{"id":33,"date":"2025-01-28T20:03:08","date_gmt":"2025-01-28T20:03:08","guid":{"rendered":"http:\/\/informaku.com\/index.php\/2025\/01\/28\/the-future-of-mixed-reality-blending-the-virtual-and-the-real\/"},"modified":"2025-01-28T20:03:08","modified_gmt":"2025-01-28T20:03:08","slug":"the-future-of-mixed-reality-blending-the-virtual-and-the-real","status":"publish","type":"post","link":"https:\/\/informaku.com\/index.php\/2025\/01\/28\/the-future-of-mixed-reality-blending-the-virtual-and-the-real\/","title":{"rendered":"The Future of Mixed Reality: Blending the Virtual and the Real"},"content":{"rendered":"\n

At Microsoft Ignite 2023, we are announcing\u00a0Copilot in Microsoft Dynamics 365 Guides<\/a>, which combines the power of generative AI with mixed reality to help frontline workers complete complex tasks and resolve issues faster with less disruption to the flow of work.<\/p>\n

Copilot in Dynamics 365 Guides assists workers in industrial settings who deal with complex equipment and processes. New technicians need to ramp up quickly while learning how to operate and service that equipment. When equipment stops functioning, workers must act quickly to diagnose the problem, implement a fix, and then document their work. Instead of workers needing to search through volumes of digital documents or paper manuals, Copilot enables workers to ask for relevant information using natural language and human gestures, such as looking and pointing. Copilot uses generative AI to search for information from technical documentation, service records, training content, and any other data sources that customers curate. Copilot then summarizes the information to provide interactive guidance through content and holograms overlaid on the equipment in operation or maintenance.<\/p>\n

Mixed reality together with AI presents a human-first interface that promises to transform real-world operations. Now, Copilot can assist industrial workers in real-time with speech and holograms.<\/p>\n

Copilot in Dynamics 365 Guides capabilities<\/h2>\n

Here are the capabilities we plan to unlock with Copilot in Dynamics 365 Guides:<\/p>\n

Point and Ask Guidance<\/h3>\n

Humans have always learned from and interacted with their environment in a hands-on manner, asking questions of others as they work. Copilot in Dynamics 365 Guides builds on that natural way of interacting to help workers better understand the world around them. Workers can point to a component on an asset and ask Copilot questions, such as \u201cWhat is the torque limit for these bolts?\u201d New workers can ask general questions, such as \u201cWhat is the function of this component?\u201d without needing to interrupt a more experienced coworker. Copilot recognizes what the user is pointing at and provides answers. 3D models and spatial maps provide the foundation for the technology to identify what the worker is looking at and then project a hologram to show instructions. Workers can ask more complex questions, such as \u201cWhich direction does this part fit?\u201d or \u201cShow me where the sensor module is on this machine,\u201d and Copilot will display holograms to show where the part belongs.<\/p>\n

Spatial Content Generation<\/h3>\n

Copilot in Dynamics 365 Guides accelerates the out-of-the-box value of mixed reality by significantly reducing the upfront investment needed to create spatial content. Copilot simplifies the creation, management, and delivery of mixed reality content using customer-defined data sources, enabling companies to adopt mixed reality much faster.<\/p>\n

Step-by-Step Assistance<\/h3>\n

Powered by Microsoft Azure OpenAI Service, large language models allow Copilot in Dynamics 365 Guides to do far more than answer one-off questions. Workers can have progressive conversations, such as \u201cWalk me through the steps to disassemble this filtration unit,\u201d or \u201cI disconnected the motor, what\u2019s next?\u201d Copilot follows along with the process and conversation using customer\u2019s curated knowledge base to articulate answers with speech, text, or 3D holograms, eliminating ambiguity and reducing the need for rework.<\/p>\n

On-demand Information<\/h3>\n

With connections to the Internet of Things (IoT) sensors, operational data, and service records, Copilot in Dynamics 365 Guides can answer questions, such as \u201cWhat is the current humidity rating?\u201d or \u201cWhen was this last inspected, and were there any concerns?\u201d\u00a0HoloLens 2<\/a>\u00a0allows Copilot to pinpoint specific assets, identify them, and access relevant information sources in real time. Frontline workers can access rich information to troubleshoot or repair with AI assistance in the context of their work.<\/p>\n

Expert Knowledge Integration<\/h3>\n

Often only a more experienced worker has the knowledge required to complete a complex task or repair a vital piece of equipment. When that worker is unavailable or retires, that knowledge is lost. Copilot in Dynamics 365 Guides can leverage notes or call transcripts from previous expert activity to guide new workers through the same process. This makes it easier and faster for workers to learn from each other and automate internal knowledge transfer\u2014bolstering workforce productivity and business agility.<\/p>\n

Streamlined Documentation<\/h3>\n

Workers will be able to use\u00a0Copilot in Dynamics 365 Field Service mobile<\/a>\u00a0to speed up the process of completing and documenting their work. Instead of filling out paperwork, workers can simply describe their progress to Copilot using their voice. Copilot will provide suggestions to efficiently check off service tasks, add notes, and update product quantities as well as statuses, accelerating data entry.\u00a0<\/p>\n

Copilot in Dynamics 365 Guides transforms the real world into a prompt and an anchor for AI. Keeping human agency at the center of the product, this tool radically transforms how computing technology can help frontline workers take action in the real world. Copilot in Dynamics 365 Guides holds significant potential for businesses seeking greater efficiency and effectiveness in their operations.<\/p>\n

Deploy Dynamics 365 Guides and Remote Assist today<\/h2>\n

The private preview for Copilot in Dynamics 365 Guides is launching today with a limited set of customers and capabilities. The upcoming public preview of Copilot in Dynamics 365 Guides will be available first on HoloLens 2, and we are planning to bring this capability to mobile devices. Interested customers can get started today by deploying\u00a0Dynamics 365 Guides<\/a>\u00a0and Remote Assist on either HoloLens 2 or mobile devices as the first step.<\/p>\n

Microsoft believes that when you create technologies that can change the world, you must also ensure that the technology is used responsibly. Copilot in Dynamics 365 Guides\u00a0is developed in alignment with\u00a0Microsoft\u2019s responsible AI standards<\/a>, and consistent with our long-standing commitment to data security and privacy, helping to ensure AI systems and solutions that are trustworthy and safe.<\/p>\n

Learn more about\u00a0Microsoft Ignite 2023<\/a>\u00a0announcements for\u00a0Dynamics 365<\/a>\u00a0and\u00a0industry transformation<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"

At Microsoft Ignite 2023, we are announcing\u00a0Copilot in Microsoft Dynamics 365 Guides, which combines the power of generative AI with mixed reality to help frontline workers complete complex tasks and resolve issues faster with less disruption to the flow of work. Copilot in Dynamics 365 Guides assists workers in industrial settings who deal with complex […]<\/p>\n","protected":false},"author":1,"featured_media":34,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[35,16],"tags":[32,33,34,15,23],"class_list":["post-33","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-software","category-technology","tag-ai-assistants","tag-ar-vr-innovations","tag-future-gadgets","tag-smart-living","tag-wearable-technology"],"_links":{"self":[{"href":"https:\/\/informaku.com\/index.php\/wp-json\/wp\/v2\/posts\/33","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/informaku.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/informaku.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/informaku.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/informaku.com\/index.php\/wp-json\/wp\/v2\/comments?post=33"}],"version-history":[{"count":0,"href":"https:\/\/informaku.com\/index.php\/wp-json\/wp\/v2\/posts\/33\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/informaku.com\/index.php\/wp-json\/wp\/v2\/media\/34"}],"wp:attachment":[{"href":"https:\/\/informaku.com\/index.php\/wp-json\/wp\/v2\/media?parent=33"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/informaku.com\/index.php\/wp-json\/wp\/v2\/categories?post=33"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/informaku.com\/index.php\/wp-json\/wp\/v2\/tags?post=33"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}