{"id":477423,"date":"2023-01-24T07:58:40","date_gmt":"2023-01-24T05:58:40","guid":{"rendered":"https:\/\/mybroadband.co.za\/news\/?p=477423"},"modified":"2023-01-24T08:48:45","modified_gmt":"2023-01-24T06:48:45","slug":"how-apples-reality-pro-headset-will-work","status":"publish","type":"post","link":"https:\/\/mybroadband.co.za\/news\/gadgets\/477423-how-apples-reality-pro-headset-will-work.html","title":{"rendered":"How Apple&#8217;s Reality Pro headset will work"},"content":{"rendered":"<p>Apple Inc.\u2019s long-anticipated mixed-reality headset is an ambitious attempt to create a 3D version of the iPhone\u2019s operating system, with eye- and hand-tracking systems that could set the technology apart from rival products.<\/p>\n<p>The roughly $3,000 device, due later this year under the likely name of Reality Pro, will take a novel approach to virtual meetings and immersive video, aiming to shake up a VR industry currently dominated by Meta Platforms Inc.<\/p>\n<p>It\u2019s a high-stakes gambit for Apple, which is expanding into its first major new product category since releasing a smartwatch in 2015, and the company needs to wow consumers.<\/p>\n<p>Apple is pushing into an uncertain market with a premium-priced product.<\/p>\n<p>The company\u2019s 1,000-person-plus Technology Development Group has spent more than seven years on the project, and Apple is counting on it to become a new revenue source \u2014 especially with sales growth poised to stall this year.<\/p>\n<p>But virtual reality has proven a challenge for the biggest titans of technology.<\/p>\n<p>Though some projections have the industry topping $100 billion by the decade\u2019s end, headsets are still seen as niche items \u2014 and Meta has\u00a0<a href=\"https:\/\/www.bloomberg.com\/news\/articles\/2022-11-11\/meta-meta-stock-drop-leaves-company-with-vr-conundrum\" target=\"_blank\" rel=\"noopener noreferrer\"><strong>lost<\/strong> <strong>billions<\/strong><\/a>\u00a0on its efforts.<\/p>\n<p>Apple\u2019s goal is to bring something new to the table.<\/p>\n<p>The eye- and hand-tracking capabilities will be a major selling point for the device, according to people familiar with the product, which is expected to cost roughly twice the price of rival devices.<\/p>\n<p>Its core features will include advanced FaceTime-based videoconferencing and meeting rooms.<\/p>\n<p>The headset also will be able to show immersive video content, serve as an external display for a connected Mac, and replicate many functions of iPhones and iPads.<\/p>\n<p>Here\u2019s how it will work: The headset will have several external cameras that can analyse a user\u2019s hands, as well as sensors within the gadget\u2019s housing to read eyes.<\/p>\n<p>That allows the wearer to control the device by looking at an on-screen item \u2014 whether it\u2019s a button, app icon or list entry \u2014 to select it.<\/p>\n<p>Users will then pinch their thumb and index finger together to activate the task \u2014 without the need to hold anything.<\/p>\n<p>The approach differs from other headsets, which typically rely on a hand controller.<\/p>\n<p>Like Meta\u2019s latest headset, Apple\u2019s device will use both virtual and augmented reality.<\/p>\n<p>With VR, users see images and content within the goggles. AR, on the other hand, overlays digital content on top of real-world views.<\/p>\n<p>The headset will have two ultra-high-resolution displays \u2014 developed with Sony Group Corp. \u2014 to handle the VR and a collection of external cameras to enable an AR \u201cpass-through mode.\u201d<\/p>\n<p>That means users will see the real world through the cameras positioned on the headset. Apple will offer users with prescription glasses custom lenses that sit within the enclosure itself.<\/p>\n<p>The device will have a so-called Digital Crown \u2014 like the Apple Watch \u2014 that lets users switch between VR and AR. When in VR, the wearer is fully immersed.<\/p>\n<p>When AR is enabled, the content fades back and becomes surrounded by the user\u2019s real environment.<\/p>\n<p>Apple expects this to be a highlight of the product, according to the people, who asked not to be identified because the project is still under wraps.<\/p>\n<p>Given that the headset is still months from being released, some features could still be canceled or changed, the people added. A spokeswoman for Apple declined to comment.<\/p>\n<div id=\"attachment_477425\" style=\"width: 2570px\" class=\"wp-caption aligncenter\"><a  data-lightbox=\"post-image\" href=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/328312279-scaled.jpg\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-477425\" class=\"size-full wp-image-477425\" src=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/328312279-scaled.jpg\" alt=\"\" width=\"2560\" height=\"1707\" srcset=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/328312279-scaled.jpg 2560w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/328312279-600x400.jpg 600w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/328312279-800x533.jpg 800w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/328312279-768x512.jpg 768w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/328312279-1536x1024.jpg 1536w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/328312279-2048x1366.jpg 2048w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/328312279-1200x800.jpg 1200w\" sizes=\"(max-width: 2560px) 100vw, 2560px\" \/><\/a><p id=\"caption-attachment-477425\" class=\"wp-caption-text\">An Apple Animoji showcased by Apple senior vice president of software engineer, Craig Federighi. Photographer: David Paul Morris\/Bloomberg<\/p><\/div>\n<p>The headset\u2019s FaceTime software will realistically render a user\u2019s face and full body in virtual reality.<\/p>\n<p>Those avatars will allow two people \u2014 each with an Apple headset \u2014 to communicate and feel like they\u2019re in the same room.<\/p>\n<p>The technology differs from virtual meeting rooms on Meta\u2019s headset, which creates a more cartoon-like avatar of the user.<\/p>\n<p>Because of the immense processing power necessary for the feature, the headset will only support realistic avatars during one-on-one video chats.<\/p>\n<p>It will still allow for FaceTime sessions with several people, but additional users will be displayed as an icon or Memoji \u2014 Apple\u2019s customised emoji.<\/p>\n<p>Apple plans to unveil the device as early as this spring, though the schedule could still shift, according to the people.<\/p>\n<p>That would let the company discuss the product at its annual conference for software developers in June and then release it later this year.<\/p>\n<p>As with some of Apple\u2019s earlier big bets, the company plans to start slow.<\/p>\n<p>It\u2019s aiming to begin early production of the device as soon as February in China and is considering launching the product in the US only to start.<\/p>\n<p>The price tag also is expected to limit the product\u2019s appeal, and Apple is already working on a cheaper version \u2014 for release in late 2024 or early 2025 \u2014 that could be closer to $1,500.<\/p>\n<p>That\u2019s what Meta charges for its mixed-reality headset.<\/p>\n<p>Apple expects to sell about 1 million units of its new headset in its first year.<\/p>\n<p>That compares with\u00a0<strong><a href=\"https:\/\/www.bloomberg.com\/news\/articles\/2022-08-11\/apple-expects-to-sustain-iphone-sales-in-2022-as-market-slows\" target=\"_blank\" rel=\"noopener noreferrer\">more than 200 million units<\/a>\u00a0<\/strong>for the iPhone, the Cupertino, California-based company\u2019s biggest moneymaker.<\/p>\n<p>In a rare move, it\u2019s also not planning to make a profit on the initial version \u2014 even at the high price \u2014 indicating that the company is taking a long-term view of the platform.<\/p>\n<p>Immersive video-watching will be a core feature of the new device.<\/p>\n<p>Apple has discussed developing VR content for the platform with about half a dozen media partners, including Walt Disney Co. and Dolby Laboratories Inc.<\/p>\n<p>And the tech giant is working to update its own Apple TV+ material to work with the headset.<\/p>\n<p>As part of the push,\u00a0<strong><a href=\"https:\/\/www.bloomberg.com\/news\/articles\/2020-05-14\/apple-acquires-startup-nextvr-to-gain-virtual-reality-content\" target=\"_blank\" rel=\"noopener noreferrer\">Apple bought<\/a>\u00a0<\/strong>streaming company NextVR in 2020, aiming to create sports content in VR.<\/p>\n<p>Apple is planning for the headset to have a dedicated video-watching feature that can make viewers feel like they\u2019re seeing a movie on a giant screen in another environment, such as a desert or outer space.<\/p>\n<p>But while the headset\u2019s video will be immersive, its speakers will be less powerful. So users will need to wear AirPods earbuds to get full spatial audio \u2014 a surround-sound effect.<\/p>\n<p><a  data-lightbox=\"post-image\" href=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Apple-revenue-sources_Bloomberg.jpg\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-477427 size-full\" src=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Apple-revenue-sources_Bloomberg.jpg\" alt=\"\" width=\"814\" height=\"448\" srcset=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Apple-revenue-sources_Bloomberg.jpg 814w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Apple-revenue-sources_Bloomberg-600x330.jpg 600w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Apple-revenue-sources_Bloomberg-800x440.jpg 800w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/Apple-revenue-sources_Bloomberg-768x423.jpg 768w\" sizes=\"(max-width: 814px) 100vw, 814px\" \/><\/a><\/p>\n<p>The device will also have productivity features, including the ability to serve as an external monitor for a Mac.<\/p>\n<p>With that feature, users will be able to see their Mac\u2019s display in virtual reality but still control the computer with their trackpad or mouse and physical keyboard.<\/p>\n<p>The headset\u2019s operating system, internally<strong>\u00a0<a href=\"https:\/\/www.bloomberg.com\/news\/articles\/2022-12-01\/apple-mixed-reality-headset-rivaling-meta-set-to-run-xros-operating-system\" target=\"_blank\" rel=\"noopener noreferrer\">called xrOS<\/a><\/strong>, will have many of the same features as an iPhone and iPad but in a 3D environment.<\/p>\n<p>That includes the Safari web browser, photos, mail, messages and the calendar app.<\/p>\n<p>And it will also have apps for the company\u2019s services, such as the App Store to install third-party software, Apple TV+, music and podcasts.<\/p>\n<p>The company is working on health-tracking functions as well.<\/p>\n<p>The experience should feel familiar to Apple users.<\/p>\n<p>When they put the headset on, the main interface will be nearly identical to that of the iPhone and iPad, featuring a home screen with a grid of icons that can be reorganised.<\/p>\n<p>Users will be able to pin widgets, such as the weather, calendar appointments, email and stock-market performance, among their app icons.<\/p>\n<p>When users need to input text, they can use the Siri voice assistant or rely on an iPhone, Mac or iPad keyboard.<\/p>\n<p>Unlike with an Apple Watch, though, an iPhone isn\u2019t required for operation.<\/p>\n<p>The company is developing technology that will let users type in midair with their hands, but such a feature is unlikely to be ready for the initial launch.<\/p>\n<figure><\/figure>\n<div id=\"attachment_477429\" style=\"width: 2570px\" class=\"wp-caption aligncenter\"><a  data-lightbox=\"post-image\" href=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/392653783-scaled.jpg\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-477429\" class=\"size-full wp-image-477429\" src=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/392653783-scaled.jpg\" alt=\"\" width=\"2560\" height=\"1706\" srcset=\"https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/392653783-scaled.jpg 2560w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/392653783-600x400.jpg 600w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/392653783-800x533.jpg 800w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/392653783-768x512.jpg 768w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/392653783-1536x1024.jpg 1536w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/392653783-2048x1365.jpg 2048w, https:\/\/mybroadband.co.za\/news\/wp-content\/uploads\/2023\/01\/392653783-1200x800.jpg 1200w\" sizes=\"(max-width: 2560px) 100vw, 2560px\" \/><\/a><p id=\"caption-attachment-477429\" class=\"wp-caption-text\">Meta Quest Pro headset. Photographer: Nic Coury\/Bloomberg<\/p><\/div>\n<p>Gaming is expected to be a popular offering from third-party developers, and Apple has created its own underlying engine to power VR games.<\/p>\n<p>In 2017, the company released ARKit and other tools to help developers prepare augmented reality experiences on the iPhone.<\/p>\n<p>This helped set the stage for programmers to build apps, games and services for the headset.<\/p>\n<p>The Apple device will include a variation of the M2 chip found in the company\u2019s latest Macs, as well as a dedicated processor for graphics and mixed-reality experiences.<\/p>\n<p>That second chip will be dubbed the Reality Processor, according to<strong>\u00a0<a href=\"https:\/\/www.bloomberg.com\/news\/articles\/2022-08-28\/what-will-apple-call-its-ar-vr-headsets-reality-one-reality-pro-names-emerge\" target=\"_blank\" rel=\"noopener noreferrer\">trademark applications<\/a><\/strong>\u00a0filed by the tech giant.<\/p>\n<p>But making the processors powerful enough brought another concern: having the device overheat while it\u2019s on a user\u2019s face.<\/p>\n<p>To address that problem, Apple made the decision to offload the battery from inside of the headset to an external pack.<\/p>\n<p>It rests in a user\u2019s pocket and connects over a cable. Another tweak is the inclusion of a cooling fan like on high-end Macs.<\/p>\n<p>The headset can last about two hours per battery pack, in line with rival products.<\/p>\n<p>The battery, however, is large: roughly the size of two iPhone 14 Pro Maxes stacked on top of each other, or about 6 inches tall and more than half an inch thick.<\/p>\n<p>Still, some internal prototypes for software development have a built-in battery and charge over USB-C.<\/p>\n<p>Meta, in contrast, puts its batteries on the back of its headset in a way that helps balance the device on a person\u2019s head.<\/p>\n<p>Apple\u2019s approach may ultimately be less comfortable for users, especially if they\u2019re watching a whole movie while wearing the headset.<\/p>\n<p>Some testers have complained that the product can be cumbersome, according to the people.<\/p>\n<p>The relatively brief battery life \u2014 about 20 hours less than Apple\u2019s latest MacBook Pro \u2014 could create its own hassles.<\/p>\n<p>If users want to watch multiple movies or play games for hours at a time, they may need to buy multiple batteries and frequently swap them out.<\/p>\n<p>Apple has acknowledged those challenges internally, and it\u2019s been trying to set realistic expectations for the product.<\/p>\n<p>One benefit of the device, the company believes, is that it could spur customers to visit Apple retail stores \u2014 not necessarily to buy the product, but to try it out.<\/p>\n<p>They may then purchase another device, such as an iPad or AirPods.<\/p>\n<p>To show off the new headset, Apple is creating a \u201cstore within a store\u201d concept \u2014 an area within its retail outlets dedicated to demonstrating the product.<\/p>\n<p>The company did something similar when it launched the Apple Watch, which is now central to a $41 billion division.<\/p>\n<p>The initial headset will be made from aluminium, glass and cushions \u2014 and be reminiscent of Apple\u2019s $550 AirPods Max headphones.<\/p>\n<p>The product will have a curved screen on the front that can outwardly show a wearer\u2019s eyes, with speakers on the sides and a headband that helps fit the device around a user\u2019s head.<\/p>\n<p>That will differ from the mostly plastic design of rival products, which typically strap the device to the wearer with multiple bands.<\/p>\n<p>The eye and hand tracking may end up being the most memorable element of the headset.<\/p>\n<p>As with its earlier big bets, Apple likes to include a groundbreaking interface that sets its products apart from competitors.<\/p>\n<p>With the iPod, it was the click wheel. With the iPhone and iPad, it was the multitouch approach. And with the Apple Watch, it was the Digital Crown.<\/p>\n<p>Now Apple hopes the headset\u2019s sci-fi-like interface will make its latest product a winner.<\/p>\n<h2 class=\"my-4\">Now read: <a href=\"https:\/\/mybroadband.co.za\/news\/hardware\/477323-apple-working-on-3nm-m3-chip-for-next-macbook-air-and-imac.html\" rel=\"bookmark\">Apple working on 3nm M3 chip for next MacBook Air and iMac<\/a><\/h2>\n","protected":false},"excerpt":{"rendered":"<p>The roughly $3,000 device, due later this year under the likely name of Reality Pro, will take a novel approach to virtual meetings and immersive video, aiming to shake up a VR industry currently dominated by Meta Platforms.<\/p>\n","protected":false},"author":341034,"featured_media":428920,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[29],"tags":[605,83859,83861,74602,73842,74056,29210],"class_list":["post-477423","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-gadgets","tag-apple","tag-apple-mixed-reality-headset","tag-apple-reality-pro","tag-augmented-reality-ar","tag-meta-platforms","tag-metaverse","tag-virtual-reality-vr"],"_links":{"self":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/477423"}],"collection":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/users\/341034"}],"replies":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/comments?post=477423"}],"version-history":[{"count":1,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/477423\/revisions"}],"predecessor-version":[{"id":477431,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/posts\/477423\/revisions\/477431"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media\/428920"}],"wp:attachment":[{"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/media?parent=477423"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/categories?post=477423"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mybroadband.co.za\/news\/wp-json\/wp\/v2\/tags?post=477423"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}