DESMA 9 Art + Science + Technology

Spring 2015 Professor Victoria Vesna

Section 1A

Title: Augmented Reality: Doctors by

Design

Name: Jaime Muñoz

ABSTRACT As technology continues to evolve and become more integrated into human’s daily life and rituals, it has technologists and creative individuals asking themselves, what more can be done. Advances in technology will further proliferate as it has become a new culture, especially for the millennial generation. It seems as if our world is free of challenges and obstacles for major technology companies to introduce a second, more visually stimulating world to play in. The world of augmented reality. The objective of this project proposal is to discuss the possibilities of utilizing augmented reality in various practices for the betterment of society on a global scale.

CONCEPT / TOPIC

Technology giants, Microsoft and Google serve as incubators for the most breakthrough technologies that provide those with the funds the opportunity to feel like a child again and play with the latest tech products. Bright and intuitive cross-functional teams captivate us with the idea that our future has in store what predominantly CGI films show on the big screen. However, it seems as if wearable technology can fulfil a greater purpose, specifically in medical fields where sometimes the lack of access and poor levels of communication can hinder impoverished communities from overcoming what more advanced countries see as benign maladies, diseases, and procedures. The question to ponder is if augmented reality, which seems to be a more popular concept to those in the gaming industry, can act as a tool for the medical landscape in third world countries?

CONTEXT & PRECEDENTS Even Google, who was praised for its innovative Glass product has suspended and possibly ended its sales for their smart glasses product [1]. People are just not finding a good use for it. Yet, Google has mentioned that there is a better market where they can apply their eyewear technology. The healthcare field. C o - f o u n d e r S e r g e y t o l d ForbesLife that he wanted to use technology to improve people’s “quality of life.”[2] By strategically shifting the companies' efforts, Google and Microsoft can achieve this.

Image: The New York Times

PROJECT PROPOSAL

HoloLens, for example, shows a glimpse of that their goggles can possibly accomplish. Through a camera in the goggles, the lenses know the objects you are seeing and then uses information to project 3D images on top of and even inside the objects.[3] This product is especially useful for collaborating on tasks of various difficulty levels as can be seen above. The top image shows the studying of formation of rocks on a different planet while the bottom image shows a father guiding his daughter in tightening the pipes of a faucet. This prompts gadget reviewers to ask, “imagine how this could be used to guide doctors through complex operations.” [4]

Images: Microsoft HoloLens Commercial

Holograms may seem like something of science fiction, but the hardware allows one to work with technology in a harmonious fashion and possibly reduce the chances of causing trauma during a surgery by understanding where to make incisions. [5] The surgeon and assistant will follow step by step procedures that augmented reality shows from the initial skin decision to viewing correct anatomical structures. According to project by Stanford and Droiders, augmented reality in healthcare is a game changer on simulations and live teachings. It is also a great aid for junior surgeons on safety features and can help expert surgeons on uncommon procedures. Imagine how revolutionary this would be in developing third world countries.

Project Proposal (cont.)

Image: MedicAR in Surgery

What may seem simple for surgeons and doctors in developed countries like the United States, may still be unheard of in third world countries. The introduction of augmented reality can truly benefit people, especially children, suffering from mild sicknesses and can also help with simple diagnoses to provide them with the correct medicines or treatments. In the example above, ‘Miracle’ is relatively inexpensive (Kinect, camera and TV) but it offers several advantages for anatomy education. This technology can address a really pressing issue of kids dying in Africa due to the inadequate knowledge of administering vaccines. According to UNICEF, more than 30 million kids are at risk since their families don’t have the knowledge of when to immunize their kids. This can all change. [6]

Project Proposal (cont.)

Image: Screenshot of the magic mirror ‘Miracle’

Conclusion

Augmented reality, while entertaining, can revolutionize medicine especially in developing countries. The issue then lies in how to gain the monetary funds to allow those in third world countries to gain access to this technology. Google and Microsoft are continuously creating products of the future, but their wearable technology are limited in applicable uses. If they, and other technology giants were to shift their efforts to improving quality of life for those less capable, it would truly make an impact to society on a global scale. After granting basic healthcare essentials to third world countries, these augmented reality technologies could then move into teaching emergency care through simulations such as natural disaster scenarios. The future of augmented reality is obscure, but it definitely looks promising.

References [1] "Augmented Reality in Medical Education." Perspect Med Education. N.p., 25 Jan. 2014. Web. 3 May 2015. [2] Edwards, Jim. "GOOGLE ENDS SALES OF GOOGLE GLASS." Business Insider. Business Insider, Inc, 16 Jan. 2015. Web. 03 May 2015. [3] Farr, Christina. "This Stanford Surgeon Shows Us the Future of Medicine: Augmented Reality & Google Glass (exclusive)." VentureBeat. N.p., 13 Mar. 2014. Web. 03 May 2015. [4] King, Leo. "Google Smart Contact Lenses Focuses on Healthcare Billions." Forbes. Forbes Magazine, 15 July 2014. Web. 03 May 2015. [5] "Microsoft HoloLens." Microsoft HoloLens. N.p., n.d. Web. 03 May 2015. [6] Statt, Nick. "Microsoft's HoloLens Explained: How It Works and Why It's Different - CNET." CNET. N.p., 24 Jan. 2015. Web. 03 May 2015.

Bibliography / Links [1] Anthony, Sebastian. "Google Invents Smart Contact Lens with Built-in Camera: Superhuman Terminator-like Vision Here We Come | ExtremeTech." ExtremeTech. 15 Apr. 2014. Web. 3 May 2015. [2] "Augmented Reality in Medical Education." Perspect Med Education. N.p., 25 Jan. 2014. Web. 3 May 2015. [3] Barrett, Brian. "Headline: Microsoft Shows HoloLens’ Augmented Reality Is No Gimmick." Wired.com. Conde Nast Digital, 29 Apr. 2015. Web. 3 May 2015. [4] Edwards, Jim. "GOOGLE ENDS SALES OF GOOGLE GLASS." Business Insider. Business Insider, Inc, 16 Jan. 2015. Web. 03 May 2015. [5] Farr, Christina. "This Stanford Surgeon Shows Us the Future of Medicine: Augmented Reality & Google Glass (exclusive)." VentureBeat. N.p., 13 Mar. 2014. Web. 03 May 2015. [6] "Immunization." UNICEF. N.p., n.d. Web. 03 May 2015. [7] King, Leo. "Google Smart Contact Lenses Focuses on Healthcare Billions." Forbes. Forbes Magazine, 15 July 2014. Web. 03 May 2015. [8] Lawrence, Stacey. "Google Goes after Med Tech, along with Other VCs." FierceMedicalDevices. 24 Dec. 2014. Web. 3 May 2015. [9] Madrigal, Alexis. "The World Is Not Enough: Google and the Future of Augmented Reality." The Atlantic. Atlantic Media Company, 25 Oct. 2012. Web. 3 May 2015. [10] Martin, Simon. "10 Reasons Why Microsoft's New HoloLens Could Change the Future of Product Design - SolidSmack." SolidSmack. 30 Apr. 2015. Web. 3 May 2015. <http://www.solidsmack.com/culture/10-reasons-microsofts-new-hololens-change-future-product-design/>. [11] "Microsoft HoloLens." Microsoft HoloLens. N.p., n.d. Web. 03 May 2015. [12] O'Connor, Anahad. "Google Glass Enters the Operating Room." Well Google Glass Enters the Operating Room Comments. N.p., 01 June 2014. Web. 03 May 2015. [13] Olson, Parmy. "Wearable Tech Is Plugging Into Health Insurance." Forbes. Forbes Magazine, 19 June 2014. Web. 03 May 2015. [14] Orwa, Chris. "Can Technology Replace Doctors in Third World Countries | A Conversation on TED.com." Can Technology Replace Doctors in Third World Countries | A Conversation on TED.com. Web. 3 May 2015. [15] Sacco, Al. "How Many People Actually Own Google Glass?" CIO. 4 June 2014. Web. 3 May 2015. [16] Statt, Nick. "Microsoft's HoloLens Explained: How It Works and Why It's Different - CNET." CNET. N.p., 24 Jan. 2015. Web. 03 May 2015. [17] Tilley, Aaron. "Mini's Augmented Reality Glasses Finally Give You X-ray Vision." Forbes. Forbes Magazine, 19 Apr. 2015. Web. 3 May 2015. [18] Tsukayama, Hayley. "Google's Smart Contact Lens: What It Does and How It Works." Washington Post. The Washington Post, 17 Jan. 2014. Web. 3 May 2015. [19] Williams, Owen. "Magic Leap Shows Off Its Augmented Reality Gaming." TNW Network All Stories RSS. 19 Mar. 2015. Web. 3 May 2015. [20] Winder, Mike. "Who, What, Why, When,." Wearables. 1 Jan. 2014. Web. 3 May 2015.