who.is.how
  • home
  • work
  • info

Stanford Medical School
​HoloLens Experience

2016


CLIENTS
Microsoft | Stanford Medical School | Citizen

RESPONSIBILITIES
​Spatial User Experience Design | Technical Artist

OVERVIEW
Stanford Medical School is one of a handful of academic partners that the Microsoft Showcase Team worked with internally before leveraging an external agency that was part of the Mixed Reality Partnership Program.

Stanford Medical School is always looking for new technologies that could help them augment training procedures through non-evasive means, and this was a perfect opportunity for us to help them realize their vision.

PROBLEM
One of the most important use cases to come from the workshops sessions, was to find a means in which to take preoperative MRI scans, translate that back into a 3D form, and then precisely overlaying that onto medical dummies and eventually real person.

In particular, they were focusing mainly on how to excise cancerous tumors from the breast. Using graphic-based markers, we were able to position the 3D tumor spatially in the body to appear as if it is floating "within" the body. This way the doctors and nurses can see how far they need to go in to the body to remove the cancerous tumor. If a doctor removes to much or too little of the tumor it can have ill repercussions.

APPROACH
My role as a technical artist was to work closely with our graphics engineer, to help identify and manipulate shaders that would have the effect of an X-ray. From a spatial experience deign perspective, I was identifying, prototyping and testing the best ways in which to perform both direct and indirect manipulation of cross-sectioning functionality. 

RESULTS
The rest of the design was taken on by Citizen (now part of EY), so I wasn't privy to its deployment or its measured success. It did however turn out to be a successful partnership between both Microsoft and Stanford Medical School, that has continued to grow and cement their relationship even further. Since then, the HoloLens is one of the main go to technologies for Stanford Medicine's Mixed and Extended Reality IMMERS incubator.

TOOLS
3DS Max | Photoshop | Unity

LINKS
Stanford Medicine Case Study
​Mixed-Reality System for Breast Surgical Planning White Paper
​Stanford Medicine IMMERS

IN-CAMERA SCREENSHOTS
Picture
XboxOneExtStorageWire01

MICROSOFT STANFORD HOLOLENS PROMO SCREEN CAPTURES
Picture
Picture
Picture

ADDITIONAL PROJECTS
Interaction Design
   Global Innovation Exchange Video Wall
   Carnival Safety Assembly
   Lowe's HoloLens Experience
   PACCAR HoloLens Experience
   Stanford Medical School HoloLens Experience
   HoloLens Holograms
   HeadRehab VR Rehabilitation
   Xbox One External Storage
   Xbox One Out of Box Experience

   Xbox One Digital Bundles
   Nissan Pathfinder Kinect Experience

   Planar Architectural Mosaic Displays
   Planar UltraRes MultiTouch Displays
   Autodesk FBX Review - Windows 8
   Sony Pictures Entertainment - Xbox Live App

Visualizations
   Chingay Parade Singapore 2020
   Delphi Automotive Autonomous Copilot
​   Puget Sound Energy Interactive Kiosk

   Boeing 787 Interior Visualizations
   Turn 10 Studios Logo
   Chevron Commercial - Canada
   LG Commercial - Korea
​
Games
   Xbox Live Full House Poker
   Blacklight: Tango Down
   America's Army 3
   Microsoft Train Simulator 2
   Forza Motorsport 2

   Forza Motorsport
   Microsoft Game Prototype

   Project Gotham Racing
   NFL Fever 2002
   NFL Fever 2000
Picture