How HoloLens Works
First, a patient’s photograph is obtained and processed to render a 3D image of that patient’s face, which is then transferred to a computer. “The Canfield Vectra imaging system has the capacity to take three stereoscopic photographs and stitch them together to create a single 3D image of an individual’s face,” Dr. Miller explains. “That image is then manipulated and modified to resemble what the patient would like to look like postoperatively.”
However, instead of printing the image hardcopy or having the image reside on a computer in the treatment room, the file of the converted 3D image is uploaded into HoloLens. “You can then open that file in HoloLens and see that person’s face in 3D right next to the patient in the operating room,” says Dr. Miller, a rhinoplasty specialist. “You can also actually glide the image of the face on top of the patient’s real face.”
As a result, Dr. Miller is able to precisely assess whether or not what he has discussed with the patient beforehand is now on the table, taking into account the typical swelling associated with the procedure.
“It is fairly routine, nowadays, for doctors to use some type of software to morph their patients’ photographs to provide guidance as to the patient’s intended, desired results,” Dr. Miller says. “These two-dimensional photographs in up to three different views are printed and available during surgery.”
In contrast, HoloLens is 3D, augmented reality that detects hand motion. Touching air and raising up and down the palms of the hand or fingers are among the funky maneuvers performed by Dr. Miller during surgery. “To everyone else, it appears I am acting randomly. But to me, I am actually manipulating controls that only I can see in front of me to move that hologram, which again only I can see,” he says. “With hand motions, I can twist, turn or enlarge the hologram.”