Our objective is to permit in situ visualization of ultrasound images so that direct hand-eye coordination can be employed during invasive procedures. A method is presented that merges the visual outer surface of a patient with a simultaneous ultrasound scan of the patient’s interior. The method combines a flat-panel monitor with a half-silvered mirror such that the image on the monitor is reflected precisely at the proper location within the patient. The ultrasound image is superimposed in real time on the patient merging with the operator’s hands and any invasive tools in the field of view. Instead of looking away from the patient at an ultrasound monitor, the operator sees through skin and underlying tissue as if it were translucent.
Link to Project