Projector-based surgeon-computer interaction on deformable surfaces.

Purpose: Providing intuitive and easy to operate interaction for medical augmented reality is essential for use in the operating room. Commonly, intra-operative navigation information is displayed on an installed monitor, requiring the operating surgeon to change focus from the monitor to the surgical site and vice versa during navigation. Projector-based augmented reality has the potential to alleviate this problem.

Risk maps for liver surgery.

Purpose: Optimal display of surgical planning data in the operating room is challenging. In liver surgery, an expressive and effective intraoperative visualization of 3D planning models is still a pressing need. The objective of this work is to visualize surgical planning information using a map display.

Making the PACS workstation a browser of image processing software: a feasibility study using inter-process communication techniques.

Purpose: To enhance the functional expandability of a picture archiving and communication systems (PACS) workstation and to facilitate the integration of third-part image-processing modules, we propose a browser-server style method.

Methods: In the proposed solution, the PACS workstation shows the front-end user interface defined in an XML file while the image processing software is running in the background as a server. Inter-process communication (IPC) techniques allow an efficient exchange of image data, parameters, and user input between the PACS workstation and stand-alone image-processing software.

Illustrative visualization of 3D planning models for augmented reality in liver surgery.

Purpose: Augmented reality (AR) obtains increasing acceptance in the operating room. However, a meaningful augmentation of the surgical view with a 3D visualization of planning data which allows reliable comparisons of distances and spatial relations is still an open request.

Methods: We introduce methods for intraoperative visualization of 3D planning models which extend illustrative rendering and AR techniques.

The medical exploration toolkit: an efficient support for visual computing in surgical planning and training.

Application development is often guided by the usage of software libraries and toolkits. For medical applications, the toolkits currently available focus on image analysis and volume rendering. Advance interactive visualizations and user interface issues are not adequately supported.

Real-time illustration of vascular structures.

We present real-time vascular visualization methods, which extend on illustrative rendering techniques to particularly accentuate spatial depth and to improve the perceptive separation of important vascular properties such as branching level and supply area. The resulting visualization can and has already been used for direct projection on a patient's organ in the operation theater where the varying absorption and reflection characteristics of the surface limit the use of color. The important contributions of our work are a GPU-based hatching algorithm for complex tubular structures that emphasizes shape and depth as well as GPU-accelerated shadow-like depth indicators, which enable reliable comparisons of depth distances in a static monoscopic 3D visualization.