Cinematic rendering

Siemens Healthineers advanced Cinematic Rendering as a volume rendering technology. Cinematic rendering is an image processing technique applied in medical diagnostics to create three-dimensional, photorealistic images of cross-sectional data, such as computed-tomography, or magnetic resonance imaging (MRI). In 2017, Klaus Engel, Franz Fellner and Robert Schneider were nominated for the German Future Prize for their interdisciplinary collaboration on Cinematic Rendering.

Technology

Based on the volumetric Monte-Carlo Path Tracing algorithm, cinematic rendering traces hundreds to thousands of light path per pixel through the data generated by a virtual camera. The light input is averaged along these path and transported from high-dynamic-range images back to the virtual camera sensor. The scattering, absorption and emission is then simulated along the optical paths by means of the interaction between the light and the volumetric data, resulting in vivid, realistic anatomical images of similar image quality similar to CGI sequences used in the film industry.

Medical applications

Approved for use in the medical field, cinematic rendering is being applied to a range of different areas that include radiology (to supplement available cross-sectional images), surgery (to plan preoperative procedures, such as oral and maxillofacial surgery, trauma surgery and orthopedics), as well as cardiovascular surgery and interventional radiology. The system can also be used across disciplines to, for example, train post-graduate medical personnel, as well as support patient education and interdisciplinary clinical meetings (such as tumor boards).

Applications in medical education

Cinematic rendering technology is currently applied as a virtual educational method at specialized facilities, institutions, and centers to teach the subject of anatomy to both medical students and other healthcare professions, for example, at the JKU Faculty of Medicine at the Johannes Kepler University Linz, and for post-graduate programs in clinical areas as well as medical assistant professions.

Journal articles

1. Fellner, F.: Title: Introducing Cinematic Rendering: A Novel Technique for Post-Processing Medical Imaging Data. Journal of Biomedical Science and Engineering. 2016, 9, 170-175. doi:10.4236/jbise.2016.93013, Citation: "Since the 1980s, various techniques have been used in the field of medicine for the post-processing of medical imaging data from computed tomography (CT) and magnetic resonance (MR). They include multiplanar reformations (MPR), maximum intensity projection (MIP) and Volume Rendering (VR). This paper presents the prototype of a new means of post-processing radiological examinations such as CT and MR, a technique that, for the first time, provides photorealistic visualizations of the human body. ..."
2. Eid, M. et al.:, Titel:Cinematic Rendering in CT: A Novel, Lifelike 3D Visualization Technique. American Journal of Roentgenology, 2017, 209, doi:10.2214/AJR.17.17850, Citation: "The purpose of this article is to present an overview of cinematic rendering, illustrating its potential advantages and applications. Conclusion: Volume-rendered reconstruction, obtaining 3D visualization from original CT datasets, is increasingly used by physicians and medical educators in various clinical and educational scenarios. Cinematic rendering is a novel 3D rendering algorithm that simulates the propagation and interaction of light rays as they pass through the volumetric data, showing a more photorealistic representation of 3D images than achieved with standard volume rendering. ..."
3. Dappa, E., et al.: Cinematic rendering – an alternative to volume rendering for 3D computed tomography imaging Insights Imaging, 2016, 7, doi: 10.4236/jbise.2016.93013., Citation: "Abstract: Volume rendering (VR) represents today’s standard three-dimensional (3-D) image post-processing technique, and often is used to visualize complex anatomical information. Recently, a novel 3-D technique for post-processing of computed tomography (CT) image data has been introduced, which is called cinematic rendering (CR). ..."
4. Li, K., et al.: Value of the Cinematic Rendering From Volumetric Computed Tomography Data in Evaluating the Relationship Between Deep Soft Tissue Sarcomas of the Extremities and Adjacent Major Vessels: A Preliminary Study. Journal of Computer Assisted Tomography, 2019, 43, doi:10.1097/RCT.0000000000000852, Citation: "Abstract: Objective:The aim of the study was to assess the value of cinematic rendering (CR) from volumetric computed tomography data in evaluating the relationship between deep soft tissue sarcomas (STSs) of the extremities and the adjacent major vessels..."
5. Moser, S.E.: Cinematic Rendering: Körperkino für das Tumorboard. Deutsches Ärzteblatt, 2017, 114, 35–36, Citation in German Language: "...Cinematic Rendering: technologischer Hintergrund. Cinematic Rendering – deutsch etwa: filmische Bildsynthese – beschreibt ein 3-D-Visualisierungsverfahren. Die Technologie stammt aus der Filmbranche, wo sie unter anderem digital animierte Figuren realitätsnah in von Menschen dargestellte Filmszenen integriert – beispielsweise „Gollum“ in „Herr der Ringe“. Aus konventionellen 2-D-CT- oder MRT-DICOM-Daten errechnet die Cinematic-Rendering-Software dreidimensionale Strukturen. ..."
6. Fellner F., et al.: Virtual Anatomy: The Dissecting Theatre of the Future—Implementation of Cinematic Rendering in a Large 8 K High-Resolution Projection Environment. Journal of Biomedical Science and Engineering, 2017, 10, doi:10.4236/jbise.2017.108028, Citation: "Abstract: Modern computer techniques have been in use for several years to generate three-dimensional visualizations of human anatomy. Very good 3-D computer models of the human body are now available and used routinely in anatomy instruction. These techniques are subsumed under the heading “virtual anatomy” to distinguish them from the conventional study of anatomy entailing cadavers and anatomy textbooks. Moreover, other imaging procedures (X-ray, angiography, CT and MR) are also used in virtual anatomy instruction. A recently introduced three-dimensional post-processing technique named Cinematic Rendering now makes it possible to use the output of routine CT and MR examinations as the basis for highly photo-realistic 3-D depictions of human anatomy. ..."
7. Binder J., et al.: Cinematic Rendering in Anatomy: A Crossover Study Comparing a Novel 3D Reconstruction Technique to Conventional Computed Tomography. Anatomical Sciences Education, 2021, 14, doi:10.1002/ase.1989, Citation: "Abstract: Integration of medical imaging into preclinical anatomy courses is already underway in many medical schools. However, interpretation of two-dimensional grayscale images is dif-ficult and conventional volume rendering techniques provide only images of limited quality. In this regard, a more photorealistic visualization provided by Cinematic Rendering (CR) may be more suitable for anatomical education. ...
8. Niedermair, J., et al.: On the added benefit of virtual anatomy for dissection-based skills. Anatomical Sciences Education, 2023, 16, doi:10.1002/ase.2234, Citation: "Technological approaches deploying three-dimensional visualization to integrate virtual anatomy are increasingly used to provide medical students with state-of-the-art teaching. It is unclear to date to which extent virtual anatomy may help replace the dissection course. Medical students of Johannes Kepler University attend both a dissection and a virtual anatomy course. This virtual anatomy course is based on Cinematic Rendering and radiological imaging and teaches anatomy and pathology. ...

External links

• German Future Prize 2017 – Team 1
• Ars Electronica Futurelab: Cinematic Anatomy x Deep Space