Skip to main content

Clinical acceptance of advanced visualization methods: a comparison study of 3D-print, virtual reality glasses, and 3D-display

Abstract

Background

To compare different methods of three-dimensional representations, namely 3D-Print, Virtual Reality (VR)-Glasses and 3D-Display regarding the understanding of the pathology, accuracy of details, quality of the anatomical representation and technical operability and assessment of possible change in treatment in different disciplines and levels of professional experience.

Methods

Interviews were conducted with twenty physicians from the disciplines of cardiology, oral and maxillofacial surgery, orthopedic surgery, and radiology between 2018 and 2020 at the University Hospital of Basel. They were all presented with three different three-dimensional clinical cases derived from CT data from their area of expertise, one case for each method. During this, the physicians were asked for their feedback written down on a pencil and paper questionnaire.

Results

Concerning the understanding of the pathology and quality of the anatomical representation, VR-Glasses were rated best in three out of four disciplines and two out of three levels of professional experience. Regarding the accuracy of details, 3D-Display was rated best in three out of four disciplines and all levels of professional experience. As to operability, 3D-Display was consistently rated best in all levels of professional experience and all disciplines. Possible change in treatment was reported using 3D-Print in 33%, VR-Glasses in 44%, and 3D-Display in 33% of participants. Physicians with a professional experience of more than ten years reported no change in treatment using any method.

Conclusions

3D-Print, VR-Glasses, and 3D-Displays are very well accepted, and a relevant percentage of participants with less than ten years of professional work experience could imagine a possible change in treatment using any of these three-dimensional methods. Our findings challenge scientists, technicians, and physicians to further develop these methods to improve the three-dimensional understanding of pathologies and to add value to the education of young and inexperienced physicians.

Background

Medical imaging plays a paramount role in diagnosis, particularly volumetric computed tomography (CT) and magnetic resonance imaging (MRI) with isotropic voxels [1, 2]. Many diagnoses are made not only with interpretation of axial slices, but include medical intuition gained from 2D-Displays of volumetric data sets such as multiplanar reformatted images, maximum intensity projections, and 3D volume rendering. These are collectively defined as 3D visualizations [3]. Displays using traditional flat screens do not include information of depth [4]. For example, volume rendering has made three-dimensional visualization possible, however, adding an accurate spatial impression remains challenging.

Today’s most important available options to truly convey three-dimensional images are 3D-Printing, Virtual Reality (VR)-Glasses, and 3D-Displays. First, 3D-Printing has lately received growing attention from research [5]. Using the term “3D printing” for a search in Pubmed.gov resulted in six publications in 2000, 64 publications in 2010, and astonishing 3569 results in 2020 [5, 6]. Areas of application include anatomical models, surgical guides, prosthesis, implantable or non-implantable medical devices, printing patient-specific anatomy for visualization, micro-needle, bioprinting, and pharmacoprinting [7,8,9,10,11,12,13,14,15,16,17,18]. In contrast to other technologies, segmentation of the desired structure out of the initial dataset is necessary. Several groups of specific 3D-Printing techniques exist, comprising vat photopolymerization, material jetting, binder jetting, material extrusion, powder bed fusion, sheet lamination, and directed energy deposition [3]. Often used methods for printing are material extrusion (MEX) and vat photopolymerization (VP) [19, 20]. The most economical way is MEX. For MEX, a spool of filament such as polylactic acid (PLA) or acrylonitrile butadiene styrene (ABS) is fed through a heated nozzle [21]. The nozzle then moves along pre-programmed coordinates, extruding a layer of melted material on the build plate. Layer by layer is added to create a three-dimensional model. The second mode of presentation are VR-Glasses. VR is a computer-generated simulation of a three-dimensional environment with which a person can interact using special electronic equipment. This can be combined with a wearable headset called VR-Glasses. To achieve the effect of three-dimensionality, two screens inside the VR-Glasses show two images slightly shifted in relation to each other. This results in a stereoscopic impression similar to natural viewing, where stereoscopic viewing is achieved by perceiving images through the slightly different positions of our left and right eye. In medicine, the use of VR-Glasses has been reported in three-dimensional planning of surgeries, teaching and training, non-pharmacological pain management, and in-home therapy intervention for patients with stroke [22,23,24,25,26,27,28,29,30,31,32]. Only recently, VR-Glasses have become more employed in diagnostics [33, 34].

The third method, a 3D-Display, creates a realistic three-dimensional impression in contrast to the already existing three-dimensional renderings on a flat-screen. 3D-Displays use stereoscopic vision, where slightly different images are sent to each eye, leading to depth perception. There are two ways to realize this. An autostereoscopic 3D-Display works as a stand-alone screen. The second possibility are stereoscopic displays with the additional wearing of special glasses. Three-dimensional displays have seldom been used in medicine due to their higher costs compared to a normal 2D-Display and the occasional experience of visual discomfort [35]. Some applications in displaying 3D ultrasound data or intracranial MR angiography have been reported [36,37,38]. Lastly, augmented reality (AR) receives growing interest. AR is a blend of projected computer-generated images in a real environment e.g., in an operating theater [39]. However, AR was not assessed in this study.

3D-Printing, VR-Glasses, and 3D-Displays can enhance physicians’ understanding of pathology. However, research on the subject has mostly been restricted to limited comparison of these modalities. To our knowledge, no studies are comparing the three mentioned methods. Much uncertainty still exists about the application in different disciplines and how well received the three-dimensional representations methods are in various levels of professional experience. Furthermore, existing accounts fail to investigate if physicians state a possible change in treatment using the mentioned three-dimensional methods.

To address these research gaps, this study aims:

1. To compare the three mentioned methods of 3D representations by evaluating the understanding of the pathology, accuracy of details, quality of the anatomical representation, and technical operability and investigating how well received they are in different disciplines and different levels of professional experience.

2. To ascertain if physicians state a possible change in treatment using 3D-Print, VR-Glasses, or a 3D-Display.

Methods

Participants

Interviews were conducted with twenty-three physicians employed at the University Hospital of Basel, Switzerland. Participants were recruited from disciplines where a potential for three-dimensional representation was identified, namely cardiology, oral and maxillofacial surgery, orthopedic surgery, and radiology. The possible participants were contacted via e-mail or asked personally to participate in this study. In total, fifty-two individuals were contacted. The physicians who found the time and were willing to attend a meeting in the 3D-PrintLab were included in this study. Participation was voluntary, and everyone agreed to the use of their data. In the end, twenty-three interviews were conducted between December 2018 and March 2020. Two participants (one student and one technical adviser) failed to comply with the selection criteria (not being a physician) and were therefore excluded. One physician had to be excluded due to technical problems in demonstrating the case on the VR-Glasses. The final cohort of this study consisted of twenty participants. Five physicians from each of the following disciplines took part: Cardiology, oral and maxillofacial surgery, orthopedic surgery, and radiology. Five participants had ≤5 years of professional experience, eight 6–10 years, and seven had > 10 years of professional experience. The demographics of the final participants are shown in Table 1.

Table 1 Demographics of the final cohort

Cases

Cases were chosen from a radiologist’s daily work at the University Hospital of Basel. Pathologies needed to be well recognized with the aforementioned 3D presentation systems while being similar to allow comparability. Furthermore, the chosen cases were required to be regularly occurring pathologies. In each discipline, except radiology, three different discipline-specific cases were selected to minimize bias. Each case was produced using all three modalities. In radiology, one case from each of the three other disciplines was used. In Table 2, the nine different cases are described. The preparation of all cases presented to the participants started with exporting DICOM (Digital Imaging and Communications in Medicine) data of the CT scans from the internal university hospital servers mentioned in Table 2. After that, the preparation of each of the three modalities proceeded differently. Figure 1 shows examples of prepared cases.

Table 2 Prepared cases
Fig. 1
figure 1

Examples of prepared cases. a. Dislocated right condylar fracture of the mandible on 3D-Display (picture taken through passive shutter glasses). b. Angle mandibular fracture on VR-Glasses (corresponding two-dimensional view on computer-display). c. Proximal crossing of RIVA and RCX on VR-Glasses, CT View (corresponding two-dimensional view on computer-display). d. Posterior column fracture left, 3D-printed. Data: RIVA = Ramus interventricularis anterior, RCX = Ramus circumflexus

3D-print

Exported DICOM data was segmented with 3D-Slicer (slicer.org, Version 4.10.0) [40] and final processing and integrity check was performed on Meshmixer (Autodesk, Inc., San Rafael, USA, Version 3.5.474). Slicing and printing were prepared with MakerBot Print (MakerBot Industries, New York City, USA, Version 4.6.0). Models were printed on a MEX MakerBot Replicator+ Printer (MakerBot Industries, New York City, USA) with a nozzle size of 0.4 mm, a slice thickness of 0.2 mm, and the printing material polylactic acid (PLA). Most cases were printed in 1:1 scale. However, the three orthopedic cases were printed in 0.5:1 scale due to the high print time and tall build volume needed for the 1:1 model. The time required to prepare varied between half an hour and one hour. Print duration reached from four to fifteen hours.

VR-glasses

To prepare DICOM data for VR representation specto (Diffuse Inc., Basel, Switzerland, Version 3.3.0) was used. This software uses real-time GPU volume raytracing. A three-dimensional view was created through auto-segmentation, cutting for the region of interest, and an equivalent volume rendering color look-up table (LUT). Specto then uses the Steam VR platform (Steam, Valve Corporation, Bellevue, USA, Version 1.11.11) and HTC Vive VR-Glasses (High Tech Computer Corporation, Taoyuan, Taiwan) with a resolution of 1080 × 1200 pixels per eye for representation. Two controllers were used to interact with the virtual environment, including arbitrary cutting planes, individual lightning, and the possibility of switching to a CT view. The total time needed to prepare the cases varied between half an hour and an hour and a half.

3D-display

To prepare the cases for viewing on the 3D-Display, DICOM data was imported to Cinematic Rendering Prototype (Siemens Healthineers, Erlangen, Germany, Prototype), where different tools were enabled to crop the data on the region of interest and to apply specific LUT. The three-dimensional representation was then rendered and displayed with the Syngo VectorRayCaster (Siemens Healthineers, Erlangen, Germany, Prototype) on the 3D-Display HP Zvr Virtual Reality Display (HP Inc., Palo Alto, USA, no longer in production) with a resolution of 1920 × 1080 pixels. Similar to a 3D-TV, additional glasses (passive, polarized) had to be worn. The time needed from DICOM to final representation lasted between thirty minutes and one hour.

Interviews & questionnaire

With nine cases available on all three modalities, interviews with the physicians were conducted by a 4th-year medical student. Each physician had an individual timeslot and was given a short introduction regarding methodology and the aim of the survey. The chronological order of the demonstrations followed a decreasing complexity concerning technical aspects. This approach was chosen in order to minimize the time physicians would spend in the lab in case of malfunctioning. Starting with the VR-Glasses, the participant was then presented with the first case from his discipline, followed by the presentation of the second case on the 3D-Display and a 3D-Model of the last case. While the physician was using each method, he gave oral feedback, which was written down. In the end, the physician filled out the missing information by pen. The rating scale ranged from 0 (very poor) to 10 (excellent) for the first research aim, i.e., understanding of the pathology, accuracy of details, quality of the anatomical representation, and technical operability. The accuracy of details evaluates how well details are represented e.g., the coronary arteries in the cardiology cases or the fracture gap in the maxillofacial surgery and orthopedic models. Technical operability was only assessed for VR-Glasses and 3D-Display as it concerned the user’s handling of the device used in the presentation i.e., the controllers and the mouse. Concerning the possible change in treatment, the participants were asked if in general they could imagine that the used method might lead to a change in the treatment plan. The original treatment plan was not provided, and participants were not familiar with the chosen cases. Furthermore, demographics were assessed, i.e., age, gender, discipline, years of professional experience, position within the hospital, and interest in technology. This entire procedure took around twenty minutes. For each of the disciplines the individual cases were shown. Radiologists received one case from each discipline. Cases within the discipline were randomly assigned to the participants using an alternating approach.

Statistical methods

The data acquired with the paper and pencil questionnaires was transferred to and statistically analyzed with Microsoft Excel (Microsoft Corporation, Redmond, USA, Version 16.47.1). Descriptive statistics were used for an overview of participants’ characteristics. Mean, and standard deviation (SD) were reported for normally distributed data. Absolute numbers and percentages were given for binary and categorical variables.

Ethics

A review by the institutional review board was waived. All patient data were anonymized. Furthermore, patients included in this study had already, by the time of the inclusion been treated. Therefore, this study had no impact on patients’ therapy or health.

Results

Averages

The averages including the radiologists’ feedback showed only marginal differences compared to the averages excluding the radiologists. Table 3 outlines the two averages.

Table 3 Comparison of the averages including the radiologists’ feedback with the average excluding the radiologists’ feedback

Disciplines and levels of professional experience

Understanding of the pathology: VR-Glasses are rated best in three out of four disciplines and two out of three levels of professional experience with an average of 8.1 (SD 2.0) followed by 3D-Display with 7.6 (SD 1.9) and 3D-Print with 7.5 (SD 2.3).

Accuracy of details: 3D-Display is rated best in three out of four disciplines and in all levels of professional experience. 3D-Print is last in all disciplines and all levels of professional experience. Mean of 3D-Display is 8.5 (SD 1.5), VR-Glasses 7.9 (SD 1.5) and, 3D-Print 6.6 (SD 2.3).

Quality of the anatomical representation: VR-Glasses have the best score with 8.4 (SD 1.6), closely followed by 3D-Display with 8.3 (SD 1.2) and with some offset 3D-Print with 7.6 (SD 2.0). VR-Glasses reach the best score in three out of four disciplines and two out of three levels of professional experience.

Technical operability: 3D-Display is consistently rated best in all levels of professional experience and all disciplines with an average of 8.6 (SD 1.6). VR-Glasses rated second with 7.7 (SD 1.8). 3D-Print was not assessed.

Comparing all three methods and all research questions above, the cardiologists gave the lowest rating in all queries and modalities except in one. On the other hand, orthopedic surgeons gave the best ratings except in one case. Tables 4 and 5 show all scores stratified in disciplines and level of professional experience.

Table 4 Comparison of 3D-Print, VR-Glasses and 3D-Display concerning disciplines
Table 5 Comparison of 3D-Print, VR-Glasses and 3D-Display concerning professional experience (in years)

Change in treatment

In cardiology, two out of three participants stated a possible change in treatment when using the VR-Glasses. Furthermore, three out of five radiologists reported a possible change in treatment when using VR-Glasses. In the group with a professional experience of more than > 10 years, no change in treatment could be envisioned for any of the three methods. Table 6 shows the percentage of participants who stated a change in treatment is possible using a 3D-Print, VR-Glasses, or a 3D-Display.

Table 6 Possible change in treatment, a. disciplines, b. professional work experience (in years)

Discussion

Medical imaging such as computed tomography and magnetic resonance imaging plays an essential role in developing a diagnosis. These medical image datasets are acquired in three dimensions, yet they are mostly presented on a two-dimensional display. The present study was designed to compare different three-dimensional representation methods, namely 3D-Print, VR-Glasses, and 3D-Display to understand these methods better.

All three modalities were well accepted and received a high rating in understanding of the pathology, accuracy of details, quality of the anatomical representation, and operability. Furthermore, a possible change in treatment was stated using 3D-Print or 3D-Display in one-third of the cases. Using the VR-Glasses, an even higher number of physicians (44%) reported a possible change in treatment. However, this is only true in participants with less than ten years of experience. This could indicate a possible educational component that should be explored further.

Our conclusions accord to some extent with previous studies which revealed significant potential for 3D-Printing [3, 41] and VR-Glasses [22, 25]. A study by Bartella, Kamal, Scholl, et al. evaluated the use of VR-Glasses in preoperative planning in maxillofacial surgery. They presented three different cases to four participants, which had to rate them concerning, e.g., the potential for clinical use. The authors have noted the importance of VR-Glasses in preoperative planning and teaching [42]. However, the participants were only given a chance to evaluate VR-Glasses. The strength of this study is that three different methods of 3D representations were compared. Some new conclusions can therefore be drawn. First, all methods are very well accepted by physicians. Consequently, further evaluations of the function and characteristics of these modalities to gain a more profound knowledge of their use in medicine is warranted. Second, it is somewhat surprising that the cardiologist gave the lowest rating in all questions and modalities in comparing the three methods except in one. On the other hand, orthopedic surgeons gave the best ratings except in one case. A possible explanation for this might be that gross bone fractures were chosen in all three orthopedic cases. In contrast, cardiology included three delicate coronary pathologies. This might indicate a weakness of all three methods in presenting delicate, detailed structures. This holds especially true for the cinematic rendering approach of VR and 3D-Display were elaborate segmentation technology as for 3D-Printing was not available and as such could have been obscured by neighboring structures with similar voxel intensities. This is particularly the case in cardiology. Furthermore, cardiologists are generally used to angiographies while the other disciplines routinely use CT data. This might make it more difficult for cardiologists to interact with the 3D representations.

Third, many physicians with professional work experience of less than ten years stated a possible change in treatment. However, physicians with professional experience above ten years reported in no case a possible change in therapy. This result is, to some extent, not surprising. The more experienced, the less someone can benefit from new methods. Nevertheless, this result was not expected to be so clear. This, however, renders the idea of using these three-dimensional methods as teaching tools for less experienced physicians [20, 22, 30, 42]. Lastly, the averages including the radiologists’ feedback and the averages excluding their feedback differed only slightly. This could indicate a good overall acceptance by physicians who are not familiar with these new methods. Only the averages concerning technical operability were slightly higher when including the radiologists. This could be because radiologists at the University Hospital of Basel occasionally work with VR-Glasses and 3D-Displays.

The cases chosen were regularly occurring pathologies, often with a standardized treatment plan. In choosing challenging and unusual cases, a possible change in treatment could have been stated more often. This is because the optimal therapy is more difficult to derive in complex cases. The strength of 3D representations is the presentation of challenging cases. This could have had an impact especially in the group with more than ten years of work experience.

Owing to some limitations in the sampling process, in choosing and preparing the cases and technological aspects, our findings should be interpreted with caution. The main limitation is the relatively small sample size. It proved to be very difficult to recruit a sufficient number of participants. Of fifty-two possible participants contacted, only twenty-three responded, some of them only after being contacted several times. The sample size consists of twenty male physicians selected from one university hospital. These numbers could, in further studies, be increased and diversified. However, as physicians are often hardly available due to the high workload, it is challenging to acquire more participants. This could be met in expanding the range of included hospitals and transferring the test site closer to the workplace of targeted participants. Furthermore, there was some element of selection bias. Predominantly, physicians interested in new technology were more likely to self-select to participate in this study.

Cases selected were considered suitable for three-dimensional representation and from a radiologist’s daily repertoire. Therefore, these cases represent only some possibilities. Additionally, specific fields were chosen, i.e., coronary pathologies in cardiology and bone-fractures in orthopedics and oral and maxillofacial surgery. This does not represent the entire range of eventualities. It would have been interesting to place the focus on challenging and unusual cases as this is the main strength of 3D representations. However, rather general cases were chosen so the educational value in the training of young and inexperienced physicians could also be assessed. The number of cases participants tested on each modality could also be increased given that only one case per modality was shown. It would be interesting to determine whether the groups with different professional experience react differently to distinct complexities of cases. The number of three cases per specific field was not suitable as some case/modality combinations were seen more often than others. The fields chosen could also have been more diverse e.g., neurological, or abdominal pathologies would have increased the meaningfulness of this study. Lastly, by first presenting the pathology with the VR-Glasses, bias could have been introduced. However, this was minimized as cases were switched between the different methods, and participants were not informed as to why VR-Glasses were used first.

With regards to the research question concerning accuracy of details, no comparison was given such as a CT-View. This question was based on the participants clinical experience. Most physicians are familiar with interpreting CT and MRI datasets or e.g., cardiologists with a coronary angiography. This allowed the participants to compare the three-dimensional presentations with the images they were already acquainted with. Concerning the research question for possible change in treatment, the answers were based on the respective physicians’ clinical experience and their subjective decision-making. This is often the case in the day-to-day work of physicians when deciding on the personal treatment plan. An original treatment plan was not provided as this could have led to a response bias.

Technical limitations appear when rendering or segmenting the raw DICOM data. This step has a specific susceptibility to errors, and the procedure must be conducted with caution and high accuracy. Furthermore, the technical equipment showed some shortcomings. The models were printed using the MEX technology as it was widely available in the used lab. A study by Msallem et al. attested the MEX technology the highest overall precision compared to other printing technologies [43]. The layer height of 0.2 mm was rather thick and could be lowered in further studies. However, considering the chosen cases, the pathologies were adequately represented with the employed printing resolution. Any possible negative effects regarding the haptic experience were considered to be minor. The orthopedics models were printed in a 0.5:1 scale due to the high print time and tall build volume needed. This led to a decrease in details and haptic recognition. This was noted by several orthopedic surgeons who mentioned that if the models had been 1:1, a higher rating would have been achieved. The HTC Vive VR-Glasses (High Tech Computer Corporation, Taoyuan, Taiwan) that were used have a screen resolution of 1080 × 1200 pixels per eye. Newer versions of VR-Glasses hold much higher resolutions, leading to more precise representations of pathologies. This is a significant improvement that has to be accounted for in interpreting the results of this study. Moreover, the 3D-Display that was used is no longer being produced. The software used to prepare the 3D-Prints were not CE marked medical software. This is also true for the software used to prepare the DICOM data for VR representation and for representation on the 3D-Display. However, a CE marking is not thought to be necessary as this study was conducted within an experimental research context. Furthermore, the CE label does not implicate quality and is not a certification mark. Finally, some technical difficulties occurred concerning the VR-Glasses. This included and was not limited to loosen contact and the inability to render some DICOM data. This problem must be addressed technically.

Conclusions

3D-Print, VR-Glasses, and 3D-Displays are very well accepted, and a relevant percentage of physicians with less than ten years of professional work experience could imagine a possible change in treatment using any of these three-dimensional methods. These findings have important implications for further development of three-dimensional representation tools, given their high acceptance and, in our understanding, a high percentage of physicians stating a possible change in treatment. Our findings challenge scientists, technicians, and physicians to further develop these three-dimensional representation methods to improve the three-dimensional understanding of pathologies. Furthermore, possible applications in medicine must be evaluated more clearly. On the one hand, they can facilitate the day-to-day work of physicians. On the other hand, the educational value could be of importance in the training of young and inexperienced physicians.

Availability of data and materials

All data generated or analysed during this study are included in this published article.

Abbreviations

CT:

Computed tomography

MRI:

Magnetic resonance imaging

VR:

Virtual Reality

MEX:

Material extrusion

VP:

Vat photopolymerization

PLA:

Polylactic acid

ABS:

Acrylonitrile butadiene styrene

DICOM:

Digital Imaging and Communications in Medicine

LUT:

Look-up-Table

SD:

Standard deviation

References

  1. Fishman EK, Drebin B, Magid D, Scott WW, Ney DR, Brooker AF, et al. Volumetric rendering techniques: applications for three-dimensional imaging of the hip. Radiology. 1987;163(3):737–8. https://doi.org/10.1148/radiology.163.3.3575725.

    Article  PubMed  CAS  Google Scholar 

  2. Rubin GD. Computed tomography: revolutionizing the practice of medicine for 40 years. Radiology. 2014;273(2S):S45–74. https://doi.org/10.1148/radiol.14141356.

    Article  PubMed  Google Scholar 

  3. Mitsouras D, Liacouras P, Imanzadeh A, Giannopoulos AA, Cai T, Kumamaru KK, et al. Medical 3D printing for the radiologist. RadioGraphics. 2015;35(7):1965–88. https://doi.org/10.1148/rg.2015140320.

    Article  PubMed  Google Scholar 

  4. Geng J. Three-dimensional display technologies. Adv Opt Photonics. 2013;5(4):456–535. https://doi.org/10.1364/AOP.5.000456.

    Article  PubMed  PubMed Central  CAS  Google Scholar 

  5. Chepelev L, Giannopoulos A, Tang A, Mitsouras D, Rybicki FJ. Medical 3D printing: methods to standardize terminology and report trends. 3D Print Med. 2017;3(1):4.

    Article  Google Scholar 

  6. Ballard DH, Trace AP, Ali S, Hodgdon T, Zygmont ME, DeBenedectis CM, et al. Clinical applications of 3D printing: primer for radiologists. Acad Radiol. 2018;25(1):52–65. https://doi.org/10.1016/j.acra.2017.08.004.

    Article  Google Scholar 

  7. Ghosh U, Ning S, Wang Y, Kong YL. Addressing unmet clinical needs with 3D printing technologies. Adv Healthc Mater. 2018;7(17):1–24. https://doi.org/10.1002/adhm.201800417.

    Article  CAS  Google Scholar 

  8. Tack P, Victor J, Gemmel P, Annemans L. 3D-printing techniques in a medical setting: a systematic literature review. Biomed Eng Online. 2016;15(1):1–21. https://doi.org/10.1186/s12938-016-0236-4.

    Article  Google Scholar 

  9. Matai I, Kaur G, Seyedsalehi A, McClinton A, Laurencin CT. Progress in 3D bioprinting technology for tissue/organ regenerative engineering. Biomaterials. 2020;226(October 2019):119536. https://doi.org/10.1016/j.biomaterials.2019.119536.

    Article  PubMed  CAS  Google Scholar 

  10. Meyer S, Hirsch J-M, Leiggener CS, Msallem B, Sigron GR, Kunz C, et al. Fibula graft cutting devices: are 3D-printed cutting guides more precise than a universal, reusable osteotomy jig? J Clin Med. 2020;9(12):4119. https://doi.org/10.3390/jcm9124119.

    Article  PubMed Central  Google Scholar 

  11. Park SW, Choi JW, Koh KS, Oh TS. Mirror-imaged rapid prototype skull model and pre-molded synthetic scaffold to achieve optimal orbital cavity reconstruction. J Oral Maxillofac Surg. 2015;73(8):1540–53. https://doi.org/10.1016/j.joms.2015.03.025.

    Article  PubMed  Google Scholar 

  12. Alturkistani R, Kavin A, Devasahayam S, Thomas R, Colombini EL, Cifuentes CA, et al. Affordable passive 3D-printed prosthesis for persons with partial hand amputation. Prosthetics Orthot Int. 2020;44(2):92–8. https://doi.org/10.1177/0309364620905220.

    Article  Google Scholar 

  13. Kim T, Lee S, Kim GB, Hong D, Kwon J, Park JW, et al. Accuracy of a simplified 3D-printed implant surgical guide. J Prosthet Dent. 2020;124(2):195–201.e2.

    Article  CAS  Google Scholar 

  14. Keller M, Guebeli A, Thieringer F, Honigmann P. ScienceDirect In-hospital professional production of patient-specific 3D-printed devices for hand and wrist rehabilitation Production en se ˆpital main et du poignet par impression 3D dans un ho. Hand Surg Rehabil. 2020;(xxxx).

  15. Kaae S, Lind JLM, Genina N, Sporrong SK. Unintended consequences for patients of future personalized pharmacoprinting. Int J Clin Pharm. 2018;40(2):321–4. https://doi.org/10.1007/s11096-018-0596-x.

    Article  PubMed  Google Scholar 

  16. MacLeod A, Patterson M, MacTear K, Gill HS. 3D printed locking osteosynthesis screw threads have comparable strength to machined or hand-tapped screw threads. J Orthop Res. 2020;38(7):1559–65. https://doi.org/10.1002/jor.24712.

    Article  PubMed  CAS  Google Scholar 

  17. Economidou SN, Pere CPP, Reid A, Uddin MJ, Windmill JFC, Lamprou DA, et al. 3D printed microneedle patches using stereolithography (SLA) for intradermal insulin delivery. Mater Sci Eng C. 2019;102(April):743–55. https://doi.org/10.1016/j.msec.2019.04.063.

    Article  CAS  Google Scholar 

  18. Forouzandeh F, Ahamed NN, Hsu MC, Walton JP, Frisina RD, Borkholder DA. A 3D-Printed Modular Microreservoir for Drug Delivery. Micromachines. 2020;11(7):648. https://doi.org/10.3390/mi11070648.

  19. Gross BC, Erkal JL, Lockwood SY, Chen C, Spence DM. Evaluation of 3D printing and its potential impact on biotechnology and the chemical sciences. Anal Chem. 2014;86(7):3240–53. https://doi.org/10.1021/ac403397r.

    Article  PubMed  CAS  Google Scholar 

  20. Kim GB, Lee S, Kim H, Yang DH, Kim YH, Kyung YS, et al. Three-dimensional printing: basic principles and applications in medicine and radiology. Korean J Radiol. 2016;17(2):182–97. https://doi.org/10.3348/kjr.2016.17.2.182.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Hong D, Lee S, Kim GB, Lee SM, Kim N, Seo JB. Development of a CT imaging phantom of anthromorphic lung using fused deposition modeling 3D printing. Medicine (Baltimore). 2020;99(1):e18617. https://doi.org/10.1097/MD.0000000000018617.

    Article  Google Scholar 

  22. Izard SG, Juanes Méndez JA, Palomera PR. Virtual reality educational tool for human anatomy. J Med Syst. 2017;41(5):2–7. https://doi.org/10.1007/s10916-017-0723-6.

    Article  Google Scholar 

  23. Iannicelli AM, Vito D, Dodaro CA, De Matteo P, Nocerino R, Sepe A, et al. Does virtual reality reduce pain in pediatric patients? A systematic review. Ital J Pediatr. 2019;45(1):1–6. https://doi.org/10.1186/s13052-019-0757-0.

    Article  Google Scholar 

  24. Sutherland J, Belec J, Sheikh A, Chepelev L, Althobaity W, Chow BJW, et al. Applying modern virtual and augmented reality technologies to medical images and models. J Digit Imaging. 2019;32(1):38–53. https://doi.org/10.1007/s10278-018-0122-7.

    Article  PubMed  Google Scholar 

  25. Kim Y, Kim H, Kim YO. Virtual reality and augmented reality in plastic surgery: a review. Arch Plast Surg. 2017;44(3):179–87. https://doi.org/10.5999/aps.2017.44.3.179.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Ong CS, Krishnan A, Huang CY, Spevak P, Vricella L, Hibino N, et al. Role of virtual reality in congenital heart disease. Congenit Heart Dis. 2018;13(3):357–61. https://doi.org/10.1111/chd.12587.

    Article  PubMed  Google Scholar 

  27. Lin J, Kelleher CL, Engsberg JR. Developing home-based virtual reality therapy interventions. Games Health J. 2013;2(1):34–8. https://doi.org/10.1089/g4h.2012.0033.

    Article  PubMed  Google Scholar 

  28. Ayoub A, Pulijala Y. The application of virtual reality and augmented reality in Oral & Maxillofacial Surgery. BMC Oral Health. 2019;19(1):1–8. https://doi.org/10.1186/s12903-019-0937-8.

    Article  Google Scholar 

  29. Juhnke B, Mattson AR, Saltzman D, Azakie A, Hoggard E, Ambrose M, et al. Use of virtual reality for pre-surgical planning in separation of conjoined twins: a case report. Proc Inst Mech Eng Part H J Eng Med. 2019;233(12):1327–32. https://doi.org/10.1177/0954411919878067.

    Article  Google Scholar 

  30. Stepan K, Zeiger J, Hanchuk S, Del Signore A, Shrivastava R, Govindaraj S, et al. Immersive virtual reality as a teaching tool for neuroanatomy. Int Forum Allergy Rhinol. 2017;7(10):1006–13. https://doi.org/10.1002/alr.21986.

    Article  PubMed  Google Scholar 

  31. Pfandler M, Lazarovici M, Stefan P, Wucherer P, Weigl M. Virtual reality-based simulators for spine surgery: a systematic review. Comput Aided Med Proced Spine J. 2017;17(9):1352–63. https://doi.org/10.1016/j.spinee.2017.05.016.

    Article  Google Scholar 

  32. Elsayed M, Kadom N, Ghobadi C, Strauss B, Al Dandan O, Aggarwal A, et al. Virtual and augmented reality: potential applications in radiology. Acta Radiol. 2020;61(9):1258–65. https://doi.org/10.1177/0284185119897362.

    Article  PubMed  Google Scholar 

  33. Werner P, Rabinowitz S, Klinger E, Korczyn AD, Josman N. Use of the virtual action planning supermarket for the diagnosis of mild cognitive impairment. Dement Geriatr Cogn Disord. 2009;27(4):301–9. https://doi.org/10.1159/000204915.

    Article  PubMed  Google Scholar 

  34. King F, Jayender J, Bhagavatula SK, Shyn PB, Pieper S, Kapur T, et al. An immersive virtual reality environment for diagnostic imaging. J Med Robot Res. 2016;01(01):1640003. https://doi.org/10.1142/S2424905X16400031.

    Article  Google Scholar 

  35. Prajapati S, Madrigal E, Friedman MT. Acquisition, visualization, and potential applications of 3D data in anatomic pathology. Discoveries. 2016;4(4):e68. https://doi.org/10.15190/d.2016.15.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Beitnes JO, Klæboe LG, Karlsen JS, Urheim S. Mitral valve analysis using a novel 3D holographic display: a feasibility study of 3D ultrasound data converted to a holographic screen. Int J Cardiovasc Imaging. 2015;31(2):323–8. https://doi.org/10.1007/s10554-014-0564-z.

    Article  PubMed  Google Scholar 

  37. Abildgaard A, Witwit AK, Karlsen JS, Jacobsen EA, Tennøe B, Ringstad G, et al. An autostereoscopic 3D display can improve visualization of 3D models from intracranial MR angiography. Int J Comput Assist Radiol Surg. 2010;5(5):549–54. https://doi.org/10.1007/s11548-010-0509-5.

    Article  PubMed  Google Scholar 

  38. Ahn J, Hong J. Are three-dimensional monitors more appropriate than two-dimensional monitors in the three-dimensional analysis? J Craniofac Surg. 2017;28(1):e101–4. https://doi.org/10.1097/SCS.0000000000003288.

    Article  PubMed  Google Scholar 

  39. Vávra P, Roman J, Zonča P, Ihnát P, Němec M, Kumar J, et al. Recent development of augmented reality in surgery: a review. J Healthc Eng. 2017;2017:1–9. https://doi.org/10.1155/2017/4574172.

    Article  Google Scholar 

  40. Fedorov A, Beichel R, Kalpathy-Cramer J, Finet J, Fillion-Robin J-C, Pujol S, et al. 3D slicer as an image computing platform for the quantitative imaging network. Magn Reson Imaging. 2012;30(9):1323–41. https://doi.org/10.1016/j.mri.2012.05.001.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Rengier F, Mehndiratta A, Von Tengg-Kobligk H, Zechmann CM, Unterhinninghofen R, Kauczor HU, et al. 3D printing based on imaging data: review of medical applications. Int J Comput Assist Radiol Surg. 2010;5(4):335–41. https://doi.org/10.1007/s11548-010-0476-x.

    Article  PubMed  CAS  Google Scholar 

  42. Bartella AK, Kamal M, Scholl I, Schiffer S, Steegmann J, Ketelsen D, et al. Virtual reality in preoperative imaging in maxillofacial surgery: implementation of “the next level”? Br J Oral Maxillofac Surg. 2019;57(7):644–8. https://doi.org/10.1016/j.bjoms.2019.02.014.

    Article  CAS  Google Scholar 

  43. Msallem B, Sharma N, Cao S, Halbeisen FS, Hans-Florian Zeilhofer FMT. Evaluation of the Dimensional Accuracy of 3D-Printed Anatomical Mandibular Models Using. J Clin Med. 2020;9(3):817.

    Article  Google Scholar 

Download references

Acknowledgements

We thank all participating physician und surgeons namely Benito Benitez, Matthias Benz, Denis Berdajs, Murat Bilici, Martin Clauss, Henrik Eckardt, Gregor Fahrni, Andreas Fischer, Emanuel Flury, Philip Haaf, Peter Kvarda, Sebastian Manneck, Simon Meyer, Mario Morgenstern, Moritz Neubauer, Maurice Pradella, Miodrag Salvic, Nicolas Schärli, Raphael Twerenbold and Matthias Ureel.

Funding

This study was partially funded by Siemens (Siemens Healthineers, Erlangen, Germany). This funding had no implications on the design of the study, collection, analysis, and interpretation of data and in writing the manuscript. No other resources financial in nature or otherwise were provided.

Author information

Authors and Affiliations

Authors

Contributions

JLM and PB devised the study conception and design. JLM was responsible for the data acquisition. Analysis and data interpretation was performed by JLM, PB and TH. The manuscript was drafted by JLM. Critical revision was conducted by FMT. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Julian Louis Muff.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

PB and FMT are members of the editorial board “3D Printing in Medicine”.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Muff, J.L., Heye, T., Thieringer, F.M. et al. Clinical acceptance of advanced visualization methods: a comparison study of 3D-print, virtual reality glasses, and 3D-display. 3D Print Med 8, 5 (2022). https://doi.org/10.1186/s41205-022-00133-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s41205-022-00133-z

Keywords