- Open Access
Systematic review of three-dimensional printing for simulation training of interventional radiology trainees
3D Printing in Medicine volume 7, Article number: 10 (2021)
Rationale and objectives
Three-dimensional (3D) printing has been utilized as a means of producing high-quality simulation models for trainees in procedure-intensive or surgical subspecialties. However, less is known about its role for trainee education within interventional radiology (IR). Thus, the purpose of this review was to assess the state of current literature regarding the use of 3D printed simulation models in IR procedural simulation experiences.
Materials and methods
A literature query was conducted through April 2020 for articles discussing three-dimensional printing for simulations in PubMed, Embase, CINAHL, Web of Science, and the Cochrane library databases using key terms relating to 3D printing, radiology, simulation, training, and interventional radiology.
We identified a scarcity of published sources, 4 total articles, that appraised the use of three-dimensional printing for simulation training in IR. While trainee feedback is generally supportive of the use of three-dimensional printing within the field, current applications utilizing 3D printed models are heterogeneous, reflecting a lack of best practices standards in the realm of medical education.
Presently available literature endorses the use of three-dimensional printing within interventional radiology as a teaching tool. Literature documenting the benefits of 3D printed models for IR simulation has the potential to expand within the field, as it offers a straightforward, sustainable, and reproducible means for hands-on training that ought to be standardized.
Simulation-based training is a method of experiential teaching that reproduces a real-world scenario in a controlled setting. Conventionally used to replicate high-risk tasks in areas such as military training, aviation, and aerospace professions , simulation-based training has become a prominent complement within medical education [2, 3]. Simulations can be performed outside of working hours, and certain procedural skills can be customized or repeated for a trainee’s needs, without compromising patient safety. Radiology residents and medical students are generally supportive of simulation use, as both groups have reported higher procedural confidence after completing a session on a number of diagnostic or interventional simulators [4,5,6,7,8,9,10].
Simulation training is especially relevant for procedural specialties like IR, where learners rely on haptic cues for skill acquisition . There is an extensive amount of simulation options currently integrated into the medical field such as video games for inferior vena cava filter placement or percutaneous image-guided interventions [12, 13], phantom simulators for Computed Tomography (CT) biopsies [10, 14,15,16], and animal or cadaver models to practice endovascular access or interventions [17, 18]. Several studies have used simulators to demonstrate improved procedural technique, either in device manipulation [19,20,21], successful vessel cannulation , or reduced procedural time and radiation use [23,24,25]. There is burgeoning evidence demonstrating skill retention after the simulation , which has translated to improved patient outcomes. Such an example was documented by Andretta et al., who noted increased procedural proficiency and successful PICC line placement among interns who completed a simulation rotation on ultrasound-guided access .
Despite their advantages, simulations have several operational limitations and a correlative cost-benefit ratio. Simulation can be categorized by degree of situational realism, anatomic accuracy, or physiologic replication . Although high-fidelity models have been shown to significantly increase technical performance in a simulated environment , they are often of higher cost, may have limited availability, or, if using animal or cadaver sources, can raise ethical concerns [18, 27, 29]. The reference standard in simulation medicine is the ability to develop a reproducible, realistic, and inexpensive product, which may be refined via three-dimensional (3D) printing. 3D printing has an emerging role within medicine and one of its primary benefits for the clinical realm includes the ability to produce patient-specific modeling from de-identified segmented stereolithography (STL) files, as this serves to augment several clinical applications, including trainee simulation [30, 31].
3D-printed models for simulation learning have been tested and positively received by trainees [32,33,34,35,36]. Some studies have found that 3D printed simulations increased student test scores when studying physiologic [34, 37] and pathologic [38,39,40,41] anatomy. 3D printed models have also facilitated groups of dental and surgical trainees in developing better preoperative plans [42, 43]. They have been shown to improve simulator procedural performance among anesthesia residents  and reduce fluoroscopy and simulator procedural times on endovascular aortic procedures with vascular surgery residents [45,46,47].
Radiology is well-poised to integrate 3D printing within simulation training. Prototypes, ranging from the lumbar spine to complex vasculature [48,49,50,51], have successfully been printed and can be modified for simulation purposes. While the role of three-dimensional printing for trainee education has been documented in other procedural specialties, there is a lack of knowledge about the role of 3D printing for trainee education within IR. Thus, the purpose of this review was to analyze the current articles that discuss the role of 3D printing for IR trainee education and emphasize the need for future experimentation.
A literature query was conducted through April 2020 for articles discussing the use of 3D printing in IR simulation experiences via PubMed, Embase, CINAHL, Web of Science, and the Cochrane Library databases. Key search terms and boolean operators can be found in Table 1.
After removing duplicate records, non-English articles, and abstract-only articles, the remaining articles were reviewed. Articles were excluded if they did not feature the use of a 3D printed simulation models for interventional procedures by trainees, defined as either medical students, diagnostic radiology or interventional radiology residents, or interventional radiology fellows. For combined groups, more than 50% of the participants needed to identify as either medical students, diagnostic radiology or interventional radiology residents, or interventional radiology fellows. Figure 1 outlines the systematic review.
To assess data quality, studies were evaluated by two reviewers using the Quality Assessment of Diagnostic Accuracy Studies - 2 (QUADAS-2) tool (Fig. 2) .. The index test was the evaluated 3D printed simulation in each study. The reference standard included a comparison to evaluate the 3D-printed simulation, which could include a pre- and post- assessment, control simulation, or outcomes from a control group. Two independent reviewers appraised these articles.
As noted in Fig. 1, the initial search yielded 843 records and was reduced to a total of 466 after removal of 377 duplicates. Of these, 51 of 466 records were further excluded due to a lack of full-text and availability of the record in English. The majority of excluded articles were original research articles that were not related to 3D printing. Of the 131 articles that discussed 3D printing, 44 of 141 (31.2%) of those articles featured trainee involvement, and 23 of the 44 (52.7%) of these articles featured a 3D printing procedure-oriented simulation. Among the remaining 23 articles, four articles featured our trainee population of interest (i.e. radiology or interventional radiology residents/fellows or medical students) and were included in the primary review.
The 19 remaining articles were excluded because they did not feature the target trainee population or the target trainee population was not represented by at least 50% of trainees in the study. The excluded articles implemented the use of 3D printed models for medical trainees in a variety of specialties. The predominant specialty that integrated 3D printing into its simulations was neurosurgery with seven articles [53,54,55,56,57,58,59]. These studies used 3D printed models of the cerebral vascular network to train neurosurgery residents and fellows on procedures such as cerebral aneurysm clipping and endoscopic ventriculostomy. Vascular surgery and anesthesiology were mentioned in three articles each [46, 47, 60,61,62,63]. The vascular surgery articles focused on endovascular repair of aneurysms and needle puncture of the gluteal artery using 3D printed vascular models while the anesthesiology articles used 3D printed models to simulate fiberoptic bronchoscopy procedures, thoracic spinal needle insertion, and central venous access [46, 47, 60,61,62,63]. Urology had a total of two articles where one of the articles featured interventional radiology trainees; however, this study did not meet the criteria of at least 50% IR trainee involvement [32, 64]. A 3D printed bladder was used to simulate urethrovesical anastomosis repair in one of the articles while the other article had a 3D printed human pelvicalyceal system, kidney, and adjacent structures to simulate percutaneous nephrolithotomy [32, 64]. The remaining articles had only one study associated with its specialty: cardiology (3D printed heart for electrophysiology training) , otolaryngology (3D printed model of the sinuses and skull base for anatomical education) , oral and maxillofacial surgery (3D printed model of the orbit for orbital surgery training) , and dentistry (3D printed model of pediatric dentition for pediatric dental education) .
All of the 19 excluded articles showed a general positive attitude toward 3D printed simulations where these models could be used for medical anatomy education as well as development of medical trainees’ procedural skills [32, 46, 47, 53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68]. The majority of these articles, 17 articles, tested the 3D simulations with trainees further in their medical career such as residents, fellows, or attendings [32, 46, 47, 53, 55, 57,58,59,60,61,62,63,64,65,66,67,68]. The remaining two articles consisted of medical students and residents [54, 56]. The higher level of trainees provides a more accurate assessment of particular values such as face, content and constructive validity due to the increased exposure to the real life procedures.
Out of the 19 omitted articles, two of the articles analyzed the face, content and construct validity of 3D printed simulators and revealed a positive trend in both studies [32, 58]. Weinstock et al. had a high face validity mean score at 4.69/5.00, a high content validity at 4.88/5.00, and a construct validity score that indicated that the 3D model provided a significant means to distinguish between novices and expert surgical skills when performing endoscopic ventriculostomy . Ghazi et al. had similar results compared to Weinstock et al. with a high face validity at 4.5/5.0, a high content validity at 4.6/5.0, and a construct validity score that supports the theory that a 3D constructed percutaneous nephrolithotomy simulation provides a comprehensive tool for surgical skills development and evaluation before hand-on experience . The high rated face, content, and construct validity ultimately emphasizes the benefits of 3D printed simulations and its practicality compared to real world procedures.
Although numerous articles reported a decreased cost of their 3D printed simulations [53, 54, 56], only two of the articles (anesthesia and cardiology) directly compared their 3D simulation to commercially available models [62, 65]. Pederson et al. noted a $110 3D printed bronchoscopic simulator compared to a commercial model priced greater than $2590 . Seslar et al. featured a $2000 3D printed electrophysiology simulator compared to commercially available models valued at over $100,000 . These two examples give a limited view of the possible cost benefits of 3D printing with medical training.
All of the criteria fulfilling articles reviewed were single institution studies with small sample sizes. The simulated procedures in the aforementioned articles included endoscopic biliary drainage , minimally-invasive CT-guided spine procedures , and ultrasound guided femoral artery access [71, 72]. Two of the studies analyzed the performance of IR procedures using medical students as the sole test population. Sheu et al. included a randomized assortment of medical students ranging from all years of training (n = 49) while Li et al. recruited first- and second-year medical students (n = 13). O’Reilly et al. invited a cohort of first year radiology physicians in training, (n = 19) for their study. Bundy et al. recruited the most diverse test population with varying backgrounds in medicine, including: technologists (n = 2), medical students (n = 1), residents (n = 2), fellows (n = 4) with consulting attending physicians (n = 2). To evaluate the effectiveness and provide a statistical method of comparison of simulation training using 3D printed materials, each study implemented a distinct approach. The heterogeneity in reported results was the main issue identified by QUADAS-2 assessment, which the reviewers assessed as a low to moderate degree of bias.
In addition to the similarities in the test populations, all four of the studies implemented a pre- and post-test questionnaire that utilized a Likert scale to quantify subjective opinions on 3D printing in IR training. Bundy et al. and Li et al. used a 10-point likert scale to assess the comfort with endoscopic techniques and lumbar punctures respectively. O’Reilly et al. used a 6-point Likert scale to assess the preference between a 3D printed and a commercially available femoral access model of the lower limb in teaching vascular access. Sheu et al. used a five-point likert scale to compare the ease of use, usefulness in practice and student confidence when using a 3D printed and commercially available phantom for femoral artery access.
All four of the studies reported positive feedback regarding the use of 3D printed models for trainee simulation. The comfortability and preference to use 3D printed models for endoscopic training increased in four different procedures as noted in Bundy et al.; however, the only statistically significant results included a 39.7% (p < 0.05) increase in comfortability performing endoscopic cholecystostomy and a 39.7% (p < 0.05) increase in the trainee’s likelihood to use endoscopy for percutaneous gastrostomy placement. Li et al. showed a significant increase in the confidence in needle stick placement for a control group, which was trained on a 3D model once, and a training group, which was trained on a 3D model twice. The confidence for the control group changed from 1.83 ± 2.0 to 5.8 ± 1.6 with p < 0.004 while the training group had a change in confidence from 1 ± 0 to 6.1 ± 1.1 with p < 0.00001. Additionally, there was a significant reduction in the number of needle stick placements for the training group when comparing the initial session, 8.0 ± 1.3 and the final session, 5.4 ± 1.5, with p < 0.005. The study further associated a 4.5 mGy-cm reduction of dose with a reduction of 3 needle readjustments, which correlates to a decreased reduction of radiation dose for the training group.
The preference to use the 3D printed model over a commercially available model for femoral artery access training was noted in O’Reilly et al. with an average rating of 5.1 out of 6. Sheu et al.’s results demonstrated that the majority of students in both the 3D printed ultrasound compatible vascular access model (3DPVAM) and commercial model (CM) groups agreed or strongly agreed that the models were useful for practice (96.2% and 95.7%, respectively; p < 0.87). Student confidence in performing femoral artery access increased by 2 Likert points in both trainee groups. Additionally, there was no difference in the average confidence change when comparing the training experience using the 3D printed model and the commercially produced model (p < 0.001).
The majority of the test populations in the excluded articles, 17 out of the 19 articles, consisted of higher-level medical professionals including residents and attendings [32, 46, 47, 53, 55, 57,58,59,60,61,62,63,64,65,66,67,68]. This contrasts with the 4 included articles where 2 out of the 4 studies used medical students as their test subjects [70, 72]. Although this provides a unique, unbiased perspective in the evaluation of the ability of the simulators to teach particular procedures, the medical students’ analysis may not accurately reflect the simulators’ realism and overall efficacy compared to the clinical procedures and its real-life application. Further research using residents, fellows and attendings would greatly benefit future studies on 3D printed simulations in IR. Future articles analyzing the benefits of 3D printed simulators would benefit from more stringent statistical analysis by including face, content, and construct validity. As noted in two of the articles, there was a positive trend in all three of the specified validity analyses [55, 65]. A common theme in the 4 included articles and the 19 excluded articles was the positive feedback in favor of the integration of 3D printed models in trainee simulations [32, 46, 47, 53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72]. The feedback was attained through post-simulator testing questionnaires. These evaluations had a diverse array of subjective questions ranging from how the subjects’ confidence changed in performing the procedure after training with the 3D model to the simulations’ ability to effectively mimic the real-life procedures.
A recent needs-assessment survey prioritized the development of ultrasound-guided or interventional procedures for simulation-based training . Contrary to aforementioned evidence of existing IR simulators [10, 12,13,14,15,16,17,18], interventional-based simulations remain one of the least common training opportunities available . A survey conducted by Matalon et al. found that 40% of radiology residents do not use simulations as part of their procedural training . The limited number of available articles that features three-dimensional printing in IR simulation training highlights this area of unmet need within radiology training. While it is possible that we missed a relevant study for our review, this limitation was minimized by using free text and MeSH terms across multiple databases. The only articles we did not review were ones that either had no full-text article or were a non-English article, which comprised a minority (51/466 = 10.9%) of our excluded articles.
There is a lack of quantitative or validated simulation measures. Simulators may not always be able to decipher between experienced or novice operators [74, 75] and must be educationally validated to be useful. Mechanisms for validation include: face validity, content validity, concurrent validity, discriminant validity, and predictive validity, defined in Table 2 . While each of our studies fulfilled face validity by demonstrating how the simulations appeared under imaging, only Li et al. evaluated content validity in evaluating the students’ abilities to complete the intervention (i.e. CT-guided facet block) . Sheu et al. tested concurrent validity by comparing their 3D printed model to the FemoraLineMan CM (Simulab Corp, Seattle, Washington), a commercially available femoral access simulator . This degree of variation in objective feedback raised concerns for a low to moderate degree of bias during QUADAS-2 evaluation.
A potential reason for a limited number of validation measures was that the study population was primarily medical students, as opposed to residents or fellows. Medical students’ lack of clinical experience compared to residents, fellows, or attendings minimizes confounders when evaluating procedural performance [17, 72]. While each study could circumvent its study population limitations by establishing face validity on appropriate imaging modalities, future studies evaluating 3D printed simulation will require more robust testing with residents and attendings, especially in regard to predictive validity. Current literature regarding predictive validity for preoperative planning is encouraging, as investigators have associated the use of 3D printed simulations or guides with reduced operative times [77, 78]. Within simulation literature, this appears to have only been evaluated in audiology trainees for proper hearing-aid placement , where trainees who practiced on a 3D printed simulator achieved a higher percentage of proper hearing-aid placement compared to those who practiced on the control model.
Given the strengths and limitations of the available literature, future studies focusing on 3D printed procedural simulation models for interventional radiology trainees could benefit from the inclusion of an adequate number of trainees particularly from senior years of training. Additionally, robust pre study baseline assessment using both subjective Likert scale questionnaires as well as objective measures of skill such as time to complete the procedure or number of attempts needed before success is crucial for post study result analysis. Ensuring the study can evaluate face, content and construct validity is valuable in generalizing the results to a larger population. Studies should have redundancy of raters if subjective observations are being made. Comparison of the 3D printed simulator with commercially available models including the cost analysis would be of great help to those trying to justify incorporating 3D printed simulation in their training program. Although many simulators do exist, the number of applications in interventional radiology remains limited. Table 3 outlines possible procedures that may benefit from 3D printed simulation training.
A common theme noted between these studies was the reduced production cost of these models compared to commercially available alternatives. The biliary simulation was one of the cheapest models to produce, costing approximately $170 for materials, while the lumbar spinal simulation, which required staged printing of bony structures, nerves, and vessels before assembly, was estimated to cost $5400. Sheu et al.’s femoral access model, with an estimated lifetime of approximately a dozen punctures, cost around $647 for the initial model and $100 to replace the 3D-printed vessels. This vastly differs from the competitive alternatives, which may cost between $2000–$4000, with replacement parts costing between $600 and $1600 . This, however, does not factor the printer and software costs, which, again, widely varied between studies. Printed models first require segmentation, which can be completed on either free, open-source software or require purchasing high-end modeling software , while actual printers can range from $6000–$750,000 . The financial cost and operational resources associated with 3D printing requires funding and institutional support, which may be another factor in the limited number of simulation articles for IR-related procedures. However, despite upfront investment, these costs can be shared across a hospital, and its resources, from preoperative modeling, simulations, and patient education, are applicable within multiple specialties [30, 31]. Although the costs of owning a printer for a particular lab can require a significant financial upfront investment, there are many various options to circumvent this issue. Many of the larger academic universities have their own 3D printing workshops, often housed in the central library and accessible to any member of campus. With this option in mind, a lab can send their designs into these workshops to help put together their particular devices. If the researchers’ organization does not have any in-house printers or specific materials, the product can be outsourced to a 3D printing service. Although owning a printer provides benefits such as on demand production and eventual lower costs, outsourcing provides its own unique benefits including no upfront investment, a wider array of 3D printing technologies and materials that can fit a certain criteria, and the availability of design expertise and recommendations when determining a design . With these options in mind, it is also reasonable to consider using an in-house as well as an outsourced 3D printer based on the particular material needs as well as specific printer requirements of the project .
Available literature, while supportive of the use of 3D-printing within vascular surgery, cardiology and for procedures performed by non-radiological specialties, is sorely lacking for interventional radiology. The paucity of literature regarding 3D-printing for simulation learning within IR reveals an essential area of improvement in medical education curricula. A lack of objective outcomes hinders advancements in simulation learning, to the disadvantage of trainees. Subsequent research and standardization of 3D-printed simulated experiences can offer more uniform and controlled learning opportunities for trainees to safely refine procedural techniques in the unique field of IR.
Summary of points
3D printing has been utilized as a means of producing high-quality simulation models for trainees in procedure-intensive or surgical subspecialties.
Less is known about its role for trainee education within interventional radiology.
Our search identified a scarcity of published sources that appraised the use of three-dimensional printing for simulation training in IR where a total of four articles were found.
Although presently available literature endorses the use of three-dimensional printing within interventional radiology as a teaching tool, there is a lack of studies that evaluates the predictive validity of 3D-printed simulation-based training in IR.
Further research and integration of 3D-printed simulations into IR medical training can help develop and expand this field to a great extent.
Availability of data and materials
Al-Elq AH. Simulation-based medical teaching and learning. J Family Community Med. 2010;17(1):35–40. https://doi.org/10.4103/1319-1683.68787.
Kusunose K, Yamada H, Suzukawa R, Hirata Y, Yamao M, Ise T, et al. Effects of transthoracic echocardiographic simulator training on performance and satisfaction in medical students. J Am Soc Echocardiogr. 2016;29(4):375–7. https://doi.org/10.1016/j.echo.2015.12.002.
Mirza S, Athreya S. Review of simulation training in interventional radiology. Acad Radiol. 2018;25(4):529–39. https://doi.org/10.1016/j.acra.2017.10.009.
Alsafi A, Alsafi Z, Hamady MS. TEVAR planning and simulation training improves trainee confidence. [P-189]. Cardiovasc Intervent Radiol. 2015;32(3):265–71.
Hoang NS, Ge BH, Kuo WT. Developing and evaluating a simulator for complex IVC filter retrieval. Acad Radiol. 2020;27(6):885–8. https://doi.org/10.1016/j.acra.2019.08.008.
Matalon SA, Chikarmane SA, Yeh ED, Smith SE, Mayo-Smith WW, Giess CS. Variability in the use of simulation for procedural training in radiology residency: opportunities for improvement. Curr Probl Diagn Radiol. 2019;48(3):241–6. https://doi.org/10.1067/j.cpradiol.2018.02.008.
Nitsche JF, Conrad S, Hoopes S, Carrel M, Bebeau K, Brost BC. Continued validation of ultrasound guidance targeting tasks: assessment of internal structure. Acad Radiol. 2019;26(4):559–65. https://doi.org/10.1016/j.acra.2018.08.011.
Orr KE, Hamilton SC, Clarke R, Adi MY, Gutteridge C, Suresh P, et al. The integration of transabdominal ultrasound simulators into an ultrasound curriculum. Ultrasound. 2019;27(1):20–30. https://doi.org/10.1177/1742271X18762251.
Picard M, Nelson R, Roebel J, Collins H, Anderson MB. Use of Low-Fidelity simulation laboratory training for teaching radiology residents CT-guided procedures. J Am Coll Radiol. 2016;13(11):1363–8. https://doi.org/10.1016/j.jacr.2016.05.025.
Sekhar A, Sun MR, Siewert B. A tissue phantom model for training residents in ultrasound-guided liver biopsy. Acad Radiol. 2014;21(7):902–8. https://doi.org/10.1016/j.acra.2014.03.002.
Johnson SJ, Guediri SM, Kilkenny C, Clough PJ. Development and validation of a virtual reality simulator: human factors input to interventional radiology training. Hum Factors. 2011;53(6):612–25. https://doi.org/10.1177/0018720811425042.
Jeun B, Ghassemi J, Pua BB. Simulation training in inferior vena cava filter placement. [Abstract No. 440]. J Vasc Interv Radiol. 2012;23(3, Suppl):S174.
Ghassemi J, Jeun B, Pua BB. Simulation training in percutaneous image-guided interventions. [Abstract No. 387]. J Vasc Interv Radiol. 23 (3, Suppl), S154 (2012).
Baadh A, Fadl A, Georgiou N, Hoffmann JC. A pilot program for use of a homemade phantom for CT biopsy simulation training. [Abstract No. 376]. J Vasc Interv Radiol. 26 (2, Suppl), S167 (2015).
Johnson SJ, Hunt CM, Woolnough HM, Crawshaw M, Kilkenny C, Gould DA, et al. Virtual reality, ultrasound-guided liver biopsy simulator: development and performance discrimination. Br J Radiol. 2012;85(1013):555–61. https://doi.org/10.1259/bjr/47436030.
Villard PF, Vidal FP, ap Cenydd L, et al. Interventional radiology virtual simulator for liver biopsy. Int J Comput Assist Radiol Surg. 9 (2), 255–267 (2014).
Meek MEM, Meek JC, Hollowoa B, Li R, Deloney LA, Phelan KD. Lightly embalmed cadavers as a training tool for ultrasound-guided procedures commonly used in interventional radiology. Acad Radiol. 2018;25(11):1503–9. https://doi.org/10.1016/j.acra.2018.05.019.
McLeod H, Cox BF, Robertson J, Duncan R, Matthew S, Bhat R, et al. Human Thiel-embalmed cadaveric aortic model with perfusion for endovascular intervention training and medical device evaluation. Cardiovasc Intervent Radiol. 2017;40(9):1454–60. https://doi.org/10.1007/s00270-017-1643-z.
Coates PJ, Zealley IA, Chakraverty S. Endovascular simulator is of benefit in the Acquisition of Basic Skills by novice operators. J Vasc Interv Radiol. 2010;21(1):130–4. https://doi.org/10.1016/j.jvir.2009.09.013.
Powell DK, Jamison DK, Silberzweig JE. An endovascular simulation exercise among radiology residents: comparison of simulation performance with and without practice. Clin Imaging. 2015;39(6):1080–5. https://doi.org/10.1016/j.clinimag.2015.08.013.
Saratzis A, Calderbank T, Sidloff D, Bown MJ, Davies RS. Role of simulation in endovascular aneurysm repair (EVAR) training: a preliminary study. Euro J Vasc Endovasc Surg. 2017;53(2):193–8. https://doi.org/10.1016/j.ejvs.2016.11.016.
Narra P, Kuban J, Grandpre LE, Singh J, Barrero J, Norbash A. Videoscopic phantom-based angiographic simulation: effect of brief angiographic simulator practice on vessel cannulation times. J Vasc Interv Radiol. 2009;20(9):1215–23. https://doi.org/10.1016/j.jvir.2009.06.006.
Dias TR, Alves Junior JDDC, Abdala N. Learning curve of radiology residents during training in fluoroscopy-guided facet joint injections. Radiol Bras. 2017;50(3):162–9. https://doi.org/10.1590/0100-3984.2015.0176.
Faulkner AR, Bourgeois AC, Bradley YC, Hudson KB, Heidel RE, Pasciak AS. Simulation-based educational curriculum for fluoroscopically guided lumbar puncture improves operator confidence and reduces patient dose. Acad Radiol. 2015;22(5):668–73. https://doi.org/10.1016/j.acra.2014.12.024.
Mendiratta-Lala M, Williams TR, Mendiratta V, Ahmed H, Bonnett JW. Simulation center training as a means to improve resident performance in percutaneous noncontinuous CT-guided fluoroscopic procedures with dose reduction. AJR Am J Roentgenol. 2015;204(4):W376–83. https://doi.org/10.2214/AJR.14.13420.
Andreatta P, Chen Y, Marsh M, Cho K. Simulation-based training improves applied clinical placement of ultrasound-guided PICCs. Support Care Cancer. 2011;19(4):539–43. https://doi.org/10.1007/s00520-010-0849-2.
Amin A, Salsamendi J, Sullivan T. High-Fidelity endovascular simulation. Tech Vasc Interv Radiol. 2019;22(1):7–13. https://doi.org/10.1053/j.tvir.2018.10.003.
Sidhu RS, Park J, Brydges R, MacRae HM, Dubrowski A. Laboratory-based vascular anastomosis training: a randomized controlled trial evaluating the effects of bench model fidelity and level of training on skill acquisition. J Vasc Surg. 2007;45(2):343–9. https://doi.org/10.1016/j.jvs.2006.09.040.
Miller ZA, Amin A, Tu J, Echenique A, Winokur RS. Simulation-based training for interventional radiology and opportunities for improving the educational paradigm. Tech Vasc Interv Radiol. 2019;22(1):35–40. https://doi.org/10.1053/j.tvir.2018.10.008.
Trace AP, Ortiz D, Deal A, et al. Radiology’s Emerging Role in 3-D Printing Applications in Health Care. J Am Coll Radiol. 2016;13(7):856–62.e4.
Ballard DH, Trace AP, Ali S, Hodgdon T, Zygmont ME, DeBenedectis CM, et al. Clinical applications of 3D printing: primer for radiologists. Acad Radiol. 2018;25(1):52–65. https://doi.org/10.1016/j.acra.2017.08.004.
Ghazi A, Campbell T, Melnyk R, Feng C, Andrusco A, Stone J, et al. Validation of a full-immersion simulation platform for percutaneous Nephrolithotomy using three-dimensional printing technology. J Endourol. 2017;31(12):1314–20. https://doi.org/10.1089/end.2017.0366.
Goudie C, Kinnin J, Bartellas M, Gullipalli R, Dubrowski A. The use of 3D printed vasculature for simulation-based medical education within interventional radiology. Cureus. 2019;11(4):e4381. https://doi.org/10.7759/cureus.4381.
Low CM, Morris JM, Matsumoto JS, Stokken JK, O’Brien EK, Choby G. Use of 3D-printed and 2D-illustrated international frontal sinus anatomy classification anatomic models for resident education. Otolaryngol Head Neck Surg. 2019;161(4):705–13. https://doi.org/10.1177/0194599819860832.
Marconi S, Pugliese L, Botti M, Peri A, Cavazzi E, Latteri S, et al. Value of 3D printing for the comprehension of surgical anatomy. Surg Endosc. 2017;31(10):4102–10. https://doi.org/10.1007/s00464-017-5457-5.
Ploch CC, Mansi CSSA, Jayamohan J, Kuhl E. Using 3D printing to create personalized brain models for neurosurgical training and preoperative planning. World Neurosurg. 2016;90:668–74. https://doi.org/10.1016/j.wneu.2016.02.081.
Cai B, Rajendran K, Bay BH, Lee J, Yen CC. The effects of a functional three-dimensional (3D) printed knee joint simulator in improving anatomical spatial knowledge. Anat Sci Educ. 2019;12(6):610–8. https://doi.org/10.1002/ase.1847.
AlAli AB, Griffin MF, Calonge WM, Butler PE. Evaluating the use of cleft lip and palate 3D-printed models as a teaching aid. J Surg Educ. 2018;75(1):200–8. https://doi.org/10.1016/j.jsurg.2017.07.023.
Costello JP, Olivieri LJ, Su L, Krieger A, Alfares F, Thabit O, et al. Incorporating three-dimensional printing into a simulation-based congenital heart disease and critical care training curriculum for resident physicians. Congenit Heart Dis. 2015;10(2):185–90. https://doi.org/10.1111/chd.12238.
Guitarte Vidauarre A, Karsenty C, Vincent R, et al. Teaching congenital cardiopathies through 3D printed models, is it always useful? . Arch Cardiovasc Dis Suppl. 2020;12(1):171.
Li Z, Li Z, Xu R, Li M, Li J, Liu Y, et al. Three-dimensional printing models improve understanding of spinal fracture--a randomized controlled study in China. Sci Rep. 2015;5(1):11570. https://doi.org/10.1038/srep11570.
Yao CJ, Chow J, Choi WWS, Mattheos N. Measuring the impact of simulation practice on spatial representation ability of dentists by means of impacted mandibular third molar (IMTM) surgery on 3D printed models. Eur J Dent Educ. 2019;23(3):332–43. https://doi.org/10.1111/eje.12434.
Zheng B, Wang X, Zheng Y, Feng J. 3D-printed model improves clinical assessment of surgeons on anatomy. J Robot Surg. 2019;13(1):61–7. https://doi.org/10.1007/s11701-018-0809-2.
Bortman J, Baribeau Y, Jegenathan J, et al. Improving clinical proficiency using a 3-dimensionally printed and patient-specific thoracic spine model as a hepatic task trainer. Reg Anesth Pain Med. 2018;43(8):819–24. https://doi.org/10.1097/AAP.0000000000000821.
Barber SR, Kozin ED, Dedmon M, Lin BM, Lee K, Sinha S, et al. 3D-printed pediatric endoscopic ear surgery simulator for surgical training. Int J Pediatr Otorhinolaryngol. 2016;90:113–8. https://doi.org/10.1016/j.ijporl.2016.08.027.
Kärkkäinen JM, Sandri G, Tenorio ER, Alexander A, Bjellum K, Matsumoto J, et al. Simulation of endovascular aortic repair using 3D printed abdominal aortic aneurysm model and fluid pump. Cardiovasc Intervent Radiol. 2019;42(11):1627–34. https://doi.org/10.1007/s00270-019-02257-y.
Torres IO, De Luccia N. A simulator for training in endovascular aneurysm repair: the use of three dimensional printers. Eur J Vasc Endovasc Surg. 2017;54(2):247–53. https://doi.org/10.1016/j.ejvs.2017.05.011.
Javan R, Bansal M, Tangestanipoor A. A prototype hybrid gypsum-based 3-dimensional printed training model for computed tomography-guided spinal pain management. J Comput Assist Tomogr. 2016;40(4):626–31. https://doi.org/10.1097/RCT.0000000000000415.
Javan R, Ellenbogen AL, Greek N, Haji-Momenian S. A prototype assembled 3D-printed phantom of the glenohumeral joint for fluoroscopic-guided shoulder arthrography. Skelet Radiol. 2019;48(5):791–802. https://doi.org/10.1007/s00256-018-2979-4.
Rynio P, Falkowski A, Witowski J, Kazimierczak A, Wójcik Ł, Gutowski P. Simulation and training of needle puncture procedure with a patient-specific 3D printed gluteal artery model. J Clin Med. 2016;9(3):686.
Silvestro E, Shellikeri S, Trahan S, Sze R, Cahill A. Fabrication of a custom pediatric phantom for pediatric interventional radiology endovascular simulation and training: technical aspects. [Abstract No. 560]. J Vasc Interv Radiol. 2020;30(3, Suppl):S242.
Whiting PF, Rutjes AWS, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529–36. https://doi.org/10.7326/0003-4819-155-8-201110180-00009.
Karakas AB, Govsa F, Ozer MA, Eraslan C. 3D brain imaging in vascular segmentation of cerebral venous sinuses. J Digit Imaging. 2019;32(2):314–21. https://doi.org/10.1007/s10278-018-0125-4.
Liu Y, Gao Q, Du S, et al. Fabrication of cerebral aneurysm simulator with a desktop 3D printer. Sci Rep. 2017;7(1):44301. https://doi.org/10.1038/srep44301.
Mashiko T, Kaneko N, Konno T, Otani K, Nagayama R, Watanabe E. Training in cerebral aneurysm clipping using self-made 3-dimensional models. J Surg Educ. 2017;74(4):681–9. https://doi.org/10.1016/j.jsurg.2016.12.010.
Ryan JR, Chen T, Nakaji P, Frakes DH, Gonzalez LF. Ventriculostomy simulation using patient-specific ventricular anatomy, 3D printing, and hydrogel casting. World Neurosurg. 2015;84(5):1333–9. https://doi.org/10.1016/j.wneu.2015.06.016.
Wang JL, Yuan ZG, Qian GL, Bao WQ, Jin GL. 3D printing of intracranial aneurysm based on intracranial digital subtraction angiography and its clinical application. Medicine (Baltimore). 2018;97(24):e11103.
Weinstock P, Rehder R, Prabhu SP, Forbes PW, Roussin CJ, Cohen AR. Creation of a novel simulator for minimally invasive neurosurgery: fusion of 3D printing and special effects. J Neurosurg Pediatr. 2017;20(1):1–9. https://doi.org/10.3171/2017.1.PEDS16568.
Zheng JP, Li CZ, Chen GQ, Song GD, Zhang YZ. Three-dimensional printed Skull Base simulation for Transnasal endoscopic surgical training. World Neurosurg. 2018;111:e773–82. https://doi.org/10.1016/j.wneu.2017.12.169.
Rynio P, Falkowski A, Witowski J, Kazimierczak A, Wójcik Ł, Gutowski P. Simulation and training of needle puncture procedure with a patient-specific 3D printed gluteal artery model. J Clin Med. 2020;9(3):686. https://doi.org/10.3390/jcm9030686.
Bortman J, Baribeau Y, Jeganathan J, Amador Y, Mahmood F, Shnider M, et al. Improving clinical proficiency using a 3-dimensionally printed and patient-specific thoracic spine model as a haptic task trainer. Reg Anesth Pain Med. 2018;43(8):819–24. https://doi.org/10.1097/AAP.0000000000000821.
Pedersen TH, Gysin J, Wegmann A, Osswald M, Ott SR, Theiler L, et al. A randomised, controlled trial evaluating a low cost, 3D-printed bronchoscopy simulator. Anaesthesia. 2017;72(8):1005–9. https://doi.org/10.1111/anae.13951.
Sappenfield JW, Smith WB, Cooper LA, Lizdas D, Gonsalves DB, Gravenstein N, et al. Visualization improves supraclavicular access to the Subclavian vein in a mixed reality simulator. Anesth Analg. 2018;127(1):83–9. https://doi.org/10.1213/ANE.0000000000002572.
Wong NC, Hoogenes J, Alharbi B, Vij S. Robotic surgical skill acquisition in trainees: a randomized comparison of robotic simulation training and the transfer of skills to a simulated robotic surgical task in the operating room using a 3D printed model. J Urol. 2016;195(4):e215–6.
Seslar SP, Patton KK. Initial experience with a novel electrophysiology mapping simulator. Pacing Clin Electrophysiol. 2018;41(2):197–202. https://doi.org/10.1111/pace.13262.
Hsieh TY, Cervenka B, Dedhia R, Strong EB, Steele T. Assessment of a patient-specific, 3-dimensionally printed endoscopic sinus and Skull Base surgical model. JAMA Otolaryngol Head Neck Surg. 2018;144(7):574–9. https://doi.org/10.1001/jamaoto.2018.0473.
Lichtenstein JT, Zeller AN, Lemound J, Lichtenstein TE, Rana M, Gellrich NC, et al. 3D-printed simulation device for orbital surgery. J Surg Educ. 2017;74(1):2–8. https://doi.org/10.1016/j.jsurg.2016.07.005.
Marty M, Broutin A, Vergnes JN, Vaysse F. Comparison of student's perceptions between 3D printed models versus series models in paediatric dentistry hands-on session. Eur J Dent Educ. 2019;23(1):68–72. https://doi.org/10.1111/eje.12404.
Bundy JJ, Weadock WJ, Chick JFB, Srinivasa RN, Patel N, Johnson E, et al. Three-dimensional printing facilitates creation of a biliary endoscopy phantom for interventional radiology-operated endoscopy training. Curr Probl Diagn Radiol. 2019;48(5):456–61. https://doi.org/10.1067/j.cpradiol.2018.08.004.
Li Y, Li Z, Ammanuel S, Gillian D, Shah V. Efficacy of using a 3D printed lumbosacral spine phantom in improving trainee proficiency and confidence in CT-guided spine procedures. 3D Print Med. 2018;4(1):7.
O'Reilly MK, Reese S, Herlihy T, Geoghegan T, Cantwell CP, Feeney RNM, et al. Fabrication and assessment of 3D printed anatomical models of the lower limb for anatomical teaching and femoral vessel access training in medicine. Anat Sci Educ. 2016;9(1):71–9. https://doi.org/10.1002/ase.1538.
Sheu AY, Laidlaw GL, Fell JC, Triana BP, Goettl CS, Shah RP. Custom 3-dimensional printed ultrasound-compatible vascular access models: training medical students for vascular access. J Vasc Interv Radiol. 2019;30(6):922–7. https://doi.org/10.1016/j.jvir.2019.02.011.
Nayahangan LJ, Nielsen KR, Albrecht-Beste E, Bachmann Nielsen M, Paltved C, Lindorff-Larsen KG, et al. Determining procedures for simulation-based training in radiology: a nationwide needs assessment. Eur Radiol. 2018;28(6):2319–27. https://doi.org/10.1007/s00330-017-5244-7.
Berry M, Lystig T, Reznick R, Lönn L. Assessment of a virtual interventional simulator trainer. J Endovasc Ther. 2006;13(2):237–43. https://doi.org/10.1583/05-1729.1.
Berry M, Reznick R, Lystig T, Lönn L. The use of virtual reality for training in carotid artery stenting: a construct validation study. Acad Radiol. 2008;49(7):801–5. https://doi.org/10.1080/02841850802108438.
Dawson S. Procedural simulation: a primer. J Vasc Interv Radiol. 2006;17(2 Pt 1):205–13. https://doi.org/10.1097/01.RVI.0000194871.97225.CA.
Ballard DH, Mills P, Duszak R Jr, Weisman JA, Rybicki FJ, Woodard PK. Medical 3D printing cost-Savings in Orthopedic and Maxillofacial Surgery: cost analysis of operating room time save with 3D printed anatomic models and surgical guides. Acad Radiol. 2019;27(8):1103–13. https://doi.org/10.1016/j.acra.2019.08.011.
Golab A, Smektala T, Kaczmarek K, Stamirowski R, Hrab M, Slojewski M. Laparoscopic partial nephrectomy supported by training involving personalized silicone replica poured in three-dimensional printed casting Mold. J Laparoendosc Adv Surg Tech A. 2017;27(4):420–2. https://doi.org/10.1089/lap.2016.0596.
Koch RW, Saleh H, Folkeard P, Moodie S, Janeteas C, Agrawal SK, et al. Skill transference of a probe-tube placement training simulator. J Am Acad Audiol. 2020;31(1):40–9. https://doi.org/10.3766/jaaa.18054.
Computer Aided Technology. 3D Printer Price (2020). https://www.cati.com/3d-printing/3d-printer-price/
Additive Manufacturing Execution System & Workflow Automation Software. 3D Printing In-House vs Outsourcing: the Definitive Guide (2018). https://amfg.ai/2018/07/04/3d-printing-outsourcing-vs-in-house/
Ethics approval and consent to participate
Consent for publication
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Tenewitz, C., Le, R.T., Hernandez, M. et al. Systematic review of three-dimensional printing for simulation training of interventional radiology trainees. 3D Print Med 7, 10 (2021). https://doi.org/10.1186/s41205-021-00102-y
- Three-dimensional printing
- Simulation training
- High fidelity training
- Interventional radiology