Original Article

Qualitative and Quantitative Evaluation of Videoendoscopic Simulation in Surgical Residents Training

10.4274/hamidiyemedj.galenos.2022.83702

  • Sezen Milli Avtan
  • Esra Akdeniz
  • Wafi Attaallah

Received Date: 24.03.2022 Accepted Date: 11.10.2022 Hamidiye Med J 2022;3(3):177-183

Background:

In our study, we aimed to evaluate the contribution of video-endoscopy simulation for the development of gastroscopy and colonoscopy skills of residents in surgical resident training, using qualitative and quantitative methods.

Materials and Methods:

Sixteen novice surgeons were trained with an endoscopic virtual reality simulator. Ten colonoscopy and 10 gastroscopy cases were overviewed in this training. Three hundred-twenty gastroscopy and colonoscopy simulation modules were evaluated. Continious variables are presented as median and interquartile range. Wilcoxon signed-rank test was used to detect changes during the training. For the qualitative data of the study, in-depth interviews were conducted with the residents who completed the modules. At the end of the interviews, the answers were documented directly in the same day. The themes and sub-themes related to the content were determined by two medical evaluators.

Results:

A significant improvement was observed both in colonoscopy and gastroscopy modules. While the time to reach the cecum in the colonoscopy module decreased from 20 minutes to 3 minutes on average, and the time to reach the duodenum in gastroscopy from 4 minutes to 3.6 minutes. The percentage of mucosal surface examined increased both in gastroscopy and colonoscopy. The time spent to obtain quality images did not change in gastroscopy, but there was an obvious increase in colonoscopy. The percentage of effective usage of the screen increased both in gastroscopy and colonoscopy. Qualitative data proved that all participants were satisfied by the training and benefited from it.

Conclusion:

The results of our study indicate the importance and advantage of the utilization of simulators in trainings that require interventional skills, before patient encounter. It has been shown that video-endoscopy simulation supports the dexterity of residents in gastroscopy and colonoscopy applications.

Keywords: Medical simulation, video-endoscopy, medical education

Introduction

Healthcare providers must be able to competently perform a wide range of clinical skills. These skills include taking a patient’s history, performing a physical examination, and performing procedures. While some procedural skills are unique to certain fields, proficiency in the execution of skills is necessary to provide safe patient care (1). The effectiveness of skills training is controversial, and data show that novice healthcare professionals are overconfident in their ability to teach practical skills (2,3). This may cause undesirable consequences during patient intervention. The use of simulators and task trainers provides the opportunity to safely train and practice procedural skills before applying them to the patient. The simulation was derived from the Latin word simulare. Simulating means making something look like the real thing. Nowadays, simulation is widely used, especially in the medical field. Patient simulations, which provide significant benefits especially in the field of medical teamwork, and surgical simulations that are effective in developing technical skills, are some of the important medical simulations. Thanks to simulation, a technical skill develops much better and facilitates the transfer to the real clinical environment (2,4,5). High-quality simulations supported by visual elements have been identified in systematic review as the most successful technique in arranging adult learner needs and procedural skills training (6). As it is known, the most valuable motivators for adult learning are the practical use of the information to be learned and the security principles provided for the application environment. Six principles have been developed for the effective learning and application of procedural knowledge.

1. Learn: Knowledge acquisition

2. See: Observation of the procedural skill

3. Practice: To make a practice using simulation

4. Prove: To assesss the competency

5. Do: The technique is carried out on a patient under direct supervision until the student is trusted to carry it out on his or her own.

6. Maintain: To make continuing clinical practical skills, with simulation-based training as a supplement (4).

As stated in this example, simulation is a training model that is applied not only to teach a skill but also to reinforce it. Before becoming competent at a skill, learners go through a succession of phases. In the acquisition of skills, there are four levels: 1) Unconsciously incompetent, 2) Consciously incompetent, 3) Consciously competent, 4) Unconsciously competent (1). The 4 phases of skill acquisition are also shown in (Figure 1) (7).

Just like using a car, we need to reach an unconsciously competent level in applications that require medical intervention. We think that one of the most important educational elements that facilitates access to this level is medical simulation. We will try to demonstrate this in our own working practice. In line with the results we have obtained, we will discuss the inclusion of simulation in the curriculum.


Material and Methods

In this study, a “virtual reality (VR)” simulator with a special video-endoscopy software, the same fiber system as the original endoscope models, was used as the simulator (Figure 2). The simulator was a simulator given as a donation to the simulation center. Three hundred-twenty gastroscopy and colonoscopy modules were evaluated. Sixteen surgical residents, who had not previously performed video-endoscopy on the patient, carried out 20 video-endoscopy cases, 10 of which were colonoscopy and 10 gastroscopies. Modules were structured in increasing difficulty. A medium difficulty module selected by the instructors was run as the first module and repeated when all modules were completed. Third module for gastroscopy and 5th module (Figure 3, 4) for colonoscopy were chosen as the reference. It was started with this module first and after 9 consecutive modules were studied, the first module was run again. Improvement trends were also examined in other modules other than the reference module.

For the qualitative data of the study, in-depth interviews were conducted with the residents who completed the modules. The answers given to the semi-structured questions prepared by the trainers with the support of the literature were recorded. The interviews lasted about 35-40 minutes. Before the interviews, verbal and written consents were obtained from the sixteen participants. It was informed that the interviews will be recorded. At the end of the in-depth interview, recordings were transcribed in the same day. The themes and sub-themes related to the content were determined by two medical evaluators. The expressions indicating the theme and sub-themes were written in the words of the participant. Ethical Permissions were obtained from Marmara University Health Sciences Institute (22.03.2021-45).

Statistical Analysis

The results of the 160 gastroscopy and 160 colonoscopy applications consisting 10 different modules with gradual difficulty, which were demonstrated by each of the 16 surgical assistants were evaluated. Continuous variables were summarized according to their distribution with mean and standard deviation or median and interquartile range (IQR). R was used as a statistical program, p<0.05 was considered significant. Wilcoxon rank-sign test was used to detect changes during the training.


Results

Ten tasks with different difficulty levels were run for gastroscopy training. Case 3, which has a medium difficulty level, was given as the first task, and followed by Cases 1,2,4,5,6,7,8,9,10 and Case 3 was given again as a last task. Success and improvement in technical skills between the repeated Case 3 tasks were evaluated in terms of percent of mucosal surface examined, percent of time spent with clear view, time to reach the duodenum, the efficiency of screening.

Wilcoxon signed rank-test results showed that for gastroscopy, the percentage of mucosal area evaluated increased significantly in the repeated case [(Md=89) (IQR=8) and Md=94 (IQR=4.5) respectively, p=0.002]. Percent of time spent with clear view had not changed [Md=97 (IQR=2.2) and (Md=96.5) (IQR=3.7) respectively p=0.365]. The time to reach the duodenum had shortened [(Md=241.5 (IQR=213.5) and Md=221.5 (IQR=60.7) respectively p=0.024]. The efectiveness of screen use also had increased [Md=23 (IQR=35) and (Md=58.5) (IQR=16.7) recpectively p=0.008]. The trainer’s observational notes also indicate that technical skills improve in repetitive tasks (Table 1).

 For colonoscopy, the tasks were started with Case 5, which was determined to be of medium difficulty by the trainer, and Case 5,1,2,3,4,6,7,8,9,10, and Case 5 (R) were repeated, respectively. The trend towards improvement in achievement and technical skills between Case 5 and Case 5 (R) was evaluated. Success and improvement in technical skills between the repeated Case 5 tasks were evaluated in terms of percent of mucosal surface examined, percent of time spent with clear view, time to reach cecum, efficiency of screening.

For colonoscopy, the percentage of mucosal area evaluated increased significantly in the repeat case (Case 5 R) [Md=83.5 (IQR=35.8) and (Md=88.5) (IQR=14.5) respectively p=0.031]. The time to reach the cecum had significantly shortened [Md=1425 (IQR=1406.5) and (Md=180) (IQR=205) respectively p=0.001]. The percentage of time spent producing clean images [Md=76.5 (IQR=13.5) and (Md= 87.5) (IQR=10.5) respectively p=0.004] and the effectiveness of screen use have also increased [(Md=20) (IQR=33) and (Md=84) (IQR=16.7) respectively p=0.001]. The trainer’s observational notes also indicate that technical skills improve in repetitive tasks (Table 2).

The themes and sub-themes obtained from the qualitative data are shown in (Table 3).

The statements of the assistants who participated in the in-depth interviews are as follows:

Participant 1, P(1): “The most important feature of simulation for me is to be able to repeat as many times as I want in a stress-free environment”.“In addition, having someone to consult with me when I need it increases the feeling of trust”.

P(3): “I was very comfortable working on the patient as the fiber optic part of the simulator is the same as the real video endoscopy device”.

P(7): “I think the simulator application before the patient experience is extremely necessary, but studying in a separate location was a waste of time for me. I wish this simulator was in our hospital”.

P(9): “The simulator broke down very often while I was working. I had to rebuild the modules. I wasted a lot of time”.

Qualitative data also show that; By making their first experience on the simulator, the residents experienced increased confidence in patient intervention. The high reality feature of the simulator was stated by most of the participants as a factor facilitating adaptation in patient practice.

While a simulation center that is isolated and outside of the working environment is considered a waste of time, very few participants stated that receiving training in a separate place is a break from their busy work schedule. Generally, because of the qualitative study, the idea that simulation increases successful patient outcomes, creates familiarity in terms of devices and interventions, reinforces the feeling of trust in physicians and patients. In addition, the answers given to the evaluation questions asked in the interviews with two trainers support our findings.


Discussion

As it is known, video-endoscopy is a very important and difficult training due to the difficulty in selecting the appropriate patient for resident training and the inadequacy of the cases. Unfortunately, it is not easy to achieve adequate technical skills for video-endoscopy in the early stages of surgical residency (8).

Competence is defined as “the minimum level of ability, knowledge, and/or expertise that is required to safely and efficiently perform a task or a procedure gained via training and experience”(8). In recent years, competence and skill development in endoscopy has been considered as an important problem (9,10,11). Different models and task trainers have been used in endoscopy training for many years. The aim of simulator-based training is to shorten the learning time in endoscopy for beginners and to eliminate the possible harm that can be given to the patient. For physicians who do not perform endoscopic interventions very often, working with a simulator before patient application, provides serious benefits (12). The performance of novice endoscopists using this simulator, improved significantly between pre- and post-training, according to this study. It is shown that surgical residents improve psychomotor and endoscopic skills with simulation-based education. Other researchs have investigated the impact of virtual endoscopic training. A study from Texas showed significant improvements in cecal intubation time, total time, and percentage of surface area scanned from pre-to post-training. In this study, the same VR simulator was used, but unlike ours, this study was conducted with senior surgical residents (13). In a study, took placed Nederlands, surgical assistants improved their performance in both the VR colonoscopy and the endobubble task. Unlike our study, there was no instructor guidance during the training (14). In another randomized controlled study, two groups were compared. One group consisted of novice residents who had less than 10 endoscopies, and the other group was senior residents. Then, these two groups are randomly seperated and simulation training is given. The total procedure time and the time to reach cecum were significantly reduced in the simulation-trained group (15). In our study, unlike this study, we evaluated the comparison of the results of the same people before and after the training as more meaningful. In a randomized study conducted in Denmark, an intermediate task was chosen, as in our study, and when all modules were completed, the same task was run again, and improvements were evaluated. Improvements in skills such as total time and clean surface area monitored by endoscopists were determined (16). In our study, based on the literature, we evaluated parameters such as the cleanly observed surface area, the percentage of the scanned mucosal area, the time to reach the cecum, and the time to reach the duedonum. We determined the shortening of the time to reach the cecum and duodenum and the percentage of mucosal area observed and the percentage of the area observed as clean as skill development criteria. Although simulators are seen as expensive devices, general maintenance costs are not very high after the initial purchase costs. The first and most comprehensive study examining the cost-effectiveness values of VR simulators was conducted by Barsuk et al. (17). On central line-associated bloodstream infections (CLABSI). Ninety-two assistants received a simulation-based training with an instructor. Surprisingly, CLABSI rates were reduced by more than sixfold after simulation training (0.50 infections per 1000 catheter days) compared to the same uninterrupted unit (3.20 per 1000 catheter days). The annual cost of the simulation-based intervention was $112,000, reducing the net savings from lower CLABSI rates to about $700,000 (18).

Although there are studies evaluating simulation-based surgical assistant training in the literature, we have not encountered both a qualitative and quantitative evaluation (19,20,21). In this sense, we find it meaningful to support our study with qualitative data. From the results of the in-depth interviews, it is understood that the surgical residents benefited from the simulation training. Accurate feedback and unlimited repeatability provided by simulation were other important issues emphasized by the residents.


Conclusion

We found that simulation shortens the application time and increases the application skills of endoscopists in colonoscopy and gastroscopy applications that require interventional skills. In our study, we got the idea that simulation video-endoscopy training can fill a very important gap in surgical assistants training and it would be beneficial to add it to the curriculum. Quantitative data support that this training provides positive contributions in dexterity, time use and treatment management. Qualitative data also show that with this training, the trust of the residents increased, and they also gained more awareness about the sensitivity and seriousness of the intervention they performed. We believe that the malpractice problems, experienced especially in recent years, will decrease with the spread of simulation application centers.

Ethics

Ethics Committee Approval: Ethical Permissions were obtained from Marmara University Health Sciences Institute (22.03.2021-45).

Informed Consent: Written consents were obtained from the sixteen participants.

Peer-review: Internally peer-reviewed.

Authorship Contributions

Surgical and Medical Practices: S.M.A., W.A., Concept: S.M.A., W.A., Design: S.M.A., W.A., Data Collection or Processing: S.M.A., E.A., W.A., Analysis or Interpretation: S.M.A., E.A., W.A., Literature Search: S.M.A., W.A., Writing: S.M.A.

Conflict of Interest: No conflict of interest was declared by the authors.

Financial Disclosure: The authors declared that this study received no financial support.


  1. Burgess A, Van Diggele C, Roberts C, Mellis C. Tips for teaching procedural skills. BMC Med Educ. 2020;20(Suppl 2):458.
  2. Kantak SS, Winstein CJ. Learning-performance distinction and memory processes for motor skills: a focused review and perspective. Behav Brain Res. 2012;228:219-231.
  3. Wall D, McAleer S. Teaching the consultant teachers: identifying the core content. Med Educ. 2000;34:131-138.
  4. Sawyer T, White M, Zaveri P, Chang T, Ades A, French H, et al. Learn, see, practice, prove, do, maintain: an evidence-based pedagogical framework for procedural skill training in medicine. Acad Med. 2015;90:1025-1033.
  5. DeBourgh GA. Psychomotor skills acquisition of novice learners. A case for contextual learning. Nurse Educ. 2011;36:144-149.
  6. Huang GC, McSparron JI, Balk EM, Richards JB, Smith CC, Whelan JS, et al. Procedural instruction in invasive bedside procedures: a systematic review and meta- analysis of effective teaching approaches. BMJ Qual Saf. 2016;25:281-294.
  7. Peyton JWR. The learning cycle. In: Peyton JWR, editor. Teaching and learning in medical practice. Rickmansworth: Manticore Europe Ltd; 1999. p. 13-19. Crossref]
  8. ASGE Standards of Practice Committee, Faulx AL, Lightdale JR, Acosta RD, Agrawal D, Bruining DH, et al. Guidelines for privileging, credentialing, and proctoring to perform GI endoscopy. Gastrointest Endosc. 2017;85:273-281.
  9. Bini EJ, Firoozi B, Choung RJ, Ali EM, Osman M, Weinshel EH. Systematic evaluation of complications related to endoscopy in a training setting: a prospective 30-day outcomes study. Gastrointest Endosc. 2003;57:8-16.
  10. McCashland T, Brand R, Lyden E, de Garmo P. The time and financial impact of training fellows in endoscopy. CORI research project. Clinical outcomes research initiative. Am J Gastroenterol. 2000;95:3129-3132.
  11. Desilets DJ, Banerjee S, Barth BA, Kaul V, Kethu SR, Pedrosa MC, et al. Endoscopic simulators. Gastrointest Endosc. 2011;73:861-867.
  12. Ziv A, Ben-David S, Ziv M. Simulation based medical education: an opportunity to learn from errors. Med Teach. 2005;27:193-199.
  13. Van Sickle KR, Buck L, Willis R, Mangram A, Truitt MS, Shabahang M, et al. A multicenter, simulation- based skills training collaborative using shared GI Mentor II sys- tems: results from the Texas Association of Surgical Skills Labo- ratories (TASSL) flexible endoscopy curriculum. Surg Endosc. 2011;25:2980-2986.
  14. Buzink SN, Koch AD, Heemskerk J, Botden SM, Goossens RH, de Ridder H, et al. Acquiring basic endoscopy skills by training on the GI Mentor II. Surg Endosc. 2007;21:1996-2003.
  15. Cohen J, Cohen SA, Vora KC, Xue X, Burdick JS, Bank S, et al. Multicenter, randomized, controlled trial of virtual-reality simulator training in acquisition of competency in colonoscopy. Gastrointest Endosc. 2006;64:361-368.
  16. Eversbusch A, Grantcharov TP. Learning curves and impact of psycho-motor training on performance in simulated colonoscopy: a randomized trial using a virtual reality endoscopy trainer. Surg Endosc. 2004;18:1514-1518.
  17. Barsuk JH, Cohen ER, Feinglass J, McGaghie WC, Wayne DB. Use of simulation-based education to reduce catheter-related bloodstream infections. Arch Intern Med. 2009;169:1420-1423.
  18. Cohen ER, Feinglass J, Barsuk JH, Barnard C, O’Donnell A, McGaghie WC, et al. Cost savings from reduced catheter- related bloodstream infection after simulation-based education for residents in a medical inten- sive care unit. Simul Healthc. 2010;5:98-102.
  19. Koch AD, Buzink SN, Heemskerk J, Botden MBIS, Veenendaal R, Jakimowicz JJ, et al. Expert and construct validity of the Simbionix GI Mentor II endoscopy simulator for colonoscopy. Surg Endosc. 2008;22:158-162.
  20. Piskorz MM, Wonaga A, Bortot L, Linares ME, Araya V, Olmos JI, et al. Impact of a Virtual Endoscopy Training Curriculum in Novice Endoscopists: First Experience in Argentina. Dig Dis Sci. 2020;65:3072-3078.
  21. Bar-Meir S. Simbionix simuulator. Gastrointest Endosc Clin N Am. 2006;16:471-478, vii.