TY - JOUR
T1 - A Systematic Review and Meta-analysis on the Impact of Proficiency-based Progression Simulation Training on Performance Outcomes
AU - Mazzone, Elio
AU - Puliatti, Stefano
AU - Amato, Marco
AU - Amato, Marco Gaetano
AU - Bunting, Brendan
AU - Rocco, Bernardo
AU - Rocco, Bernardo Maria Cesare
AU - Montorsi, Francesco
AU - Mottrie, Alexandre
AU - Gallagher, Anthony G.
PY - 2021
Y1 - 2021
N2 - Objective:To analyze all published prospective, randomized, and blinded clinical studies on the proficiency-based progression (PBP) training using objective performance metrics.Background:The benefit of PBP methodology to learning clinical skills in comparison to conventional training is not settled.Methods:Search of PubMed, Cochrane library's Central, EMBASE, MEDLINE, and Scopus databases, from inception to 1st March 2020. Two independent reviewers extracted the data. The Medical Education Research Study Quality Instrument (MERSQI) was used to assess the methodological quality of included studies. Results were pooled using biased corrected standardized mean difference and ratio-of-means. Summary effects were evaluated using a series of fixed and random effects models. The primary outcome was the number of procedural errors performed comparing PBP and non-PBP-based training pathways. Secondary outcomes were the number of procedural steps completed and the time to complete the task/procedure.Results:From the initial pool of 468 studies, 12 randomized clinical studies with a total of 239 participants were included in the analysis. In comparison to the non-PBP training, ratio-of-means results showed that PBP training reduced the number of performance errors by 60% (P < 0.001) and procedural time by 15% (P = 0.003) and increased the number of steps performed by 47% (P < 0.001).Conclusions and Relevance:Our systematic review and meta-analysis confirms that PBP training in comparison to conventional or quality assured training improved trainees' performances, by decreasing procedural errors and procedural time, while increasing the number of correct steps taken when compared to standard simulation-based training.
AB - Objective:To analyze all published prospective, randomized, and blinded clinical studies on the proficiency-based progression (PBP) training using objective performance metrics.Background:The benefit of PBP methodology to learning clinical skills in comparison to conventional training is not settled.Methods:Search of PubMed, Cochrane library's Central, EMBASE, MEDLINE, and Scopus databases, from inception to 1st March 2020. Two independent reviewers extracted the data. The Medical Education Research Study Quality Instrument (MERSQI) was used to assess the methodological quality of included studies. Results were pooled using biased corrected standardized mean difference and ratio-of-means. Summary effects were evaluated using a series of fixed and random effects models. The primary outcome was the number of procedural errors performed comparing PBP and non-PBP-based training pathways. Secondary outcomes were the number of procedural steps completed and the time to complete the task/procedure.Results:From the initial pool of 468 studies, 12 randomized clinical studies with a total of 239 participants were included in the analysis. In comparison to the non-PBP training, ratio-of-means results showed that PBP training reduced the number of performance errors by 60% (P < 0.001) and procedural time by 15% (P = 0.003) and increased the number of steps performed by 47% (P < 0.001).Conclusions and Relevance:Our systematic review and meta-analysis confirms that PBP training in comparison to conventional or quality assured training improved trainees' performances, by decreasing procedural errors and procedural time, while increasing the number of correct steps taken when compared to standard simulation-based training.
KW - objective performance metrics
KW - procedural errors
KW - procedural steps
KW - technology-enhanced training
KW - proficiency-based progression training
KW - simulation-based training
KW - Surgical training
KW - proficiency-based metrics
KW - objective performance metrics
KW - procedural errors
KW - procedural steps
KW - technology-enhanced training
KW - proficiency-based progression training
KW - simulation-based training
KW - Surgical training
KW - proficiency-based metrics
UR - http://hdl.handle.net/10807/302192
U2 - 10.1097/SLA.0000000000004650
DO - 10.1097/SLA.0000000000004650
M3 - Article
SN - 0003-4932
VL - 274
SP - 281
EP - 289
JO - Annals of Surgery
JF - Annals of Surgery
ER -