التفاصيل البيبلوغرافية
| العنوان: |
Availability and reporting quality of external validations of machine-learning prediction models with orthopedic surgical outcomes: a systematic review |
| المؤلفون: |
Olivier Q Groot (10665262), Bas J J Bindels (10665265), Paul T Ogink (10665268), Neal D Kapoor (10665271), Peter K Twining (10665274), Austin K Collins (10665277), Michiel E R Bongers (10665280), Amanda Lans (10665283), Jacobien H F Oosterhoff (10665286), Aditya V Karhade (10665289), Jorrit-Jan Verlaan (749504), Joseph H Schwab (10665292) |
| سنة النشر: |
2021 |
| المجموعة: |
Smithsonian Institution: Digital Repository |
| مصطلحات موضوعية: |
Medicine, Physiology, Pharmacology, Biotechnology, Inorganic Chemistry, Science Policy, Space Science, Biological Sciences not elsewhere classified, Mathematical Sciences not elsewhere classified, Chemical Sciences not elsewhere classified, Information Systems not elsewhere classified, machine-learning prediction models, ML prediction models, ML models, performance measures, implementable ML decision tools, TRIPOD, IQR, 59 ML prediction models, validation |
| الوصف: |
Background and purpose — External validation of machine learning (ML) prediction models is an essential step before clinical application. We assessed the proportion, performance, and transparent reporting of externally validated ML prediction models in orthopedic surgery, using the Transparent Reporting for Individual Prognosis or Diagnosis (TRIPOD) guidelines. Material and methods — We performed a systematic search using synonyms for every orthopedic specialty, ML, and external validation. The proportion was determined by using 59 ML prediction models with only internal validation in orthopedic surgical outcome published up until June 18, 2020, previously identified by our group. Model performance was evaluated using discrimination, calibration, and decision-curve analysis. The TRIPOD guidelines assessed transparent reporting. Results — We included 18 studies externally validating 10 different ML prediction models of the 59 available ML models after screening 4,682 studies. All external validations identified in this review retained good discrimination. Other key performance measures were provided in only 3 studies, rendering overall performance evaluation difficult. The overall median TRIPOD completeness was 61% (IQR 43–89), with 6 items being reported in less than 4/18 of the studies. Interpretation — Most current predictive ML models are not externally validated. The 18 available external validation studies were characterized by incomplete reporting of performance measures, limiting a transparent examination of model performance. Further prospective studies are needed to validate or refute the myriad of predictive ML models in orthopedics while adhering to existing guidelines. This ensures clinicians can take full advantage of validated and clinically implementable ML decision tools. |
| نوع الوثيقة: |
article in journal/newspaper |
| اللغة: |
unknown |
| Relation: |
https://figshare.com/articles/journal_contribution/Availability_and_reporting_quality_of_external_validations_of_machine-learning_prediction_models_with_orthopedic_surgical_outcomes_a_systematic_review/14445259 |
| DOI: |
10.6084/m9.figshare.14445259.v1 |
| الاتاحة: |
https://doi.org/10.6084/m9.figshare.14445259.v1 |
| Rights: |
CC BY 4.0 |
| رقم الانضمام: |
edsbas.6BF2A3E |
| قاعدة البيانات: |
BASE |