Reporting of Computational Modeling and Simulation Studies in Medical Device Submissions
This guidance provides recommendations for formatting, organizing, and content of reports for computational modeling and simulation (CM&S) studies used to support medical device submissions. It covers how to report CM&S studies and their outcomes when used to evaluate device safety and effectiveness, but does not address whether CM&S tools may be considered medical devices themselves. The guidance does not establish the amount or type of verification and validation needed, nor does it address how to conduct CM&S studies. It focuses solely on reporting guidelines and highlights common modeling issues.
What You Need to Know? 👇
What are the key components required in a computational modeling and simulation (CM&S) report for medical device submissions?
A CM&S report must include 15 sections: Executive Summary, Background/Introduction, Code Verification, System Configuration, Governing Equations/Constitutive Laws, System Properties, System Conditions, System Discretization, Numerical Implementation, Validation, Results, Discussion, Limitations, Conclusions, and References. Each section requires specific details about assumptions, simplifications, and rationale.
How should validation be approached for computational models in medical device regulatory submissions?
Validation requires comparing computational model results with experimental data (in vivo, ex vivo, or in vitro comparators). You must describe the validation method, provide quantitative comparisons of quantities of interest, discuss agreement levels, and explain why the validation approach is appropriate for your specific context of use.
What level of detail is needed for code verification in CM&S studies?
Code verification must include software quality assurance (SQA) and numerical code verification (NCV). Describe verification activities, reference available documentation from software developers, and provide rationale for code applicability to your computational domain. Include justification for numerical settings whether default or modified.
How should mesh refinement and convergence studies be documented?
Document the mesh refinement methodology, report criteria used to determine adequate discretization, provide representative images of discretization in critical areas, and demonstrate that quantities of interest are independent of element size. Include convergence analysis showing solution stability as discretization is refined.
What specific information is required for system properties in different CM&S modalities?
Requirements vary by modality: fluid dynamics needs viscosity and density; solid mechanics requires elastic modulus and material properties; electromagnetics needs conductivity and permittivity; ultrasound requires acoustic properties; heat transfer needs thermal conductivity and capacity. Always identify sources and provide rationale for property selection.
How should limitations and assumptions be addressed in CM&S reports?
Systematically document all assumptions and simplifications made throughout the study. Explain how these might affect computational model output, result interpretation, and relevance to context of use. If conclusions depend significantly on assumptions, perform sensitivity analyses on associated parameters to assess their impact.
What You Need to Do 👇
Recommended Actions
- Establish a standardized CM&S report template following the guidance outline
- Document verification activities:
- Software quality assurance
- Numerical code verification
- Calculation verification
- Implement validation process:
- Select appropriate comparator (bench, in vivo, literature)
- Document validation methodology
- Compare and analyze results
- Create detailed documentation of:
- System configuration and geometry
- Material properties and governing equations
- Boundary conditions and discretization
- Numerical implementation
- Perform and document:
- Sensitivity analyses for critical parameters
- Uncertainty analyses
- Convergence studies
- Prepare comprehensive results presentation:
- Quantitative results with clear labels
- Multiple formats (tables, graphs)
- Critical values highlighted
- Document limitations and assumptions:
- Clear rationale for simplifications
- Impact on results
- Uncertainties discussion
- Link conclusions to regulatory objectives:
- Address context of use
- Support safety/effectiveness claims
- Highlight key findings
Key Considerations
Non-clinical testing
- CM&S studies should be reported with an executive summary including context of use, scope, type of analysis, conclusions and keywords
- Code verification through software quality assurance and numerical code verification must be documented
- System configuration, governing equations, properties, conditions and discretization must be described in detail
- Validation approach and results must be documented with comparator data
- Results must be presented quantitatively with sufficient detail
Software
- Software tools used (commercial, open source, or custom) must be identified
- Code verification activities must be documented
- Numerical implementation methodology must be described
- Solver parameters and convergence criteria must be specified
Safety
- Safety factors and analysis must be reported when relevant
- Critical stresses, strains, forces or displacements must be documented
- Limitations that could affect safety must be discussed
Other considerations
- Assumptions and simplifications must be documented with rationale
- Sensitivity analyses should be performed for critical parameters
- Uncertainties must be discussed and their impact on results analyzed
- Conclusions must relate to regulatory objectives
Relevant Guidances 🔗
- Assessing the Credibility of Computational Modeling and Simulation in Medical Device Submissions
- Technical Considerations for Additive Manufactured Medical Devices
- Design Controls for Medical Device Manufacturers
Related references and norms 📂
- ASME V&V 10-1-2012: Verification & Validation Guide
- ASME V&V 20-2009: Verification & Validation Standard
- IEEE 1597.1-2008: Standard for Validation of Computational Electromagnetics Computer Modeling and Simulations
Original guidance
- Reporting of Computational Modeling and Simulation Studies in Medical Device Submissions
- HTML / PDF
- Issue date: 2016-09-21
- Last changed date: 2019-03-17
- Status: FINAL
- Official FDA topics: Medical Devices, Premarket Approval (PMA), 510(k), Premarket, Investigational Device Exemption (IDE)
- ReguVirta ID: ae5b978662d1d8e33afc27c8ab0685d5