Applying LLMs for Analysis of AI/ML Medical Device Approvals.

Abstract

Machine learning (ML) is increasingly being integrated into medical devices. However, the functionality and clinical use of ML within these devices remains unclear, raising safety concerns. Manual analysis of FDA approval documents provides insights but is inefficient. This study explores the feasibility of using large language models (LLMs) to automate such analyses. We evaluate LLMs based on architecture, training strategies, parameter sizes, computational demands, and output quality to extrac