FDA Seeks Feedback on Generative AI Medical Device Regulation
The Food and Drug Administration is seeking public feedback on how it should approach generative artificial intelligence used in medical devices, opening another discussion about evidence, safety, cybersecurity and rapidly changing software capabilities.
Why Generative AI Is Different
Traditional medical devices are generally evaluated around defined functions and performance characteristics. Generative AI systems can produce new text, images, recommendations or other outputs based on prompts and changing data, creating additional questions for regulators.
A medical device that incorporates generative AI may also change through software updates or interact with users in ways that are difficult to predict from a single premarket evaluation.
FDA Wants Public Input
The FDA’s September 2026 MedSun newsletter highlights the agency’s effort to gather feedback on a regulatory approach for generative AI-enabled medical devices. The discussion forms part of a wider effort to understand how new digital technologies affect patient safety.
Regulators are considering how developers should demonstrate that AI-enabled products work as intended and remain reliable when deployed in real clinical environments.
Clinical Evidence Is Central
AI tools can be trained on large datasets, but technical performance alone does not establish clinical usefulness. Developers may need to show that a device produces accurate and clinically meaningful results for the populations and conditions for which it is intended.
Regulatory questions can also include how performance changes across different patient groups, whether the system produces misleading outputs and how healthcare professionals should respond when the AI is uncertain.
Cybersecurity and Data Protection
Generative AI medical devices can create cybersecurity risks because they may depend on connected systems, cloud services or external data. Protecting patient information and preventing unauthorized changes to software are therefore important parts of medical-device oversight.
Hospitals and clinicians also need clear information about how data are collected, stored and transmitted.
Balancing Innovation and Safety
The FDA faces a difficult regulatory balance. Excessive requirements could slow useful medical innovation, while weak oversight could expose patients to unreliable technology. A workable framework must encourage development while requiring evidence appropriate to the risks of each product.
The agency has already been examining software-based medical technologies and AI-enabled devices. Generative AI adds another layer because models can be more flexible and less predictable than traditional software.
What Developers and Patients Should Watch
Developers should expect continued discussion about validation, monitoring and transparency. Patients should remember that an AI feature in a medical device is not automatically evidence that the technology improves outcomes.
Clinical decisions should continue to involve qualified healthcare professionals who can interpret AI-generated information in the context of a patient’s symptoms, history and other medical evidence.
Related Hudson Tribune coverage: AI policy and technology.
Source: U.S. Food and Drug Administration.
