Free, open and unaccountable? The growing risk of generalist AI in clinical care
A new line for clinical AI in Europe
A new line has been drawn for clinical AI in Europe
Across Europe, a new and more consequential conversation is taking place around the role of artificial intelligence in healthcare. In many settings, it is already part of the day-to-day clinical workflow — from drafting patient notes to supporting decisions where time is limited. Yet much of the early wave of AI slipped into practice without the expectations placed on new treatments, medical devices or clinical guidelines. That period is now giving way to a more structured regulatory environment.
This shift is one that Elsevier’s parent company, RELX, is engaged in directly. RELX has been appointed to the EU AI Act’s Advisory Forum — the official expert body advising the European Commission on implementation of the AI Act. Its appointment, from more than 700 applications and as one of only 32 companies, reflects the importance of ensuring that science, research, healthcare and trusted-information perspectives are represented as Europe defines responsible AI in practice.
Healthcare is not a neutral testing ground for innovation. Clinical AI operates in high-risk environments where patient safety, professional accountability and evidence integrity are non-negotiable. When AI tools influence clinical decisions, the margin for error narrows and the consequences of poor governance become far more serious.

Availability and speed may drive adoption, but trust, regulatory readiness and accountability will increasingly determine which AI tools can operate at scale in clinical settings.
The governance gap, in numbers
Adoption is racing ahead of oversight
of clinicians report using an AI tool for work — and among them, more than half rely frequently or always on generalist AI tools.Elsevier, Clinician of the Future 2026
of emergency cases were under-triaged by a generalist AI tool in structured testing, including cases needing immediate care.Nature Medicine study, February 2026
of healthcare organizations report having effective AI governance in place — and even fewer provide adequate training.Elsevier, Clinician of the Future 2026
Misuse of AI chatbots in healthcare ranked the most significant health technology hazard for 2026.ECRI 2026 Health Tech Hazard Report

Why care depends on a higher standard
Why patient care depends on holding healthcare AI to a higher standard
AI adoption in healthcare is accelerating faster than anyone predicted, but governance has lagged behind use. This imbalance is not sustainable, and it places an unreasonable burden on clinicians to compensate for gaps they did not create. Patient care is becoming more complex, with aging populations and increasing multimorbidity driving rising workloads — and when tools promise to save time, interest in them is only natural.
But the gap between what is governed and what is used in practice has a far greater impact in healthcare than in other industries. Clinicians train for years to hone judgment, assess evidence and understand where uncertainty sits, underpinned by a professional obligation to do no harm and act in the patient’s best interest.
If that gap is left unaddressed, reliance on tools that cannot be explained or examined will steadily erode that trust.
Patient safety cannot be an afterthought or a reaction to widespread implementation. Clinicians should not be expected to act as the final safeguard for tools that lack clear governance, validation or accountability. Responsible AI adoption cannot be achieved through individual vigilance alone — it must be embedded at the level of design, deployment and organizational oversight. When clinicians are already reaching for whatever is available, the task is to put credible, fit-for-purpose AI in their hands and make the safe, governed choice the easy one.
Ready for regulation — or not
Some clinical AIs are ready for regulation. Many are not.
Not all AI used in healthcare is created equal, yet clinical and generalist tools are too often discussed as if they carry the same risk and readiness. Many widely used, free generalist tools were not developed for clinical use: they are typically trained on broad internet content rather than curated medical evidence, and often lack the clinical oversight, governance and accountability expected in healthcare. As a result they can generate inaccurate, incomplete or outdated information and provide outputs with limited transparency around how conclusions were reached.
What should separate clinical AI from general-purpose tools is trust. The first question at the point of care is simple: where is the answer coming from, and can I trust it? Every answer should be explainable and verifiable, grounded in credible content a clinician can trace, check and challenge before acting on it. Systems that generate opaque responses from mixed or unverified sources are much harder to validate.
In healthcare, “free” or open access is not a governance model.

The risks are already being felt in practice. A February 2026 Nature Medicine study found a generalist AI tool under-triaged 52% of emergency cases in structured testing. Ontario’s auditor general found AI scribes could hallucinate, invent patient details and record incorrect medication names. And ECRI’s 2026 Health Tech Hazard Report ranked the misuse of AI chatbots as the most significant health technology hazard for the year. As regulatory expectations rise, only AI systems designed with evidence quality, provenance and accountability in mind will scale responsibly in European healthcare.
What governed, evidence-led AI looks like
ClinicalKey AI: governed, evidence-led AI fit for use in healthcare
ClinicalKey AI is one example of a system built specifically for healthcare rather than general-purpose use. The difference is reflected in the evidence base and the transparency behind the system: it draws on curated medical content — peer-reviewed journals, clinical guidelines and reference texts spanning a wide range of specialties — rather than broad, unfiltered internet sources.
Equally important is who is responsible for curating and governing that information. Elsevier has been involved in scientific and medical publishing for more than 140 years, and that history is reflected in established editorial processes, governance and experience in managing scientific information at scale.
years of scientific and medical publishing expertise behind the platform.
journals with daily refreshed content updates feeding the evidence base.
real-time citation validation and clinician-in-the-loop review, not a black box.
The sourcing is transparent: clinicians can trace recommendations back to the underlying evidence, review citations directly and interrogate where conclusions come from. This does not remove the need for clinical judgment — but systems designed around evidence quality, editorial oversight, traceability and validated medical content create a far safer foundation than models optimized primarily for conversational fluency. As the EU AI Act takes effect, such characteristics are no longer differentiators; they are prerequisites.
The next phase of clinical AI
Trust and leadership will define the next phase of clinical AI
AI will remain central to the future of healthcare innovation, but Europe is sending a clear message that scale alone is no longer enough. As regulatory expectations evolve, the EU AI Act reinforces principles healthcare has always depended on: patient safety, clinical accountability and evidence integrity.
Leadership in healthcare will not be defined simply by who adopts AI fastest, but by who adopts it responsibly and ethically.
Increasingly, that means giving clinicians a credible, evidence-led alternative and making it the easier choice, rather than leaving them to default to whatever is free and open. At the same time, patients now arrive with AI-generated information in hand, which makes trust even more important. For healthcare organizations, the challenge is selecting technologies that support clinical decision-making without undermining accountability, transparency or patient trust. The leaders who build on a credible, evidence-led foundation now will help define what trusted, responsible clinical AI looks like — anything less does not belong at the point of care.
Click to download the whitepaper and read the full contents.
See it in practice
Explore what governed, evidence-led clinical AI looks like
Request a free 90-day trial of ClinicalKey AI and put credible, traceable, evidence-led AI in clinicians’ hands.
Request a free 90-day trial*Individual subscriptions and trial availability vary by country and are currently offered in selected markets, including the UK and parts of Europe.