Medical AI evaluation still largely emphasizes model performance under controlled conditions. However, whether an AI-enabled clinical capability can be introduced, used safely and appropriately, and sustained in routine care depends on additional socio-technical conditions. We propose clinical deployability as a second-order, multi-level construct capturing this readiness for real-world clinical work. Deployability integrates three coordinated domains: (A) task usability and safety-in-use; (B) implementation workability (embedding, routinization, sustainment); and, (C) accountability (in-use decision performance and risk governability). We outline operational criteria and a pragmatic measurement strategy based on a deployability dashboard rather than a single scalar score. This paper presents an ongoing research program; future work will apply the framework in real-world implementation case studies to produce comparative deployability assessments and refine the indicator set.

Clinical Deployability: A Socio-technical Construct for Evaluating Real-World Readiness of Medical AI

Federico Cabitza;Mauro Dragoni
2026-01-01

Abstract

Medical AI evaluation still largely emphasizes model performance under controlled conditions. However, whether an AI-enabled clinical capability can be introduced, used safely and appropriately, and sustained in routine care depends on additional socio-technical conditions. We propose clinical deployability as a second-order, multi-level construct capturing this readiness for real-world clinical work. Deployability integrates three coordinated domains: (A) task usability and safety-in-use; (B) implementation workability (embedding, routinization, sustainment); and, (C) accountability (in-use decision performance and risk governability). We outline operational criteria and a pragmatic measurement strategy based on a deployability dashboard rather than a single scalar score. This paper presents an ongoing research program; future work will apply the framework in real-world implementation case studies to produce comparative deployability assessments and refine the indicator set.
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11582/373267
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
social impact