Artificial intelligence (AI) is now integral to healthcare, offering transformative benefits such as enhanced diagnostics, personalized treatment plans, and improved operational efficiency.
However, as AI technologies become more prevalent, robust AI governance frameworks are critical to ensure that these technologies are used responsibly, ethically, and effectively.
Let's explore the importance of AI governance in healthcare, supported by recent statistics and insights.
Establishing Foundations of AI Governance
According to a recent roundtable session hosted by intelligence platform Elion, 74% of healthcare organizations have established dedicated AI governance committees and frameworks to prioritize use cases.
These committees play a crucial role in overseeing the development and deployment of AI solutions and ensuring they align with the organization's goals and ethical standards.
Structured governance frameworks allow healthcare organizations to:
- Systematically evaluate AI projects
- Manage risks
- Ensure compliance with regulatory requirements
This foundational step is essential in building trust and fostering a culture of accountability within the organization.
Developing Processes and Policies
While progress continues in establishing governance foundations, more work remains to develop comprehensive processes and policies for adopting and managing AI-driven solutions.
According to the roundtable, only 50% of healthcare organizations have processes in place for evaluating and monitoring AI products—indicating a significant gap in ensuring ongoing oversight and quality control of AI applications.
Effective AI governance entails an initial assessment of AI solutions, as well as continuous monitoring and evaluation to proactively tackle any emerging issues.
Such ongoing work involves:
- Setting up protocols for regular audits
- Performance evaluations
- Updates to AI systems to ensure effectiveness and safety over time
Managing the Use of Large Language Models (LLMs)
The use of large language models (LLMs) such as ChatGPT is becoming increasingly common in healthcare.
The roundtable found that 80% of organizations permit the use of LLMs, but there are variations in governance policies regarding their usage. Some organizations allow LLMs only for administrative purposes, while others extend their use to clinical applications within defined scopes. However, some organizations still lack specific guidelines for LLM usage.
This disparity highlights the need for tailored governance policies that reflect each organization's specific needs and capabilities. Clear guidelines and best practices for LLM usage can help mitigate risks associated with these powerful tools, such as data privacy concerns and the potential for generating inaccurate information.
Tailoring Governance to Organizational Context
AI governance strategies are not one-size-fits-all; they must be adapted to the unique context of each healthcare organization.
Organizational size, technology maturity, and available resources significantly influence governance approaches. For example, academic medical centers (AMCs) often have more in-house AI expertise and may adopt more sophisticated governance frameworks than regional health systems with fewer resources.
Understanding these organizational differences is crucial for developing effective governance strategies. Tailoring AI governance to the specific context ensures that policies are practical, enforceable, and aligned with the organization's capabilities and goals.
Addressing the Need for High-Quality Information and Leadership
Despite the progress in AI governance, there is a strong desire for more high-quality information and thought leadership on key governance topics.
Healthcare organizations are seeking guidance on several critical areas, including:
- AI literacy, training, and education: Enhancing the understanding of AI technologies among healthcare professionals to ensure they can effectively use and oversee AI applications.
- AI solution life cycle management: Establishing best practices for the entire life cycle of AI solutions, from development and deployment to maintenance and decommissioning.
- Benchmarking for AI solution testing and evaluation metrics: Developing standardized benchmarks and metrics to evaluate the performance and safety of AI solutions consistently.
These areas are pivotal in building a comprehensive AI governance framework that addresses current challenges and prepares organizations for future advancements in AI technology.
The Necessity of AI Governance in Healthcare
As AI continues transforming the healthcare industry, robust governance frameworks are essential to ensure these technologies are used responsibly, ethically, and effectively.
Our clinically validated digital self-triage solution is built on a foundation of ethical, responsible AI use. If your healthcare organization seeks to improve patient access and engagement, overcome staff shortages and burnout, and increase efficiency, let's chat.
