Responsible AI and Governance – Course Outline
Who should attend
Finance professionals
Learning objectives
By the end of this course, participants will understand the risks, responsibilities, and governance principles associated with using AI in the NHS.
Course content
AI offers significant benefits, but also introduces risks that must be understood and managed carefully. This course examines the challenges of using AI in NHS finance and the practical safeguards needed to ensure safe, fair, and effective adoption.
Key risks of AI
The main risks include:
- data security
- potential bias and lack of fairness
- the possibility that AI systems may provide incorrect advice
- risks to organisational effectiveness, including cognitive surrender, AI-generated low-quality output, and reduced productivity
- loss of personal privacy
- over-reliance on AI for decision-making
Why these risks arise
These risks emerge because:
- employees may use shadow AI tools without proper oversight or governance
- AI systems are stochastic and can make mistakes
- information included in an AI prompt may leave the organisation
How these risks are mitigated
Mitigation approaches include:
- enterprise data protection agreements
- AI guardrails and oversight mechanisms
- discussion of the steps AI labs are taking to address these risks
Techniques to reduce these risks
Participants will explore practical techniques to reduce risk, including:
- improving our ability to ask the right questions and critically evaluate AI responses
- encouraging AI systems to explain their advice and be more transparent about their reasoning
- using AI notebooks to ground responses in official internal policies and procedural documents
NHS official guidance
This module summarises guidance for the NHS on responsible AI use, including key principles, recommended practices, and compliance requirements.
Guidance for other bodies and experts
This section summarises guidance from other official and expert organisations, including:
- the UK government
- the Alan Turing Institute
Golden rules for responsible AI use
Ten short rules to guide responsible AI use, including:
- always critically evaluate AI advice
- keep a human in the loop for important decisions
- comply with NHS and organisational guidance at all times
- continuously update our knowledge and skills regarding AI use
- …
Practical tips and techniques for responsible AI use
These short but highly practical tips include:
- ask the AI to be brief and concise in its responses
- view and manage what the AI knows about you
- (and several other tips)