Care Inspectorate Wales: Use of Artificial Intelligence (AI) in Social Care
Our position statement sets out our expectations for the safe and responsible use of artificial intelligence (AI) in social care
Introduction
Artificial intelligence (AI) is increasingly being used across social care to support tasks such as administration, care planning and identifying risks. It has the potential to improve efficiency and support better outcomes for people, but it must be used carefully.
Care Inspectorate Wales (CIW) supports the appropriate use of AI where it improves the quality of care and outcomes for people using services. However, providers remain responsible and accountable for ensuring care is high quality and centred on people. Where AI is used, providers should ensure its use aligns with the Welsh Government’s expectation that AI is used in a way that is ethical, transparent, fair and subject to appropriate oversight.
CIW strongly recommends providers consider the Social Care Wales AI Guide for the social care sector (external link) which is a key source of practical guidance for providers on using AI safely and effectively.
Our expectations of providers
When using AI, providers should ensure that:
- AI supports, but does not replace, professional judgement
- AI should assist staff, not make decisions about care.
- Responsibility for the quality and safety of care always rests with the provider.
This aligns with requirements to ensure the wellbeing of individuals and appropriate care and support, which must always be determined by suitably qualified staff.
- Care remains safe and effective - providers must be confident that:
- AI is improving, not reducing, the quality of care
- outputs are checked for accuracy before being used
- risks are understood and managed
This aligns with duties on providers to ensure safe care and the effective operation of the service, including risk management and quality of outcomes.
- People are informed - people receiving care should:
- be aware when AI is used in ways that affect them
- understand how it is being used
- have appropriate choice wherever possible
This supports requirements to ensure people are treated with respect, involved in decisions about their care and provided with clear information.
- Care is fair and equitable - providers should ensure AI does not:
- disadvantage particular groups
- introduce or reinforce bias
This links to requirements to ensure equality, dignity and respect for individuals using services, and to avoid discriminatory practice.
- Personal information is protected - all use of AI must comply with data protection law, including:
- UK GDPR and the Data Protection Act 2018
- organisational policies on handling personal data
This supports requirements relating to information governance, record keeping and confidentiality.
- There is clear oversight and accountability - providers should have:
- clear governance arrangements for AI
- appropriate training and support for staff using AI
- processes to manage risks and review impact
- accountability for decisions supported by AI
This aligns with duties on:
- the registered provider to ensure effective governance
- the responsible individual to oversee the quality, safety and compliance of the service
Regulatory framework
There is no separate set of AI regulations. Providers must use AI in a way that complies with existing legislation and guidance, including:
Social Services and Well-being (Wales) Act 2014
Regulation and Inspection of Social Care (Wales) Act 2016
The Regulated Services (Service Providers and Responsible Individuals) (Wales) Regulations 2017
UK GDPR and Data Protection Act 2018 guidance
Welsh Government AI principles and guidance
These requirements apply equally when AI is used.
Our approach
CIW does not approve or regulate individual AI tools. Our role is to assess how providers use technology, including AI, to ensure it contributes to safe, effective and person-centred care.
Looking ahead
AI is still developing and will continue to evolve in social care.
CIW will:
- continue to develop its approach as part of its digital strategy
- work with providers and partners to understand opportunities and risks
- ensure the use of AI supports high-quality care and maintains public confidence