First platform ensures fair use of AI in healthcare

Researchers have developed the world’s first real-world comparative testing platform to determine whether commercial artificial intelligence (AI) algorithms are suitable for NHS use to detect disease in a fair, equitable, transparent and trustworthy way. Diabetic eye diseases serve as a first example.

They say this eliminates any bias that may come from companies seeking to use their AI software in clinical settings and gives all companies a level playing field.

Currently, NHS AI algorithm selection is focused on cost-effectiveness and alignment with human performance. However, broader challenges remain, particularly the need for robust digital infrastructure and more rigorous testing of commercial algorithms. Crucially, software used as medical devices has rarely been studied for algorithmic fairness at scale, particularly across diverse populations and ethnicities. This oversight has led to unintended health disparities, such as the use of pulse oximeters to measure…