AI Recognises Race in Medical Images
Previous studies have shown that AI can predict your sex and age from looking at an eye scan, or your race from a chest X-ray. The authors thought that AI models could use these colour differences to work out the bone density of a patient, and therefore predict their race. C3 Is AI picking up on differences in anatomy on imaging to predict race? Was the AI picking up subtle differences in anatomy to detect race? Different races might have different heart positions, lung sizes etc. This heatmap shows areas in which the AI was paying particular attention when determining a patient's race. Result: The AI is worse at detecting race, but still performs pretty well. One of the paper's authors: Luke Oakden-Rayner believes AI's ability to detect race so easily is very bad and could lead to bias.