Summary of Design AI so that it’s Fair

Looking for the article?
We have the summary! Get the key insights in just 5 minutes.

Design AI so that it’s Fair summary

Editorial Rating



  • Analytical
  • Scientific
  • Concrete Examples


Identifying intrinsic biases toward gender, race and culture in artificial intelligence systems requires a structured analysis of data collection and machine learning, and of how results are parsed by humans. AI-supported decisions by government, corporations and scholars can be unintentionally tainted by such inequities. In a detailed report citing numerous real-world examples, James Zou and Londa Schiebinger offer solid suggestions about how to adjust AI algorithms, aiming for fairness to millions who may be affected. The article is required reading for anyone involved in business and policy decisions, and concerned by the ethics of AI systems.

About the Authors

James Zou is assistant professor of biomedical data science and (by courtesy) of computer science and electrical engineering, Stanford University. Londa Schiebinger is the John L. Hinds Professor of History of Science and director of Gendered Innovations in Science, Health & Medicine, Engineering, and Environment, Stanford University.


Artificial intelligence (AI) applications tend to discriminate based on gender, ethnicity, race and income.

As AI algorithms become more sophisticated, biases creep into the design process, requiring systemic solutions. Because most AI tasks demand huge data sets, programmers must examine the gathering, organization and processing of billions of images and words. When neural networks scrape global websites such as Google Images or Wikipedia for information, unintended inequalities can occur.

For example, India and China comprise 36% of the world’s people, but only provide about 3% of ImageNet’s 14 million pictures. This explains why its vision algorithms identify a woman in a white ...

Comment on this summary

More on this topic

By the same authors

Sex and Gender Analysis Improves Science and Engineering
An AI Tool to Make Clinical Trials More Inclusive
The AI Organization
The AI Advantage
Too Smart
The Creativity Code
When Health Tech Companies Change Their Terms of Service

Related Channels