Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • NEWS FEATURE

AI image generators often give racist and sexist results: can they be fixed?

Researchers are tracing sources of racial and gender bias in images generated by artificial intelligence, and making efforts to fix them.
  1. Ananya

    1. Ananya is a freelance journalist and translator based in Bengaluru, India.

    View author publications

    You can also search for this author in PubMed  Google Scholar

In 2022, Pratyusha Ria Kalluri, a graduate student in artificial intelligence (AI) at Stanford University in California, found something alarming in image-generating AI programs. When she prompted a popular tool for ‘a photo of an American man and his house’, it generated an image of a pale-skinned person in front of a large, colonial-style home. When she asked for ‘a photo of an African man and his fancy house’, it produced an image of a dark-skinned person in front of a simple mud house — despite the word ‘fancy’.

Access options

Rent or buy this article

Prices vary by article type

from$1.95

to$39.95

Learn more

Prices may be subject to local taxes which are calculated during checkout

Nature 627, 722-725 (2024)

doi: https://doi.org/10.1038/d41586-024-00674-9

References

  1. Bianchi, F. et al. Proc. 2023 ACM Conf. Fairness Account. Transpar. (FAccT '23) 1493–1504 (2023); available at https://doi.org/mkw9

  2. Ash, E., Durante, R., Grebenschikova, M. & Schwarz, C. Visual Representation and Stereotypes in News Media. CEPR Discussion Paper No. DP16624 (CEPR, 2021); available at https://ssrn.com/abstract=3960205

    Google Scholar 

  3. Charani, E. et al. Lancet Glob. Health, 11, 155–164 (2023).

    Article  Google Scholar 

  4. Guilbeault, D. et al. Nature 626, 1049–1055 (2024).

    Article  PubMed  Google Scholar 

  5. Mansimov, E., Parisotto, E., Ba, J. L. & Salakhutdinov, R. Preprint at arXiv https://doi.org/10.48550/arXiv.1511.02793 (2015).

  6. Bansal, H., Yin, D., Monajatipoor, M. & Chang, K.-W. in Proc. 2022 Conf. Empir. Methods Nat. Lang. Process. 1358–1370 (Association for Computational Linguistics, 2022); available at https://doi.org/mkxb

  7. Fraser, K. C., Kiritchenko, S. & Nejadgholi, I. in 14th Int. Conf. Comput. Creativity (ICCC'23) (International Conference on Computational Creativity, 2023); available at https://go.nature.com/4abrcyz

  8. Birhane, A., Prabhu, V. U. & Kahembwe, E. Preprint at arXiv https://doi.org/10.48550/arXiv.2110.01963 (2021).

  9. Dodge, J. et al. in Proc. 2021 Conf. Empir. Methods Nat. Lang. Process. 1286–1305 (Association for Computational Linguistics, 2021); available at https://doi.org/mkxc

  10. Birhane, A., Prabhu, V., Han, S., Boddeti, V. N. & Luccioni A. S. Preprint at arXiv https://doi.org/10.48550/arXiv.2311.03449 (2023).

  11. Gebru, T. et al. Commun. ACM 64, 86–92 (2021).

    Article  Google Scholar 

Download references

Subjects

Latest on:

Nature Careers

Jobs

  • Postdoc Fellowships

    Train with world-renowned cancer researchers at NIH? Consider joining the Center for Cancer Research (CCR) at the National Cancer Institute

    Bethesda, Maryland

    NIH National Cancer Institute (NCI)

  • Faculty Recruitment, Westlake University School of Medicine

    Faculty positions are open at four distinct ranks: Assistant Professor, Associate Professor, Full Professor, and Chair Professor.

    Hangzhou, Zhejiang, China

    Westlake University

  • PhD/master's Candidate

    PhD/master's Candidate    Graduate School of Frontier Science Initiative, Kanazawa University is seeking candidates for PhD and master's students i...

    Japan (JP)

    Kanazawa University

  • Senior Research Assistant in Human Immunology (wet lab)

    Senior Research Scientist in Human Immunology, high-dimensional (40+) cytometry, ICS and automated robotic platforms.

    Boston, Massachusetts (US)

    Boston University Atomic Lab

  • Postdoctoral Fellow in Systems Immunology (dry lab)

    Postdoc in systems immunology with expertise in AI and data-driven approaches for deciphering human immune responses to vaccines and diseases.

    Boston, Massachusetts (US)

    Boston University Atomic Lab

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing

Search

Advanced search

Quick links