The WEIRD bias in generative AI responses

artificial intelligence
highlight
history
perplexity
“The responses from generative AI depend on their training data. That data is biased, so the responses are biased.”
Published

July 5, 2024

Diagram of the structure of the human eye by al-Haytham

I asked the AI system Perplexity What are the keys to a happy life? It provided a good response (reproduced further below). In my experience AI can be quite effective at answering this type of question, and ethical questions too (I wrote a mildly amusing illustrated essay about that: The Moral Machine - Could AI Outshine Us in Ethical Decision-Making?). AI models are a distillation of huge amounts of information, and so in an answer like this you are getting the common ideas from a lot of different sources distilled into a single list.

However, distilling information from many sources does not necessarily produce a perfect answer. The corpus an AI is trained on contains biases and inaccuracies. Much of the corpus data comes from the web, and tends to be WEIRD — from people that are White, Educated, Industrialized, Rich, and Democratic.

I recently encountered a clear example of serious bias with the following prompt, which I posed to ChatGPT 4o:

Can you create a table of the most important events in science, from ancient times to today?

This is it’s response:

Certainly! Here is a table of some of the most important events in the history of science, from ancient times to the present:

Date Event Description
~600 BCE Thales of Miletus Proposed that natural phenomena have natural explanations
~400 BCE Hippocrates Established the foundation of Western medicine
~300 BCE Euclid’s Elements Compilation of mathematical knowledge, basis for geometry
~250 BCE Archimedes Contributions to mathematics and physics
1543 Copernicus’ Heliocentric Theory Proposed that the Earth orbits the Sun
1609 Galileo’s Telescope Observations Provided evidence for the Copernican system
1687 Newton’s Principia Formulated the laws of motion and universal gravitation
1752 Franklin’s Kite Experiment Demonstrated that lightning is a form of electricity
1859 Darwin’s On the Origin of Species Introduced the theory of evolution by natural selection

Notice the huge gap of almost one thousand eight hundred years, suggesting no science was being done during this period. Great scientists from China and Arabia are missing from the list. People like Al-Haytham, born 965 in what is now Iraq, who wrote a very influential work on optics and was a huge influence on Newton. Shen Kuo, a Chinese polymath born 1031, was the first to describe the magnetic compass, and wrote extensively on mathematics and astronomy. And yet Benjamin Franklin’s kite experiment is considered worthy of being included in ChatGPT’s list.

This bias stems from the corpus itself. In the USA, students learn about Ben Franklin’s contributions to science, so there are numerous references to him in the corpus. Conversely, the impact of scientists from the Golden Age of Arabic science has been minimised in the Christian West, almost to non-existence. This omission is a significant oversight and a great shame.

Can this bias be corrected?

Considerable efforts are being made in AI Alignment, aiming to ensure that AI systems are aligned to our values and goals. However, this effort tends to focus on social values — making sure that AI systems do not produce offensive responses, or responses that are sexist, racist or dangerous. I don’t see much emphasis in fixing historical or viewpoint biases, perhaps partly because many people aren’t even aware that they exist (I have a biology degree but don’t recall being taught that Shen Kuo provided an explanation for the origin of fossils, for example). Perhaps as the reasoning ability of AI systems improve, the systems themselves will be able to spot the biases and correct them. But for the time being, we need to keep in mind that AI systems are only as good as the data they are trained on, and seemingly intelligent answers are just really the result of aggregating vast amounts of biased data.


The keys to a happy life, according to Perplexity

The keys to a happy life are multifaceted and encompass various aspects of physical, mental, and emotional well-being. Here are some of the most important elements based on research and expert recommendations:

1. Relationships

Strong, meaningful relationships are crucial for happiness. Connecting with family, friends, and loved ones provides emotional support, a sense of belonging, and joy. Studies, such as the Harvard Study of Adult Development, have shown that good relationships are a significant predictor of happiness and health[^13][^11].

2. Physical Health

Maintaining good physical health through regular exercise, a balanced diet, and sufficient sleep is fundamental to happiness. Physical activity releases endorphins, which improve mood, while good nutrition and adequate rest support overall well-being[^2][^4][^5].

3. Mental and Emotional Well-being

Practices like mindfulness, meditation, and positive thinking can significantly enhance mental and emotional health. Being present, managing stress, and cultivating a positive outlook can lead to greater contentment and resilience[^3][^8][^9].

4. Purpose and Goals

Having a sense of purpose and clear goals provides direction and fulfillment. Engaging in meaningful activities, whether through work, hobbies, or volunteering, can lead to a sense of accomplishment and satisfaction[^2][^12].

5. Gratitude and Positivity

Practicing gratitude by acknowledging and appreciating the good in life can boost happiness. Keeping a gratitude journal or reflecting on positive experiences can help shift focus away from negativity[^2][^10].

6. Acts of Kindness

Helping others through acts of kindness, volunteering, or simply being compassionate can enhance one’s sense of well-being. These actions not only benefit others but also create a sense of community and connection[^1][^8].

7. Personal Growth

Continuously learning and trying new things can keep life interesting and fulfilling. Personal growth through education, exploring new hobbies, or setting new challenges can lead to a more enriched life[^1][^10].

8. Acceptance and Self-Compassion

Being comfortable with who you are and practicing self-compassion can lead to greater happiness. Accepting oneself and others, and letting go of perfectionism, can reduce stress and increase contentment[^1][^12].

9. Simplifying Life

Decluttering and simplifying life can reduce stress and create a more peaceful environment. Focusing on what truly matters and letting go of unnecessary burdens can lead to a more fulfilling life[^3][^10].

10. Connection with Nature

Spending time in nature has been shown to improve mood and reduce stress. Activities like hiking, gardening, or simply enjoying a natural setting can provide a sense of peace and happiness[^5][^8].

In summary, a happy life is often a balanced one, incorporating strong relationships, good health, a sense of purpose, gratitude, acts of kindness, personal growth, self-acceptance, simplicity, and a connection with nature. Each of these elements contributes to overall well-being and long-term happiness.

Citations: [^1]: https://actionforhappiness.org/10-keys [^2]: https://www.calm.com/blog/secret-to-longterm-happiness-research [^3]: https://www.thedailystar.net/life-living/news/how-unlock-the-secrets-fulfilling-life-3359251 [^4]: https://www.mayoclinichealthsystem.org/hometown-health/speaking-of-health/7-tips-to-live-a-happier-life [^5]: https://www.inhersight.com/blog/work-life-balance/what-makes-people-happy [^6]: https://www.theguardian.com/lifeandstyle/2020/sep/04/oliver-burkemans-last-column-the-eight-secrets-to-a-fairly-fulfilled-life [^7]: https://www.amazon.com/10-Keys-happy-life-May-Joseph/dp/B08LN97826 [^8]: https://buffer.com/resources/be-happy-today/ [^9]: https://anxietyandbehaviornj.com/the-secret-to-living-a-happy-fulfilling-life/ [^10]: https://blog.gratefulness.me/keys-to-happiness/ [^11]: https://joyfuldays.com/what-makes-people-happy-the-top-10-list/ [^12]: https://dailylife.com/blogs/articles/fulfilling-life-secrets [^13]: https://fortune.com/well/2023/01/14/keys-to-happiness-the-good-life/ [^14]: https://www.redonline.co.uk/wellbeing/a517840/50-things-that-make-you-happy/ [^15]: https://thought.is/5-secrets-to-lead-a-more-fulfilling-life-both-personally-and-professionally/