What Happens When God Chatbots Start Giving Spiritual Guidance? | Scientific American (https://www.scientificamerican.com/article/the-god-chatbots-changing-religious-inquiry/) (RSS) (https://www.scientificamerican.com/platform/syndication/rss/)  Skip to main content (https://www.scientificamerican.com/) Scientific American     (https://www.scientificamerican.com/newsletter-signup/) Sign Up for Our Daily Newsletter  Sign in        March 19, 2024 5min read  God Chatbots Offer Spiritual Insights on Demand. What Could Go Wrong?  Large language models trained on religious texts claim to offer spiritual insights on demand. What could go wrong?  By (https://www.scientificamerican.com/author/webb-wright/) Webb Wright  (Hands from "The Creation of Adam" painting by Michelangelo, with HTML coding above the hands.) Kenn Brown/MondoWorks    April 2024 Issue     Artificial Intelligence        J ust before midnight on the first day of Ramadan last year, Raihan Khan—a 20-year-old Muslim student living in Kolkata—announced in a LinkedIn post that he had launched QuranGPT, an artificial-intelligence-powered chatbot he had designed to answer questions and provide advice based on Islam’s holiest text. Then he went to sleep. He awoke seven hours later to find it had crashed because of an overflow of traffic. A lot of the comments were positive, but others were not. Some were flat-out threatening. Khan felt pressure at first to take the chatbot offline, but he ultimately changed his mind. He believes AI can serve as a kind of bridge that connects people with answers to their most profound spiritual questions. “There are people who want to get close to their religion [but] are not willing to spend the time to get to know more about it,” Khan says. “What if I could make it all easily accessible through one prompt?”   QuranGPT—which has now been used by about 230,000 people around the world—is just one of a litany of chatbots trained on religious texts that have recently appeared online. There’s Bible.Ai, Gita GPT, Buddhabot, (https://gab.com/ApostlePaulBot) Apostle Paul AI , a chatbot trained to imitate 16th-century German theologian (https://deepai.org/chat/martin-luther) Martin Luther , another trained on the works of (https://deepai.org/chat/confucius) Confucius , and yet another designed to imitate the (https://delphi.allenai.org/) Delphic oracle . For millennia adherents of various faiths have spent long hours—or entire lifetimes—studying scripture to glean insights into the deepest mysteries of human existence, say, the fate of the soul after death. The creators of these chatbots don’t necessarily believe large language models (LLMs) will put these age-old theological enigmas to rest. But they do think that with their ability to identify subtle linguistic patterns within vast quantities of text and provide responses to user prompts in humanlike language (a feature called natural-language processing, or NLP), the bots can theoretically synthesize spiritual insights in a matter of seconds, saving users both time and energy. It’s divine wisdom on demand. Many professional theologians, however, have serious concerns about blending LLMs with religion. Ilia Delio, chair of theology at Villanova University and author of several books about the overlap between religion and science, believes these chatbots—which she describes disparagingly as “shortcuts to God”—undermine the spiritual benefits that have traditionally been achieved through long periods of direct engagement with religious texts. And some secular AI experts think the use of LLMs to interpret scripture is based on a fundamental and potentially dangerous misunderstanding of the technology. Yet religious communities are embracing many types and uses of AI.   One such emerging use case is biblical translation. Before now this work was painstakingly slow; translating ancient sources into the English King James Bible, first published in 1611, took (https://time.com/4821911/king-james-bible-history/) seven years and a host of devoted scholars. But LLMs are expediting the process, enabling scholars to expand the Bible’s reach. A platform called Paratext, for example, uses NLP to translate esoteric terms from scripture—such as “atonement” or “sanctification”—to produce what it describes on its (https://paratext.org/) website as “faithful translations of the scriptures.” And last year computer scientists at the University of Southern California launched the (https://viterbischool.usc.edu/news/2023/06/to-the-ends-of-the-earth-bringing-the-bible-to-languages-never-before-reached/) Greek Room , a project that aids translation of the Bible into “low-resource” languages (that is, languages for which few, if any, written records exist) through the use of an AI chatbot interface. LLMs are also being used as a means of studying linguistic variations among translations of the Bible. In a research paper uploaded to the preprint site arXiv.com earlier this year, an international team of scientists described the use of sentiment analysis—an NLP-enabled process for detecting emotional valence in text—to analyze Jesus’ Sermon on the Mount, one of the most well-known passages from the New Testament. (“Blessed are the meek, for they will inherit the earth ...”) After analyzing five different translations of this sermon, including the King James version, the researchers “found that the vocabulary of the respective translations is significantly different” in each case. They also “detected different levels of humor, optimism and empathy in the respective chapters that were used by Jesus to deliver his message.” Related Stories (https://www.scientificamerican.com/article/ai-could-help-find-a-solution-for-string-theory/)  (https://www.scientificamerican.com/article/ai-could-help-find-a-solution-for-string-theory/) AI Could Help Find a Solution for String Theory  (https://www.scientificamerican.com/author/manon-bischoff/) Manon Bischoff    (https://www.scientificamerican.com/article/ai-doesnt-threaten-humanity-its-owners-do/)  (https://www.scientificamerican.com/article/ai-doesnt-threaten-humanity-its-owners-do/) AI Doesn’t Threaten Humanity. Its Owners Do  (https://www.scientificamerican.com/author/joseph-jones/) Joseph Jones    (https://www.scientificamerican.com/article/ai-is-helping-referee-games-in-major-sports-leagues-but-limitations-remain/)  (https://www.scientificamerican.com/article/ai-is-helping-referee-games-in-major-sports-leagues-but-limitations-remain/) AI Is Helping Referee Games in Major Sports Leagues, but Limitations Remain  (https://www.scientificamerican.com/author/ben-dowsett/) Ben Dowsett    (https://www.scientificamerican.com/article/3-ways-scientific-thinking-could-help-save-the-world/)  (https://www.scientificamerican.com/article/3-ways-scientific-thinking-could-help-save-the-world/) 3 Ways Scientific Thinking Could Help Save the World  (https://www.scientificamerican.com/author/lee-billings/) Lee Billings    (https://www.scientificamerican.com/article/chatbots-have-thoroughly-infiltrated-scientific-publishing/)  (https://www.scientificamerican.com/article/chatbots-have-thoroughly-infiltrated-scientific-publishing/) Chatbots Have Thoroughly Infiltrated Scientific Publishing  (https://www.scientificamerican.com/author/chris-stokel-walker/) Chris Stokel-Walker      AI could help to reinvigorate theology or religious study. Computer scientist Mark Graves believes that LLMs could hypothetically be used to chip away at rigid religious orthodoxy. “In a certain sense, there’s not much that’s been new in theology for, like, 800 years,” says Graves, who is the director of the nonprofit AI and Faith, which wrestles with the ethical challenges of AI. “Generative AI can help with that transition of breaking out of the box ... and creating new ideas.” For instance, Graves says, imagine one chatbot that’s been trained on the works of Saint Augustine (C.E. 354–430) and another that’s been trained on the works of Thomas Aquinas (circa 1225–1274). Theologians could then have these two noncontemporaries “speak” to each other, possibly leading to fruitful questions about, say, the nature of evil. He compares the stochastic mechanisms behind LLMs to “a novice student or even a young child [asking] a question that prompts a new way of thinking about something.” Other AI experts, however, are decidedly wary. “There’s going to be a temptation to make money, to make notoriety and to gain attention by ascribing some type of revelatory quality to these chatbots,” says (https://www.linkedin.com/in/thomas-arnold-bb3a5434/) Thomas Arnold , a visiting scholar of technology ethics at Tufts University, who also has a doctorate in religious studies from Harvard University.   Chatbots trained on religious texts “are going to carry some of the same defects that all large language models have at the moment, the biggest of which is hallucinations,” says Noreen Herzfeld, a professor of theology and computer science at Saint John’s University in Minnesota. “They’re going to make stuff up. And if people then believe that what these models are spouting is actually in the Quran or in the New Testament, they could be severely misled.” Max Marion, a machine-learning engineer who works on fine-tuning the performance of LLMs at AI company MosaicML, worries that Hollywood has already instilled into the public imagination an erroneous picture of AI as infallibly truthful (think of HAL 9000 from Stanley Kubrick’s 2001: A Space Odyssey, for example). But LLMs, he explains, are designed to arrange words in the most statistically logical order; what we call truth doesn’t factor into the equation. “A chatbot is just a correlation machine,” says Beth Singler, an anthropologist specializing in AI and an assistant professor of digital religions at the University of Zurich. “It takes the corpus [of text], remixes the words and puts them next to each other in terms of their probability of what word follows the next.... That’s not the same as understanding and explaining a doctrine.” The danger of hallucination in this context is compounded by the fact that religiously oriented chatbots are likely to attract acutely sensitive questions—questions one might feel too embarrassed or ashamed to ask a priest, an imam, a rabbi or even a close friend. During a software update to QuranGPT last year, Khan had a brief glimpse into user prompts, which are usually invisible to him. He recalls seeing that one person had asked, “I caught my wife cheating on me—how should I respond?” Another, more troublingly, had asked, “Can I beat my wife?” Khan was pleased with the system’s responses (it urged discussion and nonviolence on both counts), but the experience underscored the ethical gravity behind his undertaking. Indeed, other chatbots have responded with deplorable advice. There have been (https://www.cbc.ca/news/world/india-religious-chatbots-1.6896628) documented cases of Gita GPT condoning murder while citing passages from the Bhagavad Gita. Killing someone, it says, is okay as long as it’s done for the sake of protecting one’s dharma, or duty. For anyone prompting these chatbots for advice, Singler urges people to use a “hermeneutic of suspicion”—a sense of caution born from the fact that words can always be interpreted in many ways, not only by fallible human beings but now also by fallible machines.    From Our Archives (https://www.scientificamerican.com/article/how-ai-knows-things-no-one-told-it/) An AI Mystery.  George Musser; September 2023.(https://www.scientificamerican.com/archive/issues/) Scientific American.com/archive    (https://www.scientificamerican.com/author/webb-wright/) Webb Wright  is a freelance science journalist who lives in Brooklyn, N.Y.  (https://www.scientificamerican.com/author/webb-wright/) More by Webb Wright    (https://www.scientificamerican.com/issue/sa/2024/04-01/) (Scientific American Magazine Vol 330 Issue 4)  This article was originally published with the title “Shortcuts to God ” inScientific American Magazine Vol. 330No. 4(April 2024 ), p. 37 doi:10.1038/scientificamerican0424-37  (https://www.scientificamerican.com/issue/sa/2024/04-01/) View This Issue        Popular Stories   (https://www.scientificamerican.com/article/2-high-school-students-prove-pythagorean-theorem-heres-what-that-means/) (The Pythagorean theorem written on a chalkboard)  Mathematics April 10, 2023 2 High School Students Prove Pythagorean Theorem. Here’s What That Means   At an American Mathematical Society meeting, high school students presented a proof of the Pythagorean theorem that used trigonometry—an approach that some once considered impossible  Leila Sloman   (https://www.scientificamerican.com/article/chatbots-have-thoroughly-infiltrated-scientific-publishing/) (Cropped image of a line chart shows various words, including “noteworthy” and “intricate,” increasing in usage over time.)  Artificial Intelligence May 1, 2024 AI Chatbots Have Thoroughly Infiltrated Scientific Publishing   One percent of scientific articles published in 2023 showed signs of generative AI’s potential involvement, according to a recent analysis  Chris Stokel-Walker   (https://www.scientificamerican.com/article/where-does-the-solar-system-end/) (Illustration of the solar system, including its eight planets and the sun: Mercury, Venus, the Earth, Mars, asteroid belt, Jupiter, Saturn, Uranus, Neptune and at its outer limits the Kuiper Belt and the Oort Cloud)  Space Exploration May 3, 2024 Where Is the Edge of the Solar System?   The solar system’s outer limits aren’t as clear-cut as you might think  Phil Plait   (https://www.scientificamerican.com/article/we-are-in-the-golden-age-of-bird-watching/) (Blue, grey, black and white bird sitting on a piece of wood.)  Animals April 25, 2024 We Are in the Golden Age of Bird-Watching   There has never been a better time to be or become a birder  Kate Wong   (https://www.scientificamerican.com/article/collapsing-sheets-of-spacetime-could-explain-dark-matter-and-why-the/) (Gradient steam bubble hole)  Cosmology May 2, 2024 Collapsing Sheets of Spacetime Could Explain Dark Matter and Why the Universe ‘Hums’   Domain walls, long a divisive topic in physics, may be ideal explanations for some bizarre cosmic quirks  Anil Ananthaswamy   (https://www.scientificamerican.com/article/the-science-of-3-body-problem-whats-fact-and-whats-fiction/) (Male in plaid shirty and female in brown coat standing in empty space looking up.)  Extraterrestrial Life May 2, 2024 The Science of ‘ 3 Body Problem’: What’s Fact and What’s Fiction?   The hit sci-fi show’s adviser and two other researchers discuss its portrayal of scientists and their technologies  Sumeet Kulkarni, Nature magazine     Expand Your World with Science  Learn and share the most exciting discoveries, innovations and ideas shaping our world today. (https://www.scientificamerican.com/getsciam/) Subscribe (https://www.scientificamerican.com/newsletter-signup/) Sign up for our newsletters (https://www.scientificamerican.com/) See the latest stories (https://www.scientificamerican.com/latest-issue/) Read the latest issue (https://www.scientificamerican.com/getsciam/gift/) Give a Gift Subscription Follow Us:(https://www.instagram.com/scientific_american/?hl=en) (Instagram link) (Instagram)    (https://www.youtube.com/user/SciAmerican) (YouTube link) (YouTube)    (https://twitter.com/sciam) (Twitter link) (Twitter)    (https://www.facebook.com/ScientificAmerican) (Facebook link) (Facebook)    (https://www.scientificamerican.com/platform/syndication/rss/) (RSS feed) (RSS feed)      (Scientific American publications in print & digital formats)   (https://www.scientificamerican.com/page/return-refund-policy/) Return & Refund Policy  (https://www.scientificamerican.com/page/about-scientific-american/) About  (https://www.scientificamerican.com/pressroom/) Press Room    (https://www.scientificamerican.com/page/frequently-asked-questions/subscriptions/) FAQs  (https://www.scientificamerican.com/page/contact-us/customer-service/) Contact Us  (https://www.scientificamerican.com/page/international/) International Editions    (https://www.scientificamerican.com/mediakit/) Advertise  (https://www.scientificamerican.com/accessibility-statement/) Accessibility Statement  (https://www.scientificamerican.com/page/terms-of-use/) Terms of Use    (https://www.scientificamerican.com/page/privacy-policy/) Privacy Policy  (https://www.scientificamerican.com/page/california-consumer-privacy-statement/) California Consumer Privacy Statement  Use of cookies/Do not sell my data     Scientific American is part of Springer Nature, which owns or has commercial relations with thousands of scientific publications (many of them can be found at www.springernature.com/us). Scientific American maintains a strict policy of editorial independence in reporting developments in science to our readers. © 2024 SCIENTIFIC AMERICAN, A DIVISION OF SPRINGER NATURE AMERICA, INC.ALL RIGHTS RESERVED.      We Value Your Privacy We use cookies to enhance site navigation, analyze site usage & personalize content to provide social media features and to improve our marketing efforts. We also share information about your use of our site with our social media, advertising and analytics partners. By clicking “Accept All Cookies”, you agree to the storing of cookies on your device for the described purposes. (https://www.scientificamerican.com/page/privacy-policy/) View Our Privacy Policy    Cookies Settings Accept All Cookies