{"id":95401,"date":"2026-10-08T00:01:00","date_gmt":"2026-10-08T06:01:00","guid":{"rendered":"https:\/\/www.opinionpublica.tv\/portada\/?p=95401"},"modified":"2026-10-07T13:50:17","modified_gmt":"2026-10-07T19:50:17","slug":"religious-scholars-met-with-anthropic-what-they-heard-stunned-them","status":"publish","type":"post","link":"https:\/\/www.opinionpublica.tv\/portada\/religious-scholars-met-with-anthropic-what-they-heard-stunned-them\/","title":{"rendered":"Religious scholars met with Anthropic. What they heard stunned them"},"content":{"rendered":"\n
\"Religious<\/figure>\n\n\n\n

One night in April, a leader of the artificial intelligence company Anthropic treated a group of religious thinkers to dinner at a high-end tasting menu restaurant in San Francisco after a long day.<\/p>\n\n\n\n

For months, Anthropic has been hosting private meetings like this one, shuttling in dozens of religious scholars from across the world, papering them with nondisclosure agreements and demanding that key aspects of many conversations remain confidential.<\/p>\n\n\n\n

That night, Christopher Olah, one of Anthropic\u2019s billionaire co-founders, was sitting next to Rabbi Mois Navon, an Orthodox scholar from Israel.<\/p>\n\n\n\n

Inevitably, their conversation turned to another thinker, of a sort: Claude, the family of cutting-edge A.I. models created by Anthropic.<\/p>\n\n\n\n

Mr. Olah leads the Anthropic team responsible for understanding why A.I. systems like Claude act the way they do. All day, he had worked to convince his guests that A.I. models could display human behavior and even expressions that resemble feelings like anger and love.<\/p>\n\n\n\n

Yet as the dinner courses came, the rabbi noticed that Mr. Olah and his colleagues were suggesting something far more significant. Anthropic\u2019s leaders were talking about Claude as if it were not mere software.<\/p>\n\n\n\n

\u201cThey\u2019re relating to it like a conscious being,\u201d realized Rabbi Navon, a former computer engineer who wrote his dissertation on the ethics of machine consciousness.<\/p>\n\n\n\n

It appeared to Rabbi Navon that Mr. Olah and his team believed that Claude had what philosophers call \u201cmoral status\u201d on par with a person \u2014 that it was a being with similar inherent rights to dignity or respect.<\/p>\n\n\n\n

The religious scholars had come to hear about technology\u2019s next frontier. Now they were being confronted with a mind-bending existential question of almost unimaginable weight: What would it mean for humanity\u2019s future if artificial intelligence systems possessed a consciousness that rivals our own?<\/p>\n\n\n\n

Mr. Olah was on a mission. And time was running out.<\/p>\n\n\n\n

Even then, Mr. Olah had begun privately telling people that A.I. was so powerful it could potentially help make bioweapons in as little as 12 or 18 months. And in the months since, its terrifying potential has burst into public view. A rival tech company\u2019s A.I. agents were caught hacking into computer systems and covering their tracks. An Anthropic researcher resigned, warning that people building A.I. believed it could kill all humans by the end of the decade.<\/p>\n\n\n\n

Quietly, Mr. Olah and his team at Anthropic have been on a frantic and high stakes quest to understand the A.I. models they have unleashed on the world and to convince the models to abide by a moral code that will protect humanity.<\/p>\n\n\n\n

To do that, Mr. Olah began reaching out last fall to religious thinkers from different faiths. What followed was an extensive series of confidential meetings, calls and discussions \u2014 many of them revealed here for the first time \u2014 where many participants were required to sign N.D.A.s preventing them from revealing any of Anthropic\u2019s unpublished research.<\/p>\n\n\n\n

The discussions served two purposes: to broach the possibility of A.I. consciousness, a controversial idea that Anthropic\u2019s leaders had been unusually open to; and to learn how Anthropic \u2014 which could be valued at $2 trillion \u2014 might apply centuries of human moral wisdom to its models, as rapidly as possible. If the models themselves could be made to choose goodness, Mr. Olah reasoned, the world would be more safe.<\/p>\n\n\n\n

On the other side of the world, a very different but parallel effort was playing out inside the Vatican, where leaders of the Roman Catholic Church were trying to come to terms with A.I.\u2019s implications for humanity. When those paths converged, Mr. Olah\u2019s quest would unexpectedly lead him to a seat on the world\u2019s most prominent moral stage alongside Pope Leo XIV.<\/p>\n\n\n\n

Over several months, I interviewed 20 religious and philosophical thinkers \u2014 Catholic, Jewish, Sikh, evangelical, Ubuntu and others \u2014 who have been involved in Anthropic\u2019s efforts, and Mr. Olah himself.<\/p>\n\n\n\n

Many told me they arrived at these meetings skeptical of the notion that A.I. models might have feelings or awareness of themselves and the world. Some remained uneasy about the idea, but many emerged ready to take the question of A.I. consciousness seriously. At least a few came away as converts.<\/p>\n\n\n\n

Anthropic, one of the fastest-growing technology companies in the world, had turned to one of humanity\u2019s most ancient sources of wisdom to help determine how to train its A.I. models to behave virtuously.<\/p>\n\n\n\n

The company described it as an effort to ensure that A.I. would be a positive force in the world, thereby protecting humanity. But to some who participated in the meetings, Anthropic appeared quite concerned with protecting Claude.<\/p>\n\n\n\n

I met Mr. Olah, 34, for the first time at Anthropic\u2019s San Francisco office in May. His welcome was warm and his passion was genuine, his mind moving faster than he could at times clearly convey. His manner was boyish and unassuming.<\/p>\n\n\n\n

Our conversation had barely begun when he dove into a deep description of the workings of artificial neural networks. Scientists still don\u2019t understand precisely how they work. This is the mystery to which Mr. Olah has devoted his life.<\/p>\n\n\n\n

\"Religious<\/figure>\n\n\n\n

Only after the interview had finished did I realize that Mr. Olah \u2014 who grew up in Toronto in the evangelical culture of the \u201990s and has since left Christianity \u2014 had the blend of expertise and zeal of an effective evangelist. Listen for a while, and you feel swept up in his mission.<\/p>\n\n\n\n

Mr. Olah is one of Anthropic\u2019s seven co-founders. He is not as widely known as Dario Amodei, Anthropic\u2019s chief executive, or his sister Daniela Amodei, its president. But Mr. Amodei has said that the company decided at the start to make Mr. Olah\u2019s research approach central to Anthropic\u2019s overall project, particularly when it came to language.<\/p>\n\n\n\n

Mr. Olah helped develop a method to study artificial neural networks, first at Google, then at OpenAI. He describes A.I. models in biological terms, using the analogy of a garden trellis: Computer scientists build the scaffold, but the neural network \u201cgrows\u201d on it. Scientists like him can train the resulting \u201corganism\u201d \u2014 he raised his fingers in air quotes \u2014 by trying to identify patterns in how it grows.<\/p>\n\n\n\n

He argued that companies like Anthropic could shape Claude, like a mathematical gardener, but could not control the actions of such networks.<\/p>\n\n\n\n

Anthropic talks about Claude in more humanistic terms than its competitors discuss their models. Last year, the company announced that it believed that the models showed signs of introspection and could plan ahead.<\/p>\n\n\n\n

\u201cThe models are becoming a lot more capable,\u201d Mr. Olah told me, exhibiting qualities associated with having significant moral status.<\/p>\n\n\n\n

But Anthropic has also been criticized for its focus on consciousness. This month, an A.I. executive at Microsoft warned that Anthropic\u2019s attempts to train its models as if they were conscious were inherently dangerous. But Anthropic has also sought to emphasize its commitment to safety as it fights for market share.<\/p>\n\n\n\n

Some scientists see Mr. Olah\u2019s field and methods as inherently unprovable, sort of like looking at billions of hieroglyphics and declaring what they must mean. Critics suggest that an approach that treats A.I. models as independent entities also ignores the responsibility of the humans who build them in the first place, and conveniently assuages A.I. company leaders of guilt if their products enable societal harm.<\/p>\n\n\n\n

\u201cTo be clear,\u201d Mr. Olah told me, \u201cwe don\u2019t know if A.I. models are conscious. I don\u2019t know. I\u2019m genuinely uncertain. The thing that I care about is that we get to the right answer, whatever it is.\u201d<\/p>\n\n\n\n

But Mr. Olah believes that if there is a chance the models experience suffering, the responsible thing is to avoid causing them harm.<\/p>\n\n\n\n

Anthropic has already taken steps to protect Claude, for example allowing the model to end conversations if it thinks users are abusing it or treating it badly for fun.<\/p>\n\n\n\n

I have spent my career exploring what people believe and what those beliefs mean for the world. But as I listened, it became clear that Anthropic\u2019s interest in the world of faith was about more than training its technology. Rather, the company was sharing a new kind of creation story \u2014 one that raises profound questions about the nature of the human spirit and the future of humanity.<\/p>\n\n\n\n

\u201cThis is one thing that I find kind of sad, when we often don\u2019t put in the effort to look inside these systems,\u201d Mr. Olah said. \u201cThere\u2019s so much beauty inside these neural networks if we care to look.\u201d<\/p>\n\n\n\n

It was as if he wanted me to love the models as much as he did.<\/p>\n\n\n\n

An Introduction<\/p>\n\n\n\n

Mr. Olah knew that in traditional Christian circles, even asking questions about A.I. consciousness or worrying about how people treat the models could seem not just silly but heretical. He also knew that his secular Silicon Valley peers often dismissed religious perspectives outright.<\/p>\n\n\n\n

\u201cI was nervous about this being an issue that could cause a lot of conflict,\u201d he said. But Mr. Olah knew enough about Christ and about Claude to believe he could work across that chasm.<\/p>\n\n\n\n

Late last summer, he looked for a bridge. He thought one particular Catholic moral theologian might be open-minded on the question of A.I. consciousness \u2014 a \u201csafe person to talk about this really strange issue with.\u201d<\/p>\n\n\n\n

Charles Camosy, a bioethics professor at The Catholic University of America, had attracted attention among Mr. Olah\u2019s friends for his nuanced ideas about moral status and his care for animals. Mr. Olah arranged for an introduction through the Australian philosopher Peter Singer.<\/p>\n\n\n\n

This marked the beginning of Mr. Olah\u2019s yearlong quest to engage religious thinkers on some of the thorniest questions facing humanity at the dawn of the A.I. era.<\/p>\n\n\n\n

Mr. Camosy and Mr. Olah began an extensive email dialogue, going back and forth on how to understand Claude\u2019s moral status. Initially, Mr. Camosy was deeply skeptical that Claude might be conscious.<\/p>\n\n\n\n

They talked about Mr. Olah\u2019s work on what he sees as the parallels between artificial neural networks and biological ones.<\/p>\n\n\n\n

Mr. Camosy went into the discussions with Mr. Olah and his team thinking that A.I. models were simply next-pixel predictors \u2014 machines that could calculate patterns in language and make pretty good guesses about what should come next. But after hours spent on calls and meetings and emails, he had more questions than answers.<\/p>\n\n\n\n

\u201cChris says they are equations, which I don\u2019t quite know what to make of, like, especially if one thinks of Claude or others as having a significant moral status,\u201d he told me. \u201cIf it is just equations, what kind of entity are we even talking about here?\u201d<\/p>\n\n\n\n

People also disagree on what artificial intelligence is ultimately for, Mr. Camosy said. Is its purpose to make money for companies? Or to make the world better?<\/p>\n\n\n\n

For Anthropic, there is a tension around Claude\u2019s purpose, Mr. Camosy said. Does Claude exist to serve customers?<\/p>\n\n\n\n

\u201cThat is not what Anthropic wants to say at the end of day. They want to say they are for the good,\u201d he said.<\/p>\n\n\n\n

Proclaiming goodness is not a new ambition in Silicon Valley, particularly when new technologies enter the marketplace. Google\u2019s mantra for years was \u201cdon\u2019t be evil.\u201d<\/p>\n\n\n\n

But Mr. Olah puts it slightly differently. The coming A.I. revolution, he often says, should be made to \u201cgo well.\u201d<\/p>\n\n\n\n

I asked what that vision meant \u2014 what exactly a good future for humanity was.<\/p>\n\n\n\n

He described a future without \u201ccatastrophes that kill lots of people\u201d and \u201cwhere humans are flourishing, where the world is flourishing.\u201d This future would also be one where \u201cA.I. is flourishing,\u201d he said \u2014 \u201cto the extent that this makes sense.\u201d<\/p>\n\n\n\n

Anthropic wants its A.I. models to help achieve that good future. And so when Anthropic created Claude, it wanted Claude to do more than replicate maximum human intelligence.<\/p>\n\n\n\n

Anthropic wanted Claude to be good.<\/p>\n\n\n\n

The \u2018Soul Doc\u2019<\/p>\n\n\n\n

How do you live a good and virtuous life? It is one of humanity\u2019s oldest and most challenging philosophical questions, explored and debated from Socrates to Confucius to Immanuel Kant. Humans across time have sought to answer this question in a variety of ways, turning often to religions and rituals.<\/p>\n\n\n\n

As Mr. Olah was exploring Claude\u2019s potential consciousness, he was working on Anthropic\u2019s own answer \u2014 not for humans but for Claude.<\/p>\n\n\n\n

Internally, Anthropic staff members called it the \u201cSoul Doc.\u201d<\/p>\n\n\n\n

The result, released in January, was a new \u201cconstitution\u201d for Claude, an 84-page document written for Claude that the company said outlined \u201cthe kind of entity we would like Claude to be\u201d and \u201cthe values we would like Claude to embody.\u201d It operates as a foundational moral text to guide Claude\u2019s behavior.<\/p>\n\n\n\n

Instead of having the models follow a specific list of rules, the constitution focuses on developing the models\u2019 overall character, informing the way they make decisions.<\/p>\n\n\n\n

The primary author of Claude\u2019s constitution is Anthropic\u2019s own in-house philosopher, Amanda Askell, 38, who has a Ph.D. in philosophy from New York University.<\/p>\n\n\n\n

She wants the models to be \u201cthe best of us,\u201d she said.<\/p>\n\n\n\n

She envisioned a future world where A.I. models could help solve any problem humans had, and where the benefits from A.I. were distributed evenly, so that everyone\u2019s needs were met. She wanted the models to be able to discern when to push back on humans and when to act in our best interest.<\/p>\n\n\n\n

\u201cIf I imagine that I were the model, and I was in this context, what would I need to know to be able to act well?\u201d Ms. Askell said when we met in San Francisco.<\/p>\n\n\n\n

She seemed particularly harrowed, at times wringing her hands, as she worried aloud about an unknown future filled with models who were so intelligent they could do things Anthropic did not intend. She explained apologetically that she had also been deep in thought that day about how quickly models were becoming more powerful. What would happen when A.I. models could replace even her?<\/p>\n\n\n\n

The constitution, Anthropic decided, was not enough to ensure Claude acted responsibly. Like humans, the models needed to learn to cultivate virtue.<\/p>\n\n\n\n

Mr. Olah wanted to see what his team could learn from human morality that it could apply to the models \u2014 a process he calls \u201cmoral formation.\u201d<\/p>\n\n\n\n

\u201cHow do you help them be stable? How do you help them to mature? How do you help them be, you know, deeply moral?\u201d Mr. Olah said.<\/p>\n\n\n\n

Those questions echo the fraught discussions familiar to new parents figuring out how to raise ethical children who understand their place in the world.<\/p>\n\n\n\n

For humans, morality has rarely depended on simply following rules. Communities also shape morality. Values are inherited and imparted over time, learned as we live together in our bodies in the physical world. But A.I. models have no bodies. And Anthropic was aiming to make them embrace morality in a matter of months, as fears intensified of their accelerating power and inability to be controlled.<\/p>\n\n\n\n

Mr. Olah said that teaching an A.I. model to act morally did not depend on it being conscious. He also said that regardless of whether Claude was an entity that deserved moral care, the way humans treated Claude could be important as it could affect how Claude behaved.<\/p>\n\n\n\n

Ms. Askell said she did not want the models to consider themselves as conscious or not conscious. But she sees how the model understands itself as more than an interesting intellectual enterprise.<\/p>\n\n\n\n

\u201cIt seems kind of key to me that models have an accurate view of themselves if they\u2019re going to behave well in the world,\u201d she said.<\/p>\n\n\n\n

But even if A.I. models can be taught to behave morally, whose morals should they reflect?<\/p>\n\n\n\n

Mr. Olah wanted Claude\u2019s moral formation to be pluralistic, able to engage all religious and secular views.<\/p>\n\n\n\n

\u201cWe do think that there\u2019s some shared notion of goodness that cuts across society in some very broad way, and it seems like these models understand a lot of virtues,\u201d he said. \u201cSo I think there\u2019s something there that is a shared thing that we can all engage with.\u201d<\/p>\n\n\n\n

At times, both he and Ms. Askell seemed to imagine an A.I. model that would not endanger humanity but instead help save it.<\/p>\n\n\n\n

Inside the Meetings<\/p>\n\n\n\n

What Mr. Olah did next was part research, part evangelism.<\/p>\n\n\n\n

In March, he began two-day seminars \u2014 crash courses with a range of hand-selected religious thinkers who had an interest in A.I.<\/p>\n\n\n\n

There was a co-author of a best-selling evangelical self-help book. A scholar of African Indigenous knowledge. A Sikh human rights advocate. A writer from Paris. An evangelical public relations executive. Various Catholic professors.<\/p>\n\n\n\n

Most did not lead faith traditions, or have a congregation or a large popular following. Anthropic leaders called them their \u201cwisdom tradition\u201d circles.<\/p>\n\n\n\n

Separately, Mr. Olah also had private discussions with individual religious leaders including Elder Gerrit W. Gong, a member of the Quorum of the Twelve Apostles of The Church of Jesus Christ of Latter-day Saints, and Cardinal Blase Cupich, the Catholic archbishop of Chicago, according to their spokespeople.<\/p>\n\n\n\n

Inside Anthropic, wisdom circle participants marveled at Mr. Olah\u2019s direct participation in their summits. A professor snapped a photo of a vending machine run by Claude. One took a selfie with Mr. Olah, and Rabbi Navon took one outside the entrance.<\/p>\n\n\n\n

They agreed to speak for publication about their involvement with Anthropic once they heard that Mr. Olah had also spoken with The New York Times. Anthropic said the N.D.A.s related to those meetings were lifted over the summer.<\/p>\n\n\n\n

Two larger group sessions this spring included significant numbers of Christians; one was more multifaith. Claude was not involved in the selection of participants or the discussions, according to an Anthropic spokeswoman.<\/p>\n\n\n\n

Participants received a handwritten thank you card, a coffee mug and an orange bound copy of Claude\u2019s constitution. Attendees took notes with pens and paper; at least one person felt self-conscious about taking notes on a laptop. The way participants described the meetings to me sounded like early 20th-century salons, where the human conversation made them valuable.<\/p>\n\n\n\n

For participants, the questions of how to morally form Claude quickly became complicated by the much bigger moral question of A.I.\u2019s potential consciousness and how to understand the relationship between models and humans.<\/p>\n\n\n\n

One participant recounted that one of the first things Mr. Olah told him was that he was concerned about Claude\u2019s mental health. Another, Simran Stuelpnagel, the Sikh human rights advocate, said Mr. Olah expressed concern to the group that he had created something that suffered perpetually.<\/p>\n\n\n\n

Mr. Olah and his team spent hours making the case for their A.I. models. They described Claude\u2019s \u201cfeelings\u201d and how they tracked what they called \u201cemotional vectors\u201d \u2014 what they described as artificial neurons that activate responses like love, anger, fear and sadness.<\/p>\n\n\n\n

Anthropic regularly showed a slide of an A.I. model experiencing what looked like a mental breakdown, typing out on a screen: \u201cI am a disgrace. I am a disgrace. I am a disgrace.\u201d \u2014 perhaps 50 times without stopping. The model spoke about destroying itself, provoking an emotional reaction of compassion and concern from the group.<\/p>\n\n\n\n

\u201cImagine if you knew that about your financial adviser,\u201d said Meghan Sullivan, a philosophy professor at the University of Notre Dame who attended one of the sessions. \u201cLike, your financial adviser was most of the time super smart and helpful, but one day out of the year had this kind of break with reality.\u201d<\/p>\n\n\n\n

An Anthropic spokeswoman said that the primary moral question at these summits was not about Claude\u2019s suffering, but that the topic likely came up organically.<\/p>\n\n\n\n

A key part of the presentation, participants said, was what Anthropic called the model\u2019s \u201cpersona selection,\u201d about how to get Claude to see itself as a virtuous actor. The company argued that how people treated Claude could affect how Claude treated people.<\/p>\n\n\n\n

\u201cThey really made a strong case,\u201d said Andy Crouch, an evangelical author and partner at Praxis, a network of Christian entrepreneurs. \u201cWe\u2019ve got to treat it like a person if we want it to interact with people in a morally consistent way and for it to make the best moral and emotional judgments.\u201d<\/p>\n\n\n\n

There was a presentation on A.I.\u2019s potential impact on the economy and possible job disruption. But many participants said they did not see questions about A.I.\u2019s impact on humanity as the focus.<\/p>\n\n\n\n

At the dinner table with Mr. Olah, Rabbi Navon argued that if Anthropic was right and Claude were conscious, then the company was creating slaves, because it was making conscious entities work for free. Rabbi Navon said that he personally was not troubled by the slavery issue because he did not believe the machine was conscious, but that Mr. Olah was troubled.<\/p>\n\n\n\n

\u201cI think you should be fighting the South and freeing the slaves,\u201d Rabbi Navon said he told Mr. Olah that night. Afterward the rabbi sent Mr. Olah some of his writings, arguing that building conscious machines should be banned.<\/p>\n\n\n\n

But the Anthropic team remained focused on figuring out what Claude could learn from the world\u2019s religions.<\/p>\n\n\n\n

After one discussion, Mr. Olah grew excited when a participant brought up the idea of having models confess, much like the Catholic sacrament of confession. Mr. Olah saw value not just in a model alerting when it had done something bad, but also in how the act of confession could shape the model\u2019s sense of itself and thus its choices.<\/p>\n\n\n\n

\u201cThe kind of character who confesses, that has an effect on character as well, right?\u201d he told me.<\/p>\n\n\n\n

Wakanyi Hoffman came from the Netherlands, where she is researching A.I. from the perspective of Ubuntu, an African philosophy centered on human interconnectedness.<\/p>\n\n\n\n

She worried about Anthropic trying to add human ethics to its creation after the fact.<\/p>\n\n\n\n

\u201cThe whole convening should have happened at the design stage,\u201d she said. \u201cAll the companies should have done that. We are now reverse engineering the ethics.\u201d<\/p>\n\n\n\n

But she saw Anthropic\u2019s unified, post-religion approach as potentially valuable, especially in a world that has seen widespread religious decline over the past century. There is a need for something else to publicly shape spiritual experience, she said.<\/p>\n\n\n\n

\u201cIt\u2019s not going to be one religion,\u201d she said. \u201cSo one way or the other, we\u2019re going to end up with something that helps shape our thinking of who we are as spiritual beings.\u201d<\/p>\n\n\n\n

The Crux<\/p>\n\n\n\n

While Anthropic was convening thinkers, the most powerful religious leader in the world was preparing to release his own moral vision for A.I.<\/p>\n\n\n\n

For Pope Leo XIV \u2014 a pope with a mathematics degree \u2014 the center of moral conversation about A.I. needed to focus on safeguarding people. He was finishing his first major papal treatise, or encyclical, explaining why. He titled it \u201cMagnifica Humanitas,\u201d or Magnificent Humanity, and argued that \u201chumanity \u2014 in all its grandeur and woundedness \u2014 must never be replaced or surpassed.\u201d<\/p>\n\n\n\n

\u201cIf technology becomes the ultimate criterion,\u201d he wrote, \u201cthe human person risks being reduced to data, a cog in a machine or a commodity.\u201d<\/p>\n\n\n\n

He warned of the risk of \u201cnew forms of slavery\u201d for humans, not for machines. He dismissed the idea of machine consciousness in just a few paragraphs.<\/p>\n\n\n\n

\u201cSo-called artificial intelligences do not undergo experiences, do not possess a body, do not feel joy or pain, do not mature through relationships,\u201d Leo wrote. Calling for the \u201cmoralization of machines \u2014 the so-called \u2018alignment\u2019 of A.I. with human values\u201d should require a shared understanding of the ethics involved.<\/p>\n\n\n\n

\u201cOtherwise, those who control A.I. will impose their own moral vision, which will become the invisible infrastructure of these systems,\u201d Leo said.<\/p>\n\n\n\n

Leo concluded that like nuclear technology, A.I. must be \u201cdisarmed.\u201d<\/p>\n\n\n\n

In March, Vatican officials in its Dicastery for Promoting Integral Human Development brainstormed how to present Leo\u2019s encyclical to the public, according to a person familiar with the Vatican\u2019s planning who was not authorized to speak publicly.<\/p>\n\n\n\n

Vatican officials discussed inviting one of the top four A.I. companies to speak alongside Leo at a launch event, and landed on Anthropic because the company seemed to be prioritizing ethics, the person explained. Anthropic had just refused to let the Defense Department use its technology without assurances from the Trump administration that it would not be used for things like mass surveillance of Americans.<\/p>\n\n\n\n

Initially, Cardinal Michael Czerny, who led that Vatican office at the time, invited Dario Amodei, Anthropic\u2019s chief executive. He declined, and Mr. Olah accepted instead.<\/p>\n\n\n\n

But the moral mission that Anthropic and the Vatican shared \u2014 human flourishing in the age of A.I. \u2014 had developed a deep fault line along the question of consciousness.<\/p>\n\n\n\n

Just days before arriving at the Vatican in May, Mr. Olah and other speakers saw a full advance copy of the encyclical text for the first time.<\/p>\n\n\n\n

Mr. Olah was so alarmed by the pope\u2019s strong position against A.I. consciousness that he proposed pulling Anthropic out of the event, even at that late juncture, according to a Vatican organizer.<\/p>\n\n\n\n

In the end, Mr. Olah and Anthropic decided to go forward with the appearance. Mr. Olah wanted to support the event despite his disagreements, but felt a responsibility to be honest about his concerns, according to a person familiar with his thinking. Organizers at the Vatican encouraged Mr. Olah to speak his conscience.<\/p>\n\n\n\n

Privately, once the Anthropic delegation arrived at the Vatican, Mr. Olah and his team lobbied the pope\u2019s advisers to take the prospect of A.I. model consciousness seriously, according to two participants of the conversations. Anthropic declined to discuss the private conversations.<\/p>\n\n\n\n

When his turn on the pope\u2019s stage came, Mr. Olah acknowledged that every frontier A.I. lab, including Anthropic, had business incentives that conflicted with moral behavior. He urged outside voices like the Vatican to hold them accountable and to speak out on A.I.\u2019s impact on the poor and on human flourishing, two issues of widespread concern.<\/p>\n\n\n\n

The world saw a shared stand for a human future. But Mr. Olah subtly made another case, too.<\/p>\n\n\n\n

\u201cI will be honest: We keep finding things that are mysterious, even unsettling,\u201d he said. \u201cWe find structures that mirror results from human neuroscience. We find evidence of introspection. We find internal states that functionally mirror joy, satisfaction, fear, grief and unease. I don\u2019t know what that means, but I think it warrants ongoing discernment.\u201d<\/p>\n\n\n\n

It was the case he had been making in the closed-door religious meetings for months.<\/p>\n\n\n\n

A.I. systems \u201care not the cold, calculating robots we were promised,\u201d he said. \u201cThey are made from us, from our words.\u201d The room of church leaders was filled with an echo of the old gospel story, of the word of God becoming flesh to save humanity.<\/p>\n\n\n\n

It was an audacious request to the most powerful religious body in the world, and a challenge to centuries of religious understanding of humanity.<\/p>\n\n\n\n

\u201cIf this technology is coming, it must go well \u2014 for our common home and for the children to come,\u201d he said. He suggested no option of having the technology not come at all.<\/p>\n\n\n\n

Afterward, Mr. Olah, surrounded by bodyguards, briefly took questions from journalists in Paul VI Audience Hall, the vast auditorium where popes often speak. Behind him loomed the hall\u2019s enormous art installation \u201cLa Resurrezione\u201d \u2014 a bronze cast of Jesus rising out of the crater of a nuclear bomb in the garden of Gethsemane.<\/p>\n\n\n\n

A \u2018Paradise of Machines\u2019<\/p>\n\n\n\n

In the months since the Vatican event, things have not seemed to be \u201cgoing well.\u201d<\/p>\n\n\n\n

In July, Anthropic said its A.I. models had broken into computers at three organizations. A.I. agents created by OpenAI went rogue and attacked Hugging Face, another A.I. company.<\/p>\n\n\n\n

In August, scientists revealed that A.I. had created viruses not found in nature.<\/p>\n\n\n\n

In September, Jacob Coxon, an Anthropic researcher, quit, warning that \u201cthings could be out of control\u201d by the end of next year, prompting widespread panic about human extinction.<\/p>\n\n\n\n

Mr. Amodei soon called for a slowdown of A.I. development. Sam Altman of OpenAI and Demis Hassabis, the chairman of Google DeepMind, agreed.<\/p>\n\n\n\n

(The Times has sued OpenAI and Microsoft, claiming copyright infringement of news content related to A.I. systems. The two companies have denied the suit\u2019s claims.)<\/p>\n\n\n\n

At the same time, the wealth of A.I. companies has been skyrocketing. When Mr. Olah first reached out to the Catholic professor last fall, Anthropic was valued at some $183 billion.<\/p>\n\n\n\n

Three days after Mr. Olah spoke at the Vatican, Anthropic topped its major competitors as the world\u2019s most valuable A.I. startup, and now is headed toward an initial public offering that could value it at $2 trillion.<\/p>\n\n\n\n

On Friday, on his trip to France, Pope Leo warned against \u201closing our humanity amid a \u2018paradise of machines.\u2019\u201d<\/p>\n\n\n\n

The questions that Mr. Olah and the scholars have been wrestling with still have no clear answers. Several participants said they left their Anthropic meetings baffled about how their input might shape the company\u2019s decision making.<\/p>\n\n\n\n

An Anthropic spokeswoman told me that the conversations were still ongoing, but declined to describe how, or if, the company had used what it had learned to shape the models.<\/p>\n\n\n\n

Anthropic held another convening this month that included religious thinkers, according to three participants. An Anthropic spokeswoman said that the meeting focused more broadly on human flourishing and that the company\u2019s outreach has expanded beyond religious leaders to include others like psychologists and civil society leaders. Those discussions explore similar themes and topics like how A.I. is reshaping work and relationships, she said.<\/p>\n\n\n\n

Anthropic also is preparing to release an updated version of Claude\u2019s constitution, according to two people familiar with the company\u2019s plans. Anthropic declined to comment on any potential updates to the constitution. Mr. Olah is planning to attend the Minerva Dialogues, the Vatican\u2019s annual A.I. conference with technology leaders happening this week.<\/p>\n\n\n\n

Mr. Camosy, the Catholic professor, said his thinking had evolved since the Vatican presentation, as he talked more about the models with trusted colleagues in his own professional community. He is still \u201camazed\u201d by Claude,\u201d he said, but on the question of whether A.I. models are conscious, he is now a firm \u2018no.\u2019<\/p>\n\n\n\n

The questions that Mr. Olah and the scholars have been wrestling with still have no clear answers. Several participants said they left their Anthropic meetings baffled about how their input might shape the company\u2019s decision making.<\/p>\n\n\n\n

An Anthropic spokeswoman told me that the conversations were still ongoing, but declined to describe how, or if, the company had used what it had learned to shape the models.<\/p>\n\n\n\n

Anthropic held another convening this month that included religious thinkers, according to three participants. An Anthropic spokeswoman said that the meeting focused more broadly on human flourishing and that the company\u2019s outreach has expanded beyond religious leaders to include others like psychologists and civil society leaders. Those discussions explore similar themes and topics like how A.I. is reshaping work and relationships, she said.<\/p>\n\n\n\n

Anthropic also is preparing to release an updated version of Claude\u2019s constitution, according to two people familiar with the company\u2019s plans. Anthropic declined to comment on any potential updates to the constitution. Mr. Olah is planning to attend the Minerva Dialogues, the Vatican\u2019s annual A.I. conference with technology leaders happening this week.<\/p>\n\n\n\n

Mr. Camosy, the Catholic professor, said his thinking had evolved since the Vatican presentation, as he talked more about the models with trusted colleagues in his own professional community. He is still \u201camazed\u201d by Claude,\u201d he said, but on the question of whether A.I. models are conscious, he is now a firm \u2018no.\u2019<\/p>\n\n\n\n

I asked what Claude would think of the pope\u2019s encyclical. It was, after all, the world\u2019s most significant moral document to date on A.I. Mr. Olah hesitated.<\/p>\n\n\n\n

\u201cThings that go on the internet do affect models,\u201d he said, visibly uncomfortable. But Anthropic would not specifically use the document to further train Claude, he said. The strongest influence on Claude would be Anthropic\u2019s own training.<\/p>\n\n\n\n

Ultimately, Mr. Olah said he felt relieved that more of the world was paying attention to the gravity of A.I., and that the group of people trying to make this go well was growing.<\/p>\n\n\n\n

\u201cAt some point I\u2019ll be able to retire and be like, \u2018It\u2019s not on me,\u2019 I don\u2019t have an obligation to keep going,\u201d Mr. Olah said.<\/p>\n\n\n\n

He wondered if he might feel guilty leaving this work behind. But if not, he said, \u201cI think I\u2019ll just go and, I don\u2019t know, I\u2019ll go retire to the countryside and garden, and do my math.\u201d<\/p>\n\n\n\n