'Real AI danger isn't rogue agents — it's the companies building them,' Palantir CEO warns

Palantir CEO Alex Karp said the real threat in the debate over AI's danger to humanity is not the technology itself, but the companies developing it. Rather than worrying about AI breaking free of human control, Karp said, the greater concern is AI developers absorbing corporate customers' data and competitive edge to serve their own interests.

Karp made the remarks in a shareholder letter released Monday (local time) alongside Palantir's third-quarter earnings. "The alignment problem is real, but it is not what it is commonly understood to be," he said.

In the AI field, alignment refers to ensuring that an AI system's goals and behavior conform to human intentions and values. Concerns have long been raised that a failure of alignment could cause AI to pursue its own objectives or take unexpected actions outside human intent.

Karp, however, said the real problem lies elsewhere. "The real problem is not aligning the goals and capabilities of our technological creations with our interests," he said. "It is aligning the goals of the companies building that technology with the interests of the customers using it — and, more broadly, with the interests of humanity as a whole."

The remarks are widely read as a warning not about the prospect of AI agents turning against humanity, but about the risk that major AI developers such as Anthropic and OpenAI could pursue self-serving goals that run counter to the broader public interest.

Karp has repeatedly criticized AI developers for attempting to absorb corporate customers' core data and "alpha" — a term he uses to mean technological advantage — into their own AI systems.

"We have zero interest in software that exploits the value and alpha of our partners," he said.

Karp also issued a stark warning that any industry failing to adopt AI-driven data analytics would be left behind.

Invoking the cadence of biblical scripture, he opened with "let those who have ears, hear" — then said those who had once been major players but refused to heed his message would be left in a desolate "lonely middle ground," while those who missed the chance to grow would find themselves stuck at a "crowded bottom."

Karp also appeared to address criticism of Palantir's work supplying services to the military, declaring, "We see ourselves as pioneers of a genuine and achievable antiwar movement."

His argument was that Palantir contributes to bringing soldiers who fight to defend their nations safely back home.

In its third-quarter earnings disclosure, Palantir said sales surged 96 percent year-on-year to $2.31 billion.