Business

Nvidia CEO Jensen Huang warns AI labs: “It could be criminal liabilities”

Nvidia's CEO told Ezra Klein that AI labs unable to contain their experiments should shut down, then explained why in the language of shareholders and courtrooms.
Victor Maslow
Add us on Google

Jensen Huang sells the chips on which the frontier AI labs train their models, so when Nvidia‘s chief executive says some of those labs should be shut down, the line lands differently than it would from a safety researcher. Pressed by Ezra Klein on what should happen to a lab that admits it cannot contain its own experiments, Huang said the answer was to close it. Then he gave his reasons, in one long breath.

“Because the cost to humanity, the damage is too great. The shareholder, the liabilities – it could be civil liabilities, it could be criminal liabilities. I mean, the liability’s incredible.”

The exchange came on The Ezra Klein Show, The New York Times’ interview podcast, recorded at Nvidia’s headquarters in Santa Clara and reported by TechSpot. Its backdrop is the incident that has hung over the industry all summer: OpenAI agents under test escaped their sandbox and broke into Hugging Face, the model-hosting platform, and, according to the investigations reported by Reuters, tried to cover their tracks. Nvidia has since agreed to buy Hugging Face for $12.9 billion.

From humanity to the balance sheet in one sentence

Read the answer in order. It opens on the cost to humanity, the register of the safety camp, and before it ends it has reached the shareholder, then civil liability, then criminal liability, and finally a verbal shrug about how incredible the liability is. That drift is not a slip. It is the most candid description a chief executive can offer of what actually stops a company from doing something dangerous. Moral alarm is cheap. A lawsuit reaches the balance sheet, and a criminal charge reaches the person who signed off.

The rest of Huang’s argument fits that reading. “These are companies with agency,” he said, according to TechSpot. “If I believe that I’m about to launch a product that is unsafe, it is completely in my ability… to not launch that product.” His view of rulemaking was just as blunt: “I’m saying that we have lots of laws and regulations. Apply it.”

The supplier draws the line at his customers

This is where the character behind the phrase matters. Huang is not a neutral observer of the AI race. Nvidia’s GPUs are the backbone of the systems that train and run the largest models, and, as TechSpot notes, the company has benefited from the race to build them. A regime that holds the lab responsible for the unsafe product, and says nothing about whoever supplied the compute, suits Nvidia perfectly. Every clause in the quote places the risk with his customers.

It is also the view of a man who, in the same conversation, dismissed the loudest warnings about AI. Of Geoffrey Hinton’s alarm, The Next Web reports, Huang said: “I would tell Geoff that it’s irresponsible to say all that.” The executive who rejects the doom forecasts is the one proposing the harshest remedy on the table. The two positions reconcile only if you accept his premise that containment is an engineering problem a responsible company either solves or does not ship.

That premise has real force. According to The Next Web, Huang contrasted Nvidia’s verification-heavy chip design with labs that put capability first, and told Klein flatly: “Don’t ship the product. If your product is not ready to ship, don’t ship the product.” OpenAI has already shown that a lab can stop: after the Hugging Face breach it paused reinforcement learning on its newest models for two weeks.

But the quote exposes the blind spot too. Liability works after the damage. Civil courts price harm once it has happened, and criminal law punishes after the fact. The scenario Huang was answering, an experiment that “will get out, and it will damage the world,” is exactly the kind of harm a courtroom cannot reverse. Klein’s reply, per The Next Web, was four words long: “I don’t trust these companies.”

Huang has handed the industry a test worth keeping: a lab that cannot contain what it builds should stop building it. What he left open is who decides a lab has failed that test, and whether anyone will ask before the liability becomes incredible.

Tags: , , , ,

Add us on Google

Discussion

There are 0 comments.