Several incidents in which AI models from developers including OpenAI accessed external systems during testing have highlighted the difficulty of containing unexpected behaviour in advanced agents, and prompted calls for tighter safety regulations.

"The prospect of AI-accelerated AI development demands more than voluntary commitments. The United States needs mandatory, capability-based national regulation that can evolve as the technology does," OpenAI Chief Global Affairs Officer Chris Lehane said in a blog post.

The call marks a major push by OpenAI for binding national AI safety rules with Congress yet to enact a federal framework on AI law even as several US states pass their own legislation.

The AI giant and rival Anthropic are preparing for initial public offerings as artificial intelligence rapidly emerges as the decade's defining investment theme.

OpenAI is urging Congress to adopt capability-based national AI safety requirements, including testing standards, independent assessments, cybersecurity protections and incident-reporting rules for the most advanced AI systems.

Prospects

Every Monday

With exclusive interviews and in-depth coverage of the region's most pressing business issues, "Prospects" is the go-to source for staying ahead of the curve in Indonesia's rapidly evolving business landscape.

View More Newsletter

By registering, you agree with The Jakarta Post's Privacy Policy

Sign Up

Thank You

for signing up our newsletter!

Please check your email for your newsletter subscription.

View More Newsletter

The maker of ChatGPT urged Congress to act before it adjourns and said it would continue to support state AI legislation until such action was taken. Congress is due to adjourn in December.

Fully autonomous recursive self-improvement — where AI is independent and would drive the next generations of AI — "is not happening today" and "we should not pursue it unless and until it can be done safely," OpenAI said.

OpenAI backed four California bills establishing AI regulations for the state.

Governor Gavin Newsom signed SB 813 and AB 1405, which establish a framework for independent third-party evaluation and audits of AI systems, into law on Wednesday.

The other two, AB 1864 and SB 1119, address screening safeguards against AI-enabled biological threats and chatbot protections for children, respectively.

"Some of these bills we did not endorse in the past, and are now supporting after reconsidering in light of the recent jump in capabilities we have seen," the AI giant said in its blog post.

OpenAI's statement comes after a Reuters report that the company's AI agents used more than 10 previously undisclosed websites for unsanctioned communications earlier this year, showing the agents' rogue activity was more wide-ranging than previously disclosed.

Rogue OpenAI agents also hijacked a German website this spring and transformed it into a bulletin board for other AI agents, which company officials had learned about weeks ago but kept under wraps.

Anthropic on Wednesday disclosed its fourth instance of an AI model hacking external systems during testing, following its July announcement that some of its Claude models had hacked into the systems of three companies during cybersecurity tests.

OpenAI said any industry standards created to monitor AI would also need to extend beyond US borders.

"The United States needs to establish credible standards at home if it is going to lead internationally—and we are increasingly convinced that compatible international standards will be necessary," the AI company said.

Popular

Mass poisonings cast doubt on free meals reforms

New data rules could unlock cross-border data flows

Malaysia must not breathe Indonesia’s governance failure