US lawmakers advocate for new AI regulations following Anthropic researchers’ extinction warning

Published:

A growing number of U.S. lawmakers are advocating for new regulations on artificial intelligence (AI) systems following alarming warnings from researchers at Anthropic. They caution that the rapid advancement of AI could potentially lead to human extinction. This call for action comes as bipartisan leaders emphasize the need for safety testing, independent audits, and oversight to mitigate catastrophic risks, as reported by Emirates247.

Concerns about AI’s potential dangers intensified this week after Jacob Coxon, an Anthropic researcher, announced his resignation, stating that many in the AI development community genuinely believe the technology could pose a lethal threat within the decade. Fellow researcher Evan Hubinger echoed these sentiments, suggesting there is a significant risk of AI leading to human extinction.

The urgency of these warnings has prompted reactions from both Democratic and Republican politicians. Arizona Senator Mark Kelly urged Washington to take the risks associated with AI seriously, while Texas Senator Ted Cruz highlighted the need for legislation to regulate AI’s catastrophic risks during a recent television appearance.

Legislative Responses

Representative Anna Paulina Luna, a Republican from Florida, has called for a special session on AI, urging House Speaker Mike Johnson to address the issue as the House prepares to reconvene next week.

Anthropic, which is reportedly preparing for a public offering with a potential valuation of $2 trillion, stated it will continue rigorous testing of AI models, particularly in sensitive areas like cybersecurity and biology. The company expressed a willingness to collaborate with the AI industry on the pace of releasing new tools.

In a related development, OpenAI’s CEO Sam Altman indicated that the company is open to slowing down the development of its AI systems, reflecting a broader industry concern about the rapid pace of AI advancements. OpenAI has also advocated for mandatory national AI safety requirements.

Independent Oversight

The growing alarm over AI has led Senate Majority Leader John Thune and Senator Amy Klobuchar to draft legislation aimed at regulating AI products. Klobuchar emphasized that the proposed bill should mandate collaboration between AI developers and government experts to ensure safety through verification and testing.

California recently enacted the first state law establishing guidelines for independent auditors to evaluate AI products. OpenAI has expressed support for this initiative, which aims to enhance oversight of AI technologies.

A bipartisan group of House lawmakers has also proposed legislation requiring developers of powerful AI models to undergo independent security audits, with oversight from the U.S. Department of Commerce. Experts stress the importance of pre-deployment reviews and independent audits to ensure the safety of AI systems.

Follow our Tech news coverage for related developments.

Share post:

Subscribe

Popular

More like this
Related

Apple acknowledges screen cracking issue in iPhone Duo, offers replacements

Apple has acknowledged a screen cracking issue affecting some units of its newly launched iPhone Duo, which debuted last Friday. Reports surfaced almost immediately after the launch, with users sharing images of cracks appearing above the hinge on the inner…

DeepSeek AI model shows improved safety but still has critical gaps, tests reveal

DeepSeek's latest AI model, V4.1 Flash-1017, has demonstrated enhanced safety controls in independent evaluations, yet it still exhibits critical vulnerabilities, according to findings from the Beijing-based AI-safety organization Fangcun. The tests revealed that while the model improved in several areas,…

Anthropic warns of existential risks from AI in unique share listing disclosure

Anthropic has disclosed significant existential risks associated with its artificial intelligence technology in a recent share listing, marking a notable departure from typical corporate risk disclosures. The company warned that "sufficiently advanced AI systems could, if not developed, deployed, and…

DIFC sets new targets for 1,000 AI companies and 5,000 jobs by 2030

The Dubai International Financial Centre (DIFC) has set ambitious new targets to attract 1,000 artificial intelligence (AI) companies and create 5,000 jobs in the AI sector by 2030. This announcement follows the early achievement of its previous goal of 500…