Australia to mandate frontier AI safety rules with new regulator

Australia will require frontier AI companies to meet mandatory safety and security standards, backed by a new regulator empowered to impose significant penalties. A joint ministerial release dated 10 November 2026 sets out the proposed protections under planned Australian AI Standards legislation, with further consultation to follow before the bill is published.

The requirements would apply to all frontier AI companies wishing to operate in Australia. The government defines frontier AI as "the most sophisticated models at the cutting edge of current technological capability."

Who would enforce the protections?

The Albanese government proposes a targeted AI safety regulator. The joint release states: "The Government will propose these protections be enforced by a new targeted regulator for AI safety, which will work with the Australian AI Safety Institute to provide technical expertise and oversight as global standards evolve."

The regulator "would be able to enforce significant penalties for AI companies that fail to comply with mandatory obligations that will help keep Australia safe," according to the release. Separately, the government is considering criminal law changes to address serious misconduct by frontier AI companies. The Australian AI Safety Institute was announced in November 2025 and funded with A$29.9 million under the National AI Plan.

What would frontier AI companies have to do?

The government lists six planned requirements for affected companies:

• Maintain security controls across all stages of development and deployment.
• Identify and manage serious risks associated with their models.
• Allow independent evaluation of their models.
• Promptly notify the Australian government of incidents.
• Maintain and publish safety and security frameworks to support governance, risk management and transparency.
• Respond to updated standards and rules as technologies change.

The government says these measures would provide "earlier warning of emerging risks from rogue AI agents" and enable "faster, coordinated action when serious AI incidents occur." The protections align with recommendations in an interim report by the Joint Select Committee on Artificial Intelligence, which also called for mandatory reporting of misaligned AI behaviour and cyber incidents, plus closer engagement with international counterparts and frontier AI developers on shared safety and accountability expectations.

How does the proposal fit the wider AI programme?

The release places the protections under the government's AI in Australia's Interests agenda. The planned legislation covers other policy areas, including rules requiring large data centres to pay for their own new power supply and grid connection costs, and protections for Australian artists and media against AI training on their work without their control. The earlier AI in Australia's Interests release also established an Office of AI within the Department of the Prime Minister and Cabinet, and referred to National Cabinet consideration in August with legislation early the following year. The government says it announced its safety approach ahead of international talks on AI development and investment.

Prime Minister Anthony Albanese said the agenda aims to "provide Australians confidence that frontier AI companies are taking steps to improve safety and security, and provide certainty for investors." He also called Australia a first mover in this space. Home Affairs and Cyber Security Minister Tony Burke said: "Those who want to cause us harm have access to the latest technology." He called for "clear guardrails to protect Australians."

Tim Ayres, Minister for Industry and Innovation and Minister for Science, said the protections would build on the National AI Plan. That plan was released on 2 December 2025 and dropped an earlier proposal for mandatory guardrails on high-risk AI. Ayres said the plan "put safety at the core of the Government's AI agenda – capturing the opportunities of AI while keeping Australians safe."