AIRiskAware
AI Governance Glossary
Governance Concept

What Is AI Safety Institute?

AI Safety Institute is a government-established body that researches, evaluates, and advises on the safety and security risks of advanced AI systems, often testing frontier models and informing policy.

Definition

AI Safety Institute โ€” a government-established body that researches, evaluates, and advises on the safety and security risks of advanced AI systems, often testing frontier models and informing policy.

A wave of these bodies emerged after 2023: the UK's (renamed the AI Security Institute in 2025), the United States' institute, the EU AI Office's scientific work, and an Australian AI Safety Institute confirmed under the 2025 National AI Plan. They generally focus on frontier-model evaluation and systemic risk rather than enforcing rules on ordinary deployers, but their testing and reports increasingly shape what "good" looks like.

Source: Government AI safety/security institutes (UK, US, EU, Australia)

Plain-language explanation

A wave of these bodies emerged after 2023: the UK's (renamed the AI Security Institute in 2025), the United States' institute, the EU AI Office's scientific work, and an Australian AI Safety Institute confirmed under the 2025 National AI Plan. They generally focus on frontier-model evaluation and systemic risk rather than enforcing rules on ordinary deployers, but their testing and reports increasingly shape what "good" looks like.

Primary source: Government AI safety/security institutes (UK, US, EU, Australia)

Related terms

Frontier Model Model Evaluation Systemic Risk (GPAI) Safety Case

See where you stand on AI governance

Take the free 7-question maturity assessment and get a personalised action plan.

Free assessment โ€” 3 minutes โ†’