The arrangement implements METR's vision for embedded assessments, which aim to provide outside evidence on whether AI developers maintain control over agents as they gain the ability to perform recursive self improvement. Anthropic is establishing a 3 tier evaluator system where top tier organizations obtain high level internal access and independent publishing rights, while other groups, such as SecureBio, must obtain company approval before releasing reports.
