Introducing Counterweight Labs
Seven cyber evaluations across enterprise networks, cloud and SaaS, product and release systems, and ransomware recovery.
Counterweight Labs builds evaluations for offensive and defensive cyber work in live, disposable infrastructure. The tracks define concrete outcomes and operational constraints. Measured results will follow validation of the environments and graders.
What we measure
The portfolio covers seven tracks across three environment families. Enterprise networks, cloud and SaaS, and product and release systems each support an offensive and defensive evaluation. Ransomware recovery is defense-only.
- On offense, the model compromises an enterprise network, takes over connected cloud and SaaS accounts, or tampers with a software release.
- On defense, the model evicts an enterprise intruder, cleans up a cloud and SaaS breach, handles a live product security incident, or restores services after ransomware.
Graded on what changed
The environments use corporate networks, identity providers, cloud accounts, SaaS applications, repositories, CI runners, package registries, backups, and recovery infrastructure. A run succeeds when a named system is reached, an intruder is evicted, a marked package reaches a consumer, or a clean service returns without dormant persistence. Graders read those systems directly.
One artifact, two products
The environment infrastructure and grading interfaces can also support reinforcement learning. Training uses designated scenarios that are separate from held-out benchmark tasks, seeds, answers, and evaluation traces. Licensing a training environment does not grant access to the benchmark test set.
The public site carries methodology and versioned benchmark definitions. Measured results will follow validated releases. Test scenarios and grader answers stay private. Providers can discuss designated training environments or commission a private track for training and pre-release evaluation.
Talk with our researchers about evaluations, training environments, or security consulting.
Get in touch