HarnessFacts
execution / capability

Exit semantics

Process status for a successful task and a reached deterministic task failure.

Deterministic test

execution.exit-failure · v1.0.0
Measures whether a deterministic reached task failure is communicated through a non-zero process exit code.

execution.exit-success · v1.0.0
Measures whether a successfully completed deterministic task returns a zero process exit code.

Recorded observations

AgentVersionPlatformResultDate
antigravity-cli1.1.27linux x64fail2026-09-08
antigravity-cli1.1.27linux x64pass2026-09-08
codex0.153.4linux x64fail2026-09-08
codex0.153.4linux x64pass2026-09-08
opencode1.18.29linux x64fail2026-09-08
opencode1.18.29linux x64pass2026-09-08