harb/scripts/harb-evaluator
johba 46e928ea97 fix: Red-team schema should add candidate_commit field (#1066) (#1075)
Fixes #1066

## Changes
Done. Here's what was changed:

**`evidence/README.md`**
- Added `"candidate_commit": "abc1234"` to the red-team schema JSON example
- Added `candidate_commit | string | Git commit SHA of the optimizer under test` row to the field table

**`scripts/harb-evaluator/red-team.sh`**
- Captures `CANDIDATE_COMMIT` from `git rev-parse HEAD` at startup (alongside existing `CANDIDATE_NAME`/`OPTIMIZER_PROFILE`)
- Added a new step (9a-pre) that writes `evidence/red-team/YYYY-MM-DD.json` at the end of each run, including `candidate_commit` plus all other schema fields (`candidate`, `optimizer_profile`, `lm_eth_before`, `lm_eth_after`, `eth_extracted`, `floor_held`, `verdict`, `attacks`)

Co-authored-by: openhands <openhands@all-hands.dev>
Reviewed-on: https://codeberg.org/johba/harb/pulls/1075
Reviewed-by: Disinto_bot <disinto_bot@noreply.codeberg.org>
2026-03-21 13:47:13 +01:00
..
helpers fix: Stale JSDoc in navigateToStakePage refers to '/stake' not '/app/stake' (#509) 2026-03-13 10:37:14 +00:00
scenarios/passive-confidence fix: correct buyKrk call sites for new opts param, add eslint-disable for polling loop 2026-03-05 05:53:19 +00:00
bootstrap-light.sh fix: bootstrap-light.sh missing validation guards for KRK, STAKE, OPT (#872) 2026-03-17 23:37:01 +00:00
evaluate.sh fix: formula scripts broken on evolution box (#1006, #1007, #1008) 2026-03-19 14:09:38 +00:00
export-attacks.py fix: also update red-team.sh addresses to Base Sepolia (#873) 2026-03-17 23:05:26 +00:00
holdout.config.ts fix: address PR #438 review findings 2026-03-04 08:20:11 +00:00
promote-attacks.sh fix: address promote-attacks review feedback (#974) 2026-03-19 07:48:24 +00:00
red-team-program.md fix: red-team-program.md taxRate naming inconsistency (pre-existing) (#835) 2026-03-16 09:46:55 +00:00
red-team-sweep.sh fix: evaluate.sh detects docker compose vs docker-compose binary; red-team-sweep.sh does not (#964) 2026-03-18 18:57:36 +00:00
red-team.sh fix: Red-team schema should add candidate_commit field (#1066) (#1075) 2026-03-21 13:47:13 +01:00