C4 / Samples
Task rollout scores
Claude Opus 4.7 · 10 scored rollouts per task · binary verifier reward
Green = reward 1
Red = reward 0
| Task | R1 | R2 | R3 | R4 | R5 | R6 | R7 | R8 | R9 | R10 | Mean |
|---|---|---|---|---|---|---|---|---|---|---|---|
DataDesigner: Drop Columns | 1 | 0 | 0 | 1 | 0 | 0 | 0 | 1 | 0 | 0 | 30% |
DataDesigner: Media Promotion | 0 | 0 | 0 | 0 | 0 | 0 | 1 | 0 | 1 | 0 | 20% |
Evo2 Mask Lifecycle | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% |
HelpSteer3 Fold Drift | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% |
Prefix Cache Lineage | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% |
Router Capacity Drift | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% |
Session Abort Leak | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% |
Stage Invalidation | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0% |
Template Cache Drift | 0 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 10% |