On This Page
Task Repo Guide
Your task repo
Ops grants you access per task; the link is on your HAI task page.
Definitions of every term used here are on the Terminology page.
Conventions
- Only files under
submissions/belong in the PR, plusenvs/tasks/<prompt_id>.dockerfileand.mdif you changed them;hs submitincludes those for you. Your own checks go inverification/armA/andverification/armB/; detailed reasoning goes in grading evidence. No notes.txt or other loose files. - Your task repo is read-only. Fork it, clone your fork, and push with
hs submit --push --pr(see Step 3 and Step 6). - Explain any steering deviation between the arms in the comparison comments, citing the turns.
- A rerun keeps the earlier run under
submissions/previous-runs/; give the reason when hs asks.
Task types, domains, and interaction modes are on About the Task.