Task Workflow

Six steps from claiming a task on HAI to submitting it.

Video walkthrough

The whole task end to end. Once your pull request is open, go back to HAI and submit the task there too; the PR alone does not close it.

New to the project? Read About the Task first, especially the rules for your task's interaction mode.

Task Lifecycle Overview

1
Claim a Task on HAI
Copy your task repo link and API key.
2
Install hs
One time. Docker Desktop, git, and one binary.
3
Set Up the Task
Fork the task repo, clone your fork, run hs claim, read the task.
4
Run Arm A and Arm B
hs arm-a, then hs arm-b. Same steering in both.
5
Grade Both Arms
Your own checks, six ratings, behavioral issues, then compare.
6
Submit
hs submit --push --pr after every step; submit the task on HAI once the pull request is open.

The whole task in commands

hs claim               # take the task: key, seed, submission skeleton
hs arm-a               # Arm A, always first
hs submit --push --pr  # push it; repeat after grading A, running B, grading B, and comparing
hs arm-b               # Arm B, after Arm A

Run hs on its own at any point. It tells you the next step.

After you submit

Submission and review is one continuous process, and you drive it.

A reviewer checks your pull request and may send it back with feedback, sometimes more than once. Address every comment promptly, run hs submit --push --pr again.
From your first submission to approval expect up to 2 to 3 days, depending on how many rounds of feedback are needed. A task in good shape can pass in one go.
Once the task is approved you are paid in the next delivery cycle.

Details on the When You Get Paid page.