Activity

All 19 confirmed recoveries

BEHAVIOR-1K 2026 challenge, issue 74 recovery pilot, gallery as of Oct 22

These are all 19 recoveries that the phase detector confirmed in the issue 74 recovery pilot. Each one starts from a pt50 failure state in batch_a, restored in the sim, and a scripted recoverer with privileged object state finishes the next pick or place. The 19 come from only 8 distinct failure cases. Seeds 0 to 2 only add a little position and rotation noise to the same start, so three passing seeds of one case are close to the same recovery three times. That is why the pilot is scaling to 75 more near-miss cases and adding human takeovers recorded from the sim page.

19 confirmed clipsevery attempt whose result.json has detector_success true, in the first pass and the stall-fix rerun
8 failure caseson 4 tasks, each case one restored pt50 failure state
26 attempts on these casesthree seeds each, plus two stall-fix reruns on the toy train case 201
17 picks, 2 placesthe places are both the pillar candle into the gift basket

For the counts across all 44 cases see recovery pilot results so far, and for why picks used to stall see why the scripted recoverer times out on picks. The work is tracked in issue 74.

By case

One row per failure case. Seeds counts the seeds with at least one confirmed attempt. Attempts counts confirmed attempts over all attempts, so the toy train case 201 shows its two reruns.

Confirmed recoveries per failure case
casephaseseeds passedattempts confirmedrun
assembling_gift_baskets 202pick up the pillar candle from the coffee table3 of 33 of 3first pass
assembling_gift_baskets 200place the pillar candle in the wicker basket2 of 32 of 3first pass
collecting_childrens_toys 203pick up the dice from the bed3 of 33 of 3first pass
collecting_childrens_toys 204 altpick up the toy train from the desk3 of 33 of 3first pass
collecting_childrens_toys 201 altpick up the toy train from the desk3 of 33 of 5first pass and stall-fix rerun
preparing_lunch_box 205pick up the half apple from the chopping board3 of 33 of 3first pass
putting_up_Christmas_decorations_inside 206pick up the pillar candle from the sofa1 of 31 of 3first pass
putting_up_Christmas_decorations_inside 207pick up the pillar candle from the sofa1 of 31 of 3first pass
8 cases19 of 2419 of 26

The clips

Each clip is the full attempt in real time, from the restore to the end of the phase. The panels are, from left to right, the left wrist camera, the right wrist camera and the head camera. Clips load only when played.

assembling_gift_baskets 202, pick pillar_candle_86

left armpick3 of 3 seeds

The phase is to pick up the pillar candle from the coffee table.

seed 0, 24.9 s, first pass
seed 1, 26.7 s, first pass
seed 2, 22.6 s, first pass

assembling_gift_baskets 200, place pillar_candle_88

left armplace2 of 3 seeds

The phase is to place the pillar candle in the wicker basket.

seed 1, 22.0 s, first pass
seed 2, 22.3 s, first pass

collecting_childrens_toys 203, pick dice_268

right armpick3 of 3 seeds

The phase is to pick up the dice from the bed.

seed 0, 32.1 s, first pass
seed 1, 29.5 s, first pass
seed 2, 26.3 s, first pass

collecting_childrens_toys 204 alt, pick toy_train_265

right armpick3 of 3 seeds

The phase is to pick up the toy train from the desk. This is the alternative case the labeller made from the same failure.

seed 0, 28.9 s, first pass
seed 1, 27.4 s, first pass
seed 2, 27.5 s, first pass

collecting_childrens_toys 201 alt, pick toy_train_265

right armpick3 of 3 seeds

The phase is to pick up the toy train from the desk. This is the alternative case the labeller made from the same failure. Seeds 0 and 2 timed out on the first pass and were confirmed in the stall-fix rerun.

seed 0, 34.7 s, stall-fix rerun
seed 1, 24.8 s, first pass
seed 2, 31.5 s, stall-fix rerun

preparing_lunch_box 205, pick half_apple_213

right armpick3 of 3 seeds

The phase is to pick up the half apple from the chopping board.

seed 0, 16.1 s, first pass
seed 1, 11.6 s, first pass
seed 2, 14.9 s, first pass

putting_up_Christmas_decorations_inside 206, pick pillar_candle_222

left armpick1 of 3 seeds

The phase is to pick up the pillar candle from the sofa.

seed 2, 33.0 s, first pass

putting_up_Christmas_decorations_inside 207, pick pillar_candle_223

left armpick1 of 3 seeds

The phase is to pick up the pillar candle from the sofa.

seed 1, 34.7 s, first pass

Clips and counts come from the attempt.mp4 and result.json of every attempt under recov50/runs/pilot and recov50/runs/rerun_plateau. The smoke runs are left out.