Plug Insertion with SmolVLA
Our first policy output end-effector deltas and kept taking the plug to the wrong place, because at 30 Hz most of each delta is teleop noise, so we were basically training on the noise.
Switching to absolute joint targets fixed that, and we ran it with real-time chunking so the arm keeps moving while the next chunk is computed. The harder problem was that demos of clean successes only cover states close to the good trajectories, so once the policy drifted off that manifold it had never seen anything like where it was and the errors compounded. We started recording demos where we went slightly wrong on purpose and then fixed it, and those went into the final policy. Looking back, DAgger-style interventions would probably have done a lot more, because you'd be correcting the mistakes the policy actually makes rather than the ones we guessed it would.