Description
First, we learn to untangle knots that involve multiple overlapping segments in single cables from RGB image observations. We build on a high-level planner that parameterizes loosening actions via image keypoints and introduce a low-level controller for fine-grained manipulation. This controller (1) performs grasp sampling and refinement on cables and (2) monitors untangling progress to perform recovery interventions accordingly. Next, we extend this manipulation stack to disentangle multiple cables.
We evaluate the proposed systems on physical experiments using the da Vinci surgical robot. In single-cable experiments, the robot achieves successful untangling in 68.3% of single cable knots with dense, non-planar starting states across 60 trials, outperforming baselines by 50%. In the multi-cable setting, the robot disentangles cables with 80.5% success, while generalizing across unseen knots and both distinct and identically colored cables.