We consider the problem of segmenting and tracking deformable objects in color video with depth (RGBD) data available from commodity sensors such as the Asus Xtion Pro Live or Microsoft Kinect. We frame this problem with very few assumptions—no prior object model, no stationary sensor, and no prior 3-D map—thus making a solution potentially useful for a large number of applications, includi…