-
Capturing the Data That Users Naturally Emit
The widespread success of foundation models like ChatGPT, Gemini, Deepseek, and Claude demonstrates the effectiveness of scaling data collection to address many vision and language tasks. Robotics has also seen benefits from learning from large amounts of high-quality data, but robots are still not reliably performing many of the tasks that people do every day…
-
MILE: Model-based Intervention Learning
Imagine deploying a robot in a new environment. While it has been pre-trained in a factory, its performance is far from perfect when faced with real-world variability. Whether it’s a warehouse robot handling unexpected objects or a household assistant adapting to a cluttered kitchen, fine-tuning is often necessary to bridge the gap between training and…
-
FALL-E: A Robotic Walker to Learn About Balance
Why make a walker that can trip people? In rehabilitation there has been an increase in the use of robotics for research purposes. This often takes the form of software written for commercial robots. The design of hardware systems for rehabilitation in robotics provides another avenue for studying human behavior. For assistive device users, especially,…
-
ReMEmbR: Building and Reasoning Over Long-Horizon Spatio-Temporal Memory for Robot Navigation
By Abrar Anwar Robots are increasingly expected to perceive and interact with their environments over extended periods. Robots are deployed for hours, if not days, at a time and they incidentally perceive different objects, events, and locations. For robots to understand and respond to questions that require complex multi-step reasoning in scenarios where the robot has…
-
VoxAct-B: Voxel-Based Acting and Stabilizing Policy for Bimanual Manipulation
By I-Chun Arthur Liu Bimanual manipulation is essential for robots to manipulate objects as well as humans. It becomes necessary when objects are too large to be controlled by one hand or when using one hand to stabilize an object makes it easier for the other hand to manipulate it. In this work, we focus…