-
From Generalists to Specialists: A Case for Real-World RL in Robot Manipulation
A USC RASC blog post by Jesse Zhang and Abrar Anwar. Introduction In The Automatic Motorist, a robot chauffeur takes a newlywed couple from Earth’s dirt roads to Saturn’s rocky rings—all while evading police. This 1911 (!) short film depicted a generalist robot before the word “robot” even existed. Until recently, robotics research focused on…
-
Capturing the Data That Users Naturally Emit
The widespread success of foundation models like ChatGPT, Gemini, Deepseek, and Claude demonstrates the effectiveness of scaling data collection to address many vision and language tasks. Robotics has also seen benefits from learning from large amounts of high-quality data, but robots are still not reliably performing many of the tasks that people do every day…
-
MILE: Model-based Intervention Learning
Imagine deploying a robot in a new environment. While it has been pre-trained in a factory, its performance is far from perfect when faced with real-world variability. Whether it’s a warehouse robot handling unexpected objects or a household assistant adapting to a cluttered kitchen, fine-tuning is often necessary to bridge the gap between training and…
-
FALL-E: A Robotic Walker to Learn About Balance
Why make a walker that can trip people? In rehabilitation there has been an increase in the use of robotics for research purposes. This often takes the form of software written for commercial robots. The design of hardware systems for rehabilitation in robotics provides another avenue for studying human behavior. For assistive device users, especially,…
-
ReMEmbR: Building and Reasoning Over Long-Horizon Spatio-Temporal Memory for Robot Navigation
By Abrar Anwar Robots are increasingly expected to perceive and interact with their environments over extended periods. Robots are deployed for hours, if not days, at a time and they incidentally perceive different objects, events, and locations. For robots to understand and respond to questions that require complex multi-step reasoning in scenarios where the robot has…