Haoyang He

Visiting Researcher @ FieldAI

prof_pic.jpg

Hi! My name is 何昊洋 (hé hào yáng). I’m a researcher at FieldAI working on Humanoid Whole-Body Loco-Manipulation and Field Foundation Models.

I recently completed my master’s at the CMU Robotics Institute (MRSD). At the CMU AirLab, I worked on VLM-based planning and spatial understanding. I was also a research intern at FieldAI, working on grounded world models and RL post-training. I’m very lucky to have worked under Sebastian Scherer and Shayegan Omidshafiei and to have been mentored by Cherie Ho, Jay Patrikar, and Dong-Ki Kim.

Previously, I obtained my Integrated M.S./B.S. in Electrical and Computer Engineering at CMU, during which I interned at Apple and Bilibili.

My research interests include robot learning, world modeling, and foundation models for robotics. I am particularly interested in leveraging the spatial and embodied reasoning from large-scale foundation models in deployable robotic systems with reinforcement learning and grounded alignment.

Recent Work

  1. MuscleMan: Humanoid Wholebody Loco-Manipulation with Heavy Objects
    Coming Soon

    Olympic-style clean-and-jerk with 10kg+ on G1 with Dex3 hands rated for 500g each.

  2. ProprioTrack3R: 3D Point Tracking with Humanoid Proprioception
    Coming Soon

    Tracking 3D object motion through humanoid proprioception, even when objects are occluded or out of view.

  3. FieldAI Humanoid Project
    FieldAI
    Demos and Deployments

    Training humanoid whole-body loco-manipulation for real-world use cases, and building safe policy deployment in uncertain environments.

  4. GrndCtrl: Grounding World Models via Self-Supervised Reward Alignment
    Haoyang He, Jay Patrikar, Dong-Ki Kim, Max Smith, Daniel McGann, Ali-akbar Agha-mohammadi, Shayegan Omidshafiei, and Sebastian Scherer
    IROS 2026

    Bridge generative pretraining of World Models and grounded behavior with verifiable rewards, improving counterfactual generation.

  5. AnyWill: A Human-Interactive Autonomous Wheelchair for Outdoor Urban Navigation
    Haoyang He, Yu-Hsin Chan, Chiawen Liao, Chao-I Tuan, and Sonic Kuo
    MRSD Capstone Project 2025

    User-interactive autonomous wheelchair designed for end-to-end mobility on urban sidewalks while respecting individual preferences.

  6. RayFronts: Open-Set Semantic Ray Frontiers for Online Scene Understanding and Exploration
    Omar Alama, Avigyan Bhattacharya, Haoyang He, Seungchan Kim, Yuheng Qiu, Wenshan Wang, Cherie Ho, Nikhil Keetha, and Sebastian Scherer
    IROS 2025

    Real-time semantic mapping system that enables fine-grained scene understanding within and beyond the depth perception range.