HiPHI:大规模高精度人体运动与物体交互基准数据集
HiPHI: A Large-Scale Benchmark for High-Precision Human Motion and Object Interaction
HiPHI 是一个 617.5 小时的全身体人体运动数据集,由光学动捕以亚毫米精度采集,其中包含 245.7 小时带同步物体轨迹与网格的人-物交互数据,并用语言学框架 FrameNet 组织动作覆盖范围。该白皮书同时提出衡量动作多样性与交互 grounding 的基准套件,并报告了在该数据集上训练、部署到实体 Unitree G1 人形机器人上的策略结果。
Download this complimentary White Paper today!
This White Paper gives robotics researchers and engineers an overview of a new large-scale motion capture dataset built to close the data gap limiting humanoid robot learning. It also shows how policies trained on the dataset transfer to a real humanoid robot.
What you will learn about:
- Why humanoid robot learning, a central problem in embodied AI and Physical AI, needs data that internet video and existing motion capture datasets cannot provide.
- How FrameNet, a linguistic framework for human action, can guide motion capture collection to systematically cover a broad range of whole-body motion.
- Why synchronized object trajectories and meshes make human-object interaction data useful for teaching robots real-world tasks such as carrying, pushing, and pulling.
- How reinforcement learning policies trained on this motion capture data improve with scale, and how sim-to-real transfer carries them onto a physical humanoid robot.
Click ‘LOOK INSIDE’ to Download Now.
IEEE Spectrum and Wiley are proud to bring you this White Paper, sponsored by Noitom Robotics
More Information
Humanoid robots must learn to balance, move, and interact with objects across an enormous range of situations, but the data available for this training has clear limits. Internet video shows diverse behavior but cannot capture precise physical states. Laboratory motion capture systems record accurate movement but usually cover only a narrow set of actions. This white paper examines HiPHI, a 617.5-hour whole-body human motion dataset captured with optical motion capture at sub-millimeter accuracy. It includes 245.7 hours of human-object interaction with synchronized object trajectories and meshes, and organizes coverage using FrameNet, a linguistic framework for human action. The paper also introduces a benchmark suite for measuring motion diversity and interaction grounding, and reports results from policies trained on the dataset and deployed on a physical Unitree G1 humanoid robot.
来源:IEEE Spectrum · AI · content.knowledgehub.wiley.com

