Top-down semantic map preview
Loading map…
Semantic LiDAR maps from the four robots at both CU-Multi sites. Switch between Main Campus and Kittredge Loop, pick one robot or all of them, and colour points by semantic class or by the robot that observed them. Scans are taken every 10 m along each ground-truth trajectory, downsampled to 0.5 m voxels, then merged and downsampled to 0.5 m again. The axes show each lidar's pose (x red, y green, z blue), replayed in sync about 60× faster than real time. Click a class to hide it.

Overview

During my research, I saw that while multi-robot systems research was advancing quickly, the field had trouble benchmarking algorithms because few datasets capture realistic multi-robot team behavior. Many existing evaluations partitioned single-robot trajectories. That’s useful, but it doesn’t fully represent the collaborative perception that makes multi-robot systems effective.

This motivated me to develop CU-Multi, a dataset designed to give the research community better tools for evaluating multi-robot collaborative perception algorithms.

CU-Multi robot trajectories over the CU Boulder campus, with per-robot maps
The four robots' trajectories across both campus sites, with each robot's individual map.

What CU-Multi offers

Multi-robot collaboration: The dataset has four synchronized robot runs with carefully designed overlap patterns that reflect realistic team operations. This addresses a limitation of existing datasets, where robots typically operate independently.

Full sensor suite: The dataset includes the sensors most commonly used in robotics research:

  • RGB-D cameras for visual perception
  • RTK GPS for precise positioning (especially valuable outdoors)
  • Semantic LiDAR for 3D scene understanding
  • High-quality ground-truth odometry for validation

Large-scale data collection: Data was collected over multiple days at two different outdoor sites on the CU Boulder campus. The varied environments test different aspects of multi-robot algorithms.

Standardized evaluation: A key goal was a benchmark that allows fair comparison across research groups. Controlled overlap patterns and dense semantic annotations give CU-Multi a foundation for evaluating multi-robot collaborative perception algorithms.

Publication

CU-Multi: A Dataset for Multi-Robot Collaborative Perception
Doncey Albin, Daniel McGann, Miles Mena, Annika Thomas, Harel Biggie, Xuefei Sun, Steve McGuire, Jonathan P. How, Christoffer Heckman
Under review