Within the autonomous driving community, millimetre-wave frequency-modulated continuous-wave (FMCW) radars are not used to their fullest potential. Classical, hand-designed target detection algorithms are applied in the signal processing chain and the rich contextual information is discarded. This early discarding of information limits what can be applied in algorithms further downstream. In contrast with object detection in camera images, radar has thus been unable to benefit fully from data-driven methods. This work seeks to bridge this gap by providing the community with a diverse, minimally processed FMCW radar dataset that is not only RGB-D (color and depth) aligned but also synchronized with inertial measurement unit (IMU) measurements in the presence of ego-motion. Moreover, having time-synchronized measurements allow for verification, automated or assisted labelling of the radar data, and opens the door for novel methods of fusing the data from a variety of sensors. We present a system that could be built with accessible, off-the-shelf components within a $1000 budget and an accompanying dataset consisting of diverse scenes spanning indoor, urban and highway driving. Finally, we demonstrated the ability to go beyond classical radar object detection with our dataset with a classification accuracy of 85.1% using the low-level radar signals captured by our system, supporting our argument that there is value in retaining the information discarded by current radar pipelines.
Special Issue paper in IEEE Journal of Selected Topics in Signal Processing or preprint version
Our dataset is shared under CC-BY License. A dedicated website for our dataset with further details can be found here.
Unprocessed, raw versions of our dataset can be downloaded from here. Scripts for preprocessing, conversion and temporal alignment as described in the paper are also included.
Since the entire dataset is huge, we’ve made a small, preprocessed, sample available here. [md5sum: b195ff422cc4c979eeb81623899050cb]
To facilitate easy use of our dataset, we’re also releasing an SDK to use our dataset here. This software package is under constant development and may include features and functionality not included in the published paper. We welcome feedback, suggestions and bug reports.
We thank Texas Instruments for sponsoring the radar hardware and their support in this project.