Engineering Research Center of Cyberspace, Yunnan University, Kunming, 650091, China.
School of Software, Yunnan University, Kunming, 650091, China.
Sci Data. 2023 Apr 20;10(1):227. doi: 10.1038/s41597-023-02066-6.
We present the HIT-UAV dataset, a high-altitude infrared thermal dataset for object detection applications on Unmanned Aerial Vehicles (UAVs). The dataset comprises 2,898 infrared thermal images extracted from 43,470 frames in hundreds of videos captured by UAVs in various scenarios, such as schools, parking lots, roads, and playgrounds. Moreover, the HIT-UAV provides essential flight data for each image, including flight altitude, camera perspective, date, and daylight intensity. For each image, we have manually annotated object instances with bounding boxes of two types (oriented and standard) to tackle the challenge of significant overlap of object instances in aerial images. To the best of our knowledge, the HIT-UAV is the first publicly available high-altitude UAV-based infrared thermal dataset for detecting persons and vehicles. We have trained and evaluated well-established object detection algorithms on the HIT-UAV. Our results demonstrate that the detection algorithms perform exceptionally well on the HIT-UAV compared to visual light datasets, since infrared thermal images do not contain significant irrelevant information about objects. We believe that the HIT-UAV will contribute to various UAV-based applications and researches. The dataset is freely available at https://pegasus.ac.cn .
我们提出了 HIT-UAV 数据集，这是一个用于无人机（UAV）上目标检测应用的高空红外热数据集。该数据集由从数百个视频中提取的 43470 帧中的 2898 张红外热图像组成，这些视频是在学校、停车场、道路和操场等各种场景中由 UAV 拍摄的。此外，HIT-UAV 为每张图像提供了必要的飞行数据，包括飞行高度、相机视角、日期和日光强度。对于每张图像，我们都使用边界框（定向和标准）手动注释了对象实例，以解决航空图像中对象实例大量重叠的挑战。据我们所知，HIT-UAV 是第一个可公开获取的用于检测人员和车辆的高空基于无人机的红外热数据集。我们已经在 HIT-UAV 上训练和评估了成熟的目标检测算法。我们的结果表明，与可见光数据集相比，这些检测算法在 HIT-UAV 上的性能非常出色，因为红外热图像不包含关于物体的大量不相关信息。我们相信 HIT-UAV 将为各种基于 UAV 的应用和研究做出贡献。该数据集可在 https://pegasus.ac.cn 免费获取。
