TechRxiv
TFW Annotated Thermal Faces in the Wild Dataset.pdf (5.07 MB)
Download file

TFW: Annotated Thermal Faces in the Wild Dataset

Download (5.07 MB)
preprint
posted on 12.05.2022, 19:18 authored by Askat KuzdeuovAskat Kuzdeuov, Dana AubakirovaDana Aubakirova, Darina KoishigarinaDarina Koishigarina, Hüseyin Atakan VarolHüseyin Atakan Varol

Face detection and subsequent localization of facial landmarks are the primary steps in many face applications. Numerous algorithms and benchmark datasets have been introduced to develop robust models for the visible domain. However, varying conditions of illumination still pose challenging problems. In this regard, thermal cameras are employed to address this problem, because they operate on longer wavelengths. However, thermal face and facial landmark detection in the wild is an open research problem because most of the existing thermal datasets were collected in controlled environments. In addition, many of them were not annotated with face bounding boxes and facial landmarks. In this work, we present a thermal face dataset with manually labeled bounding boxes and facial landmarks to address these problems. The dataset contains 9,982 images of 147 subjects collected under controlled and uncontrolled conditions. As a baseline, we trained the YOLOv5 object detection model and its adaptation for face detection, YOLO5Face, on our dataset. In addition to our test set, we evaluated the models on the external RWTH-Aachen thermal face dataset to show the efficacy of our dataset. We have made the dataset, source code, and pre-trained models publicly available at https://github.com/IS2AI/TFW to bolster research in thermal face analysis.

History

Email Address of Submitting Author

askat.kuzdeuov@nu.edu.kz

ORCID of Submitting Author

0000-0001-6169-8252

Submitting Author's Institution

Institute of Smart Systems and Artificial Intelligence, Nazarbayev University

Submitting Author's Country

Kazakhstan