TechRxiv
TechRxiv_HoloGCS.pdf (3.65 MB)
Download file

HoloGCS : Mixed Reality-based Ground Control Station for Unmanned Aerial Vehicle

Download (3.65 MB)
preprint
posted on 07.01.2022, 22:42 by Daniar Estu WidiyantiDaniar Estu Widiyanti, Krisma AsmoroKrisma Asmoro, Soo Young Shin
Ground control station (GCS) is a system for controlling and monitoring unmanned aerial vehicle (UAV). In current GCS, the device used are considered as complex environment. This paper proposes a video streaming and speech command control for supporting mixed reality based UAV GCS using Microsoft HoloLens. Video streaming will inform the UAV view and transmit the raw video to the HoloLens, while the HoloLens steers the UAV based on the displayed UAV field of view (FoV). Using the HoloLens Mixed Reality Tool-Kit (MRTK) speech input, UAV speech control from the HoloLens was successfully implemented. Finally, experimental results based on video streaming and speech command calculation of the throughput, round-time trip, latency and speech accuracy tests are discussed to demonstrate the feasibility of the proposed scheme.

Funding

This research was supported by the MSIT(Ministry of Science and ICT), Korea, under the Grand Information Technology Research Center support program (IITP-2021-2020- 0-01612) supervised by the IITP (Institute for Information & communications Technology Planning & Evaluation)

History

Email Address of Submitting Author

daniarestuw@gmail.com

Submitting Author's Institution

Kumoh National Institute of Technology

Submitting Author's Country

South Korea