TechRxiv_HoloGCS.pdf (3.65 MB)
HoloGCS : Mixed Reality-based Ground Control Station for Unmanned Aerial Vehicle
preprint
posted on 2022-01-07, 22:42 authored by Daniar Estu WidiyantiDaniar Estu Widiyanti, Krisma AsmoroKrisma Asmoro, Soo Young ShinGround control station (GCS) is a system for controlling and monitoring unmanned aerial vehicle (UAV). In current GCS, the device used are considered as complex environment. This paper proposes a video streaming and speech command control for supporting mixed reality based UAV GCS using Microsoft HoloLens. Video streaming will inform the UAV view and transmit the raw video to the HoloLens, while the HoloLens steers the UAV based on the displayed UAV field of view (FoV). Using the HoloLens Mixed Reality Tool-Kit (MRTK) speech input, UAV speech control from the HoloLens was successfully implemented. Finally, experimental results based on video streaming and speech command calculation of the throughput, round-time trip, latency and speech accuracy tests are discussed to demonstrate the feasibility of the proposed scheme.
Funding
This research was supported by the MSIT(Ministry of Science and ICT), Korea, under the Grand Information Technology Research Center support program (IITP-2021-2020- 0-01612) supervised by the IITP (Institute for Information & communications Technology Planning & Evaluation)
History
Email Address of Submitting Author
daniarestuw@gmail.comSubmitting Author's Institution
Kumoh National Institute of TechnologySubmitting Author's Country
- South Korea