loading page

HoloGCS : Mixed Reality-based Ground Control Station for Unmanned Aerial Vehicle
  • Daniar Estu Widiyanti ,
  • Krisma Asmoro ,
  • Soo Young Shin
Daniar Estu Widiyanti
Kumoh National Institute of Technology

Corresponding Author:[email protected]

Author Profile
Krisma Asmoro
Author Profile
Soo Young Shin
Author Profile

Abstract

Ground control station (GCS) is a system for controlling and monitoring unmanned aerial vehicle (UAV). In current GCS, the device used are considered as complex environment. This paper proposes a video streaming and speech command control for supporting mixed reality based UAV GCS using Microsoft HoloLens. Video streaming will inform the UAV view and transmit the raw video to the HoloLens, while the HoloLens steers the UAV based on the displayed UAV field of view (FoV). Using the HoloLens Mixed Reality Tool-Kit (MRTK) speech input, UAV speech control from the HoloLens was successfully implemented. Finally, experimental results based on video streaming and speech command calculation of the throughput, round-time trip, latency and speech accuracy tests are discussed to demonstrate the feasibility of the proposed scheme.
Mar 2024Published in Virtual Reality volume 28 issue 1. https://doi.org/10.1007/s10055-023-00914-9