CPM Olympics: Development of Scenarios for Benchmarking in Networked and Autonomous Driving

The Cyber-Physical Mobility (CPM) Remote project provides web-based access to a simulation service and the CPM Lab itself, which is provided by the Chair of Embedded Software at RWTH Aachen University. With this approach, users no longer need special hardware, software, or physical access to use the simulation tool and the CPM Lab. This reduces the effort required to participate in research compared to the conventional simulation and lab setup. CPM Remote already offers uniform hardware by outsourcing the simulation to our Chair’s servers and uniform software through the computer simulation of the CPM Lab. This paper proposes extending the CPM Remote framework by a set of formalized problems and a unified evaluation method. These benchmarks detect whether the vehicles have successfully passed through the scenario and evaluate the quality of the driven trajectories. We compiled the extracted scenarios into an event, the CPM Olympics. Thus, CPM Remote now has a fully defined stack for the objective comparison of algorithms for networked and autonomous driving