Quantum dots must be tuned precisely to provide a suitable basis for quantum computation. A scalable platform for quantum computing can only be achieved by fully automating the tuning process. One crucial step is to trap the appropriate number of electrons in the quantum dots, typically accomplished by analyzing charge stability diagrams (CSDs). Training and testing automation algorithms require large amounts of data, which can be either measured and manually labeled in an experiment or simulated. This article introduces a new approach to the realistic simulation of such measurements. Our flexible framework enables the simulation of ideal CSD data complemented with appropriate sensor responses and distortions. We suggest using this simulation to benchmark published algorithms. Also, we encourage the extension by custom models and parameter sets to drive the development of robust, technology-independent algorithms.