This paper presents the tunable and switchable Perfect Absorbers (PAs), operating within the mid-infrared (mid-IR) spectrum, specifically targeting the 3 to 5 µm range with precise 0.25 µm intervals. This spectrum is particularly engineered for its minimal atmospheric absorption and unique atmospheric transmission characteristics. Our approach utilizes graphene-based nanophotonic aperiodic multilayer structures optimized through the synergy of micro-genetic optimization algorithm (GOA) within an inverse design framework. This strategic combination enables a predictive model-based strategy that broadens the design of space exploration, facilitating the discovery of PAs with highly accurate absorption control. Employing the Transfer-Matrix-Method (TMM) method for simulations, we manipulate the absorption characteristics, allowing for the precise tailoring of the desired spectral response while maintaining the multilayer structures' thickness under 2 µm. Our results demonstrate the tunability and switchability of PAs by adjusting graphene layers' chemical potentials, highlighting their dynamic optical behavior. For instance, a PA optimized for a 4 µm absorption peak can shift its absorption peak to 4.22 µm by merely changing the graphene layer's chemical potential from 0 eV to 1 eV, without compromising absorption efficiency. Additionally, our research uncovers the proposed absorbers' remarkable adaptability to various incident angles, maintaining 90% absorption up to 52 degrees. This adaptability demonstrates the versatility and robustness of our design across a broad spectrum of real-world applications, including thermal photovoltaics, sensors, and stealth technology, where angular independence significantly enhances device performance and efficiency. This research not only deepens the understanding of nanophotonic materials' capabilities but also paves the way for the design and development of highly efficient optical devices tailored for the mid-IR range.