Inverse-Designed Nanophotonic Resonators for Cavity Quantum Electrodynamics with Diamond Color Centers