A Platform for Cavity Quantum Electrodynamics with Rydberg Atom Arrays