Text this: Impact of light-matter coupling on correlations across the classical-quantum boundary in quantum electrodynamics