We present a first calculation of the heavy flavor contribution to the longitudinally polarized DIS structure function $g_1$, differential in the transverse momentum or the rapidity of the observed heavy antiquark $\overline{Q}$. All results are obtained at next-to-leading order accuracy with a newly developed parton-level Monte Carlo generator that also allows one to study observables associated with the heavy quark pair such as its invariant mass distribution or its correlation in azimuthal angle. First phenomenological studies are presented in a kinematic regime relevant for a future Electron-Ion Collider with a particular emphasis on the sensitivity to the helicity gluon distribution. Finally, we also provide first NLO results for the full neutral-current sector of polarized DIS, i.e., including contributions from Z-boson exchange.