We explore fluctuations of the net-baryon number density in hadronic matter at vanishing chemical potential. We discuss the interplay between chiral dynamics and repulsive interactions and their influence on the properties of these fluctuations near the chiral crossover in the parity doublet model. We find that the characteristic properties of cumulants are entirely linked to the critical chiral dynamics and cannot be reproduced in phenomenological models, which account only for repulsive interactions. Consequently, a description of the higher-order cumulants of the net-baryon density requires a self-consistent treatment of the chiral in-medium effects and repulsive interactions.