An accurate calibration of the energy measurement of electrons and photons is paramount for many ATLAS physics analyses. The calibration of the energy measurement is performed $in-situ$ using a large sample of $Z\rightarrow ee$ events. The results obtained with the $pp$ collisions data recorded in 2015 and 2016 at $\sqrt{s}=13$ TeV, corresponding to an integrated luminosity of $3.2 \ \mathrm{fb}^{-1}$ and $2.7 \ \mathrm{fb}^{-1}$ respectively, as well as the corresponding uncertainties on the electron and photon energy scales, are presented.