The development of low-threshold detectors for neutrinos and dark matter necessitates low-energy calibration. We suggest this can be provided by the nuclear recoils resulting from the $\gamma$ emission following neutron capture. There is often a well defined MeV-scale $\gamma$ associated to a nuclear recoil in the 100 eV range. Using the FIFRELIN code, $\gamma$-cascades of various isotopes can be predicted with high accuracy. We present a comprehensive experimental concept for the calibration of CaWO$_4$ and Ge cryogenic detectors and show the potential of additional $\gamma$-tagging to extend the reach of the method.