Drastic epigenetic reprogramming occurs during human gametogenesis and early embryo development. Advances in low-input and single-cell epigenetic techniques have provided powerful tools to dissect the genome-wide dynamics of different epigenetic molecular layers in these processes. In this review, we focus mainly on the most recent progress in understanding the dynamics of DNA methylation, chromatin accessibility, and histone modifications in human gametogenesis and early embryo development. Deficiencies in remodeling of the epigenomes can cause severe developmental defects, infertility, and long-term health issues in offspring. Aspects of the external environment, including assisted reproductive technology procedures, parental diets, and unhealthy parental habits, may disturb the epigenetic reprogramming processes and lead to an aberrant epigenome in the offspring. Here, we review the current knowledge of the potential risk factors of aberrant epigenomes in humans.