Toxoplasma gondii is a major foodborne pathogen capable of infecting all warm-blooded animals, including humans. Although oocyst-associated toxoplasmosis outbreaks have been documented, the relevance of the environmental transmission route remains poorly investigated. Thus, we carried out an extensive systematic review on T. gondii oocyst contamination of soil, water, fresh produce, and mollusk bivalves, following the PRISMA guidelines. Studies published up to the end of 2020 were searched for in public databases and screened. The reference sections of the selected articles were examined to identify additional studies. A total of 102 out of 3201 articles were selected: 34 articles focused on soil, 40 focused on water, 23 focused on fresh produce (vegetables/fruits), and 21 focused on bivalve mollusks. Toxoplasma gondii oocysts were found in all matrices worldwide, with detection rates ranging from 0.09% (1/1109) to 100% (8/8) using bioassay or PCR-based detection methods. There was a high heterogeneity (I2 = 98.9%), which was influenced by both the sampling strategy (e.g., sampling site and sample type, sample composition, sample origin, season, number of samples, cat presence) and methodology (recovery and detection methods). Harmonized approaches are needed for the detection of T. gondii in different environmental matrices in order to obtain robust and comparable results.