Abstract This paper reports a simple label-free high-sensitive method for detecting low-concentration persistent organic pollutants and explosive materials. The proposed method combines surface-enhanced Raman spectroscopy (SERS) and magnetomotive enrichment of the target molecules on the surface of Ag nanoparticles (NPs). This structure can be achieved through self-assembling integration of Ag NPs with ferromagnetic Fe3O4 microspheres, forming a hybrid SERS nanoprobe with both optical and magnetic properties. Moreover, the magnetic response of ferromagnetic Fe3O4 microspheres can be used to dynamically modulate the optical property of Ag NPs through controlling their geometric arrangement on the substrate by applying an external magnetic field. It is also demonstrated from the full-wave numerical simulation results that the maximum electromagnetic field enhancement can be greatly increased by shortening the distance of neighboring Ag NPs and therefore resulting in an improved SERS detecting limit. More importantly, by using the prepared substrate, the SERS signals from organic pollution substances, i.e. aromatic polychlorinated biphenyl-77 and 2,4,6-trinitrotoluene, were quantitatively analyzed.