A hybrid method combining the finite element method (FEM) with the boundary integral equation (BIE) is presented in this paper to investigate two-dimensional (2D) electromagnetic scattering properties of multiple dielectric objects buried beneath a dielectric rough ground for TM case. In traditional FEM simulation, the artificial boundaries, such as perfectly matched layer (PML) and the absorbing boundary conditions (ABC), are usually adopted as truncated boundaries to enclose the whole model. However, the enclosed computational domain increases quickly in size for a rough surface with a large scale, especially for the scattering model of objects away from the rough surface. In the hybrid FEM-BIE method, one boundary integral equation is adopt to depict the scattering above the rough surface based on Green's function. Based on the domain decomposition technique, the computational region below the rough ground is divided into multiple isolated interior regions containing each object and the exterior region. Finite element formulations are only applied inside interior regions to derive a set of linear systems, and another boundary integral formula is developed below the rough surface which also acts as the boundary constraint of the FEM region. Compared with traditional FEM, the hybrid technique presented here is highly efficient in terms of computational memory, time, and versatility. Numerical simulations are carried out based on hybrid FEM-BIE to study the scattering from multiple dielectric objects buried beneath a rough ground.