We present a novel approach to probe elastic properties of polyelectrolyte multilayer microcapsules. The method is based on measurements of the capsule load-deformation curves with the atomic force microscope. The experiment suggests that at low applied load deformations of the capsule shell are elastic. Using elastic theory of membranes we relate force, deformation, elastic moduli, and characteristic sizes of the capsule. Fitting to the prediction of the model yields the lower limit for Young's modulus of the polyelectrolyte multilayers of the order of 1-100 MPa, depending on the template and solvent used for its dissolution. These values correspond to Young's modulus of an elastomer.