Here, we computed the aqueous solvation (hydration) free energies of 52 small drug-like molecules using an all-atom force field in explicit water. This differs from previous studies in that (1) this was a blind test (in an event called SAMPL sponsored by OpenEye Software) and (2) the test compounds were considerably more challenging than have been used in the past in typical solvation tests of all-atom models. Overall, we found good correlations with experimental values which were subsequently made available, but the variances are large compared to those in previous tests. We tested several different charge models and found that several standard charge models performed relatively well. We found that hypervalent sulfur and phosphorus compounds are not well handled using current force field parameters and suggest several other possible systematic errors. Overall, blind tests like these appear to provide significant opportunities for improving force fields and solvent models.