We demonstrate the method of averaging for conservative oscillators which may be strongly nonlinear, under small perturbations including delayed and/or fractional derivative terms. The unperturbed systems studied here include a harmonic oscillator, a strongly nonlinear oscillator with a cubic nonlinearity, as well as one with a nonanalytic nonlinearity. For the latter two cases, we use an approximate realization of the asymptotic method of averaging, based on harmonic balance. The averaged dynamics closely match the full numerical solutions in all cases, verifying the validity of the averaging procedure as well as the harmonic balance approximations therein. Moreover, interesting dynamics is uncovered in the strongly nonlinear case with small delayed terms, where arbitrarily many stable and unstable limit cycles can coexist, and infinitely many simultaneous saddle-node bifurcations can occur.