Stepover is everything
A stepover above about 10% of cutter diameter leaves visible scallops. Smaller stepover, longer run, better surface.
Leave stock for the finish
Roughing should never touch the final surface. Leave 0.3–0.5 mm and let the finishing pass take it.
Kill the runout
Tiny ball nose cutters show every bit of collet runout. A clean collet and a properly seated tool matter more than RPM.