I've always heard one should use a brass or aluminium wool, as steel wool leaves bits behind that rust, also.
For bad rust, I use sandpaper of varying coarsness, and/or the various creams with terrycloth. Buffing wheels are good, but hard to get in tight places.