Yep, the only way to tell for sure is to take off the hub and look inside. When my hub bearing went out the spocket had about 3mm of lateral play.
Along with bearings, you may want to check the brake return springs, sometimes they can break while braking. Also check the break anchor pin nut, mine vibrated loose at one time.