Hello there Br Arizoni,
I ride my 03 Iron Barrel with drum brakes in Phoenix traffic all the time. I can tell you that a properly adjusted front brake is sufficient. Like Ace said, and I have proven (to some expense), the heat is the real problem for you and I. I am hoping my current iteration will help me out there, while I wait for the modified crank bushing they are working on to get out of R&D.
I have the left shift Albion, with the improvement kit for the shifting action, and sealed bearings. I get a very positive sense of change of gears. I suspect it merely needs a little attention. Perhaps that little screw thing in the gear box needs adjusted inwards, or sharpened a hair depending on miles ridden.
Cleaning and lubing the front brake parts and cleaning the drum real well significantly improved my action and stopping power. Plus, Hitchcocks has a good primer on their site for how to properly setup that little adjuster bar for good solid drum contact.
If you wanna come ride mine around the block for a comparison, you are more than welcome. I'm no master mechanic, but I feel like I have mine in a good place right now, and might make a good basis of comparison.
Be safe man.