I like riding gravelroads on my Enfield, but I personally think it's a bit heavy, (as its put together), for a really decent offroad bike. I used to ride a KLX; lots of power, light, fast, noisy, and now, (I guess), illegal in most places.
Plus, (and this is just my opinion), I don't like to see off-road vehicles in other than the designated riding places, but I do all the time.
The Enfield, besides being street legal, and a little workhorse, is plenty capable of getting me to just about any place I want to here in Washington State; I can walk the rest of the way.
I don't know how things are where you live, but here, if you are building the bike for strictly offroad, you'll end up trucking it quite a ways sometimes.
In my opinion, it won't keep up with a KLR offroad, but will, on most gravel and F.S. roads.