There's no doubt that removing the "hot tube" in the exhaust will help to reduce the retained heat in the engine, and improve performance too.
I'd definitely do that.
As for the PAV, it really does nothing.
You could take it off or leave it on, and there will be no noticeable change.
However, if you do take it off, I'd keep it in the closet, just in case some whacky politicians decide to make a new rule saying you need to have pollution monitoring at yearly vehicle inspections.
So, to keep all bases covered, I think it best to get a whole new performance exhaust system, good air fliter, re-jet the carb, and remove the PAV.
Keep all the original stuff, just in case the emissions-Gestapo start getting happy feet, and want to stick emissions probes up your tailpipe.
The usual method for states that have this, is to run your bike the way you want it, and then put the original stuff back on when you go in for the emissions test, and then put it back the way you want it for the rest of the year.