Yes.
First, take the whole exhaust system off completely.
Then fit the header pipe into the engine, and bend the brackets however is needed to get it to hold naturally and fairly in place when the brackets are on the bolts.
Then, if there is a loose fit of the header into the exhaust port hole, you can cut a beer can into about one - inch wide strip of aluminum, and wrap it around the end of the header, like tape, and then push it into the exhaust port hole again to see how it fits. The idea is to fill the gap with the aluminum strip, so it makes a tight fit and fills the gap. Normally, one full wrap of the aluminum strip is enough in most cases. If you can do it with one wrap withe the ends butted perfectly together, then it will seal the best.
This fixes it in a way that has no goop or putty to burn off or crack off, and can be removed and replaced as many times as you want, like a permanent packing.
Then, put the rest of the exhaust system back on.