No, I did not do any mods to the amp. I mainly ran pedals through the clean channel.
I wouldn't recommend using high gain tubes to improve the OD channel. That OD channel just isn't going to do metal by itself. High gain tubes amplifies your input signal more but doesn't dramatically change the distortion characteristics of the amp. It's the preamp that does most of the sound shaping. If you're sticking with the amp, I think you're doing the right thing in looking for a distortion pedal.
If anything, I'd say put a low gain preamp tube in V1 so you have more headroom so that your pedal's input signal doesn't overload the amp input.
You have a tube zone? Is that not working out for you then?
What's your budget anyways?
Keeley MT2 can get that tight aggressive thing really well. Great string separation. Great for thrash but not that great for smooth recto nu-metal distortion.
I just won a Zoom Tri-metal on ebay (cos it was cheap) and I've been impressed by the Zoom analogue pedals in the past so I'm holding high hopes for this when it arrives.
EHX Big Muff is a muffled buzzy POS imo but the new Big Muff with Tone Wicker is meant to bypass the tone stack so you get more presence in sound which the BM badly needs. So it may be worth checking out.
Blackstar DistX might be good too.
Wampler/Emma/Tech 21/Catalinbread etc etc lots of boutique makers make high gain pedals but I have a feeling they're outside your budget.
Good luck with your search :)