Yes I've done it loads over the years - the best one being years back when I went with a Leeds mate of mine to Millwall when they were down Cold Blow Lane and had a well deserved name for violence.
What we never thought about until go there were or thick northern accents made us stand out a mile - not a good thing to be!
We had to get by, by grunts and nods until the match was over and we were back in central London.
I don't think the threat of being beaten up is anything like as great now as back then, but probably wise not to wear any club colours and don't jump out of your seat when we score because all the home fans will still be sat down.
If you do though, the solution is to go wild at someone immediately, the referee, linesman, defender keeper and blame them for the goal that's just been let in!
I refused to cheer for any goals they score, might just clap though just to be on the safe side - and clap our goals - but obviously not going over the top when you do.
You should be fine at Wycombe though.
Enjoy the match, maybe Parky will go all out attack for a change!