Ahhh, the team kit fred debate.... now that is a new one
You know what, I have a sneaking suspicision that no one is going to mistake you for a member of the pro peleton, just like we dont really believe that Jeff Gordoo, or Mikey Jordon, or Mario Lemiux is really strolling down the aisle of anytown, USA or anytown, anywhere for that matter. If you like the clothing, if you like the team, if you like the player/rider... then by all means wear the clothing. It is how the teams make money, it is why the sponsors sponsor the sport, it is why sports marketing works.
Those that cry "Fred" have their own issues. As I stated in a post the other day. Any cyclist worth his beans has experienced on at least one occasion... a textbook "Fred" showing up at a ride, race, or meeting on a road and absolutely cleaning the "non-Freds" proverbial clock. If they don't admit it, they are lying or have selective memories.
If you are worried about it, then don't get it. Otherwise you are going to either never wear it, or be weirded out when you actually do wear it.