A couple of months back a coworker of mine and I encountered a similar thing. We met a couple of guys talking about WoW in the cafeteria, but when we inquired on their faction and realm, they said they were playing Alliance on a PvE server.With both of us playing Horde on a PvP server, we instantly stopped talking to them.
