We're actively looking into this issue and trying to isolate who is affected. To help us with our search, can you let us know what region your game is from (i.e. North America or Europe), whether or not everyone in the party is playing with a full retail or free trial build, and what specific matchmaking filters you are using when you try to join a server with invite only?