They could split the playlists between Social and Ranked. Anyone in the Social playlists could join mid-match while people looking for Ranked games could wait until a match starts.