You should share what CPU/GPU you have. 40% of 4090 RTX is not the same as 10% of 1060GTX ...
Anyhow as far as I know the lobby is built on top of the engine so it will still do some of the necessary stuff for the engine (textures, etc.), so I 2 GB does not sound excessive to me.
Now, if after each game the memory consumption grows - then that's a problem (that was reported previously and fixed).