gfx_restart is broken. This is known/intentional, it has not been updated in ages, hence it doesn't handle any of the newer features or alike of the game.
Doing a temporary fix by forcing a reconnect on gfx_restarts. Should handle most of the issues I've heard people reporting.
I need misc other things in place before fixing it, or I'll basically have to do it twice.