Don't count servervotes for vote limitations.

Don't count the automatic server-called votes for the limitation. Also, maybe allow two votes before it's "locked down" for a little bit