Fix odd low player count servers

Has been killing me ever since it got into master. When vote count changes, one of the votes won't be sliding back and forth across the entire screen.