There are different reasons to vote !n
-you do not want to start the game in this setup, because do not like map/teams etc
or
-you do not want to start the game
right now, because something prevents you from playing in next short time. (like have quickly do something, like close antivir update or start voicechat program or wait 30 seconds for a friend who has to restart lobby,..)
I think that is different and players need ways to signal that.
Like with the "ready up" button that was used before/is used other hosts/lobbies use.
(Players not readying up or votespam is similiar annoyance)
If you think about it, ready-status is the same as voting:
Except that you can always "vote yes" to start (=ready up) not only when a vote is active. And it does not spam the chat.