“Just tell me what you will do if you want me to vote. Don’t tell me about the other person,” Comedy Central host explains