“I think that you're seeing Republicans wishing that other Republicans would stop talking about this. But until Donald Trump does, they're in trouble,” libertarian podcaster says