The Vice President can’t do that without “a majority of either the principal officers of the executive departments or of such other body as Congress may by law provide” on their side. That can’t happen without either the aid of people that Trump would have to select (and he’s notorious for picking toadies) or Congress passing a bill to create a body to evict him.