The government already can throw people out of their homes.
For the first 9 years of my life I lived on a certain block in Brooklyn. My family was evicted under "eminent domain" (something about a bridge to Staten Island).