Ben Spencer, Conservative MP for Runnymede and Weybridge, said it would put an “unmanageable burden” on schools and healthcare.
The Home Office wants to develop a building in Syward Place, Pyrcroft Road, to house 300 people.
The Home Office said it would work with local people to address their concerns.