The group were detained as part of an “intelligence led operation” in January and now face being kicked out of the UK.
A 50-year-old Latvian man and a 37-year-old Polish man are currently in a detention centre awaiting removal, while three other men were also detained but have since been released.
The released men, originating from Lithuania and Poland and aged in their twenties and thirties, have been ordered to regularly report to Immigration Enforcement.
Those deported will also be refused entry to the UK for the next 12 months.
A spokesman for the Home Office said they consider rough sleeping “an abuse of free movement rights”.
They said: “Those EU citizens wishing to stay beyond three months can only do so where they are exercising a treaty right.
The Home Office said homeless migrants were breaking free movement rights
“We consider rough sleeping an abuse of free movement rights even where it takes place in the first three months of an EU national’s residence in the UK.
“We will take action against foreign nationals who refuse to find alternative accommodation, including removal from the UK.
“The response of enforcement officers is taken on a case-by-case basis when they encounter rough sleepers and will be proportionate to their personal circumstances.”
The group are set to be deported from the UK
He said: “People come into our city from far and wide with very complex needs and our focus has to be on those who really need our help.