Both sides met near the Four Points By Sheraton hotel in Horley, which is used to house asylum seekers, and were separated by police.