It would be a good idea to at least purchase something in the restaurant. The Harbour Police and PSNI both do have powers to move you on from the area as its private property to which the public have a right of way. You should see regular PSNI and Harbour Patrols in vehicles around the site to deter crime.
If you purchased something in the restaurant (its cheap!) then we would not move you on as your a customer.