Has anyone had any issues with these people (for want of a better word)?, I have heard them shout and people in the street and urinate up the walls.

If they're abusing fellow pedestrians and urinating on walls I think contacting the forest hill met support team might be of some help?
http://www.met.police.uk/saferneighbourh...htm#00AZGL