you should contact the police, maybe the SNT could help? If he is causing alarm and distress this is an offence - don't think you are causing a fuss about nothing it certainly isn't nothing

hope it works out