RJames - in my view (and I accept that every view is subjective), you have nothing to be worried about. I walk/cycle along this section of road every evening and, the occasional smart alec comment from teenagers aside, I've never felt threatened or unsafe.

It's a fairly well trodden path too and it's rare that you'd be the only person walking home along that road.