That is indeed rather concerning that someone would return so many times. Has he been given anything by anyone at some point? Is he seeing the house as a soft touch, or does it seem like he is checking if anyone is in?

Either way I hope the police can have a word with him soon, and at least get it on record who the guy is, and what his intentions are.