I would get on to the bank in question and the police straight away. This could be setting your address up with some kind of credit history for a bigger fraud further down the line.
How do he know that a parcel was going to your address.
I would also contact the Post Office. No postman should give something address to your flat to anybody without ringing the doorbell first.