I look forward to meeting you on Wednesday and discussing the issue.

Since I realise that English is not your first language let me try and explain why your comments are perceived as racist, even if that may not have been your intention.

1. This makes it sound like you believe that the police are deliberately taking no action because of the race of the perpetrator. Our police system, while often flawed, does not work like that (and there is plenty of evidence that it is ethnic minorities that are unfairly targeted by the police).
2. 'when they don't give a damn' makes it sound like you are claiming that all people of the race you define 'don't give a damn' - rather than a small number of individuals. Of course most people with this ethnicity (and any other) would share your dislike and upset about such parties that disturb all neighbours.
3. 'I don't want it to sound racist' - I think you knew that this might upset people, particularly if not phrased very carefully. Generally if you feel that your words may easily be interpreted as racist then it is better not to say them.

I hope that helps explain why some people found your comments to be racist, just as you predicted.