Foxes aren't really noted as fruit eaters. Maybe the fruit is attracting the mice/rats, which in turn attract their natural predators, the foxes. You should be grateful that they both keep vermin down and clean up after all those who are careless with their chicken takeaways. If the population of either were reduced, then the fox population would follow.

Our neighbours do put food out and have a regular fox clientele. They have cats too, and there's no conflict. The whole family enjoys watching the foxes playing and sunbathing on our lawn and apart from the track through our flowerbeds which is the path they use across the garden (woe betide if you try to plant anything there), we suffer few ill effects.

Instead of venting your spleen on those who feed foxes, how about those who overfill their wheely bins, and leave bin bags out as temptation to the foxes to strew rubbish all over the street (the other side neighbour!)