I don't think you can speak on behalf of the vast number of people who don't cycle. Including many like myself who take other forms of exercise. What a bizarre analysis.
I certainly don't feel envy and I've never detected that in any of the discourse about these issues.
So if someone breaks the law and behaves aggressively, we only mention it because we're jealous? Perhaps it gets mentioned simply because it's a growing problem and as a result more people notice it.
You're also forgetting the fact that when people aren't on bikes or in cars they are also pedestrians. Would be interesting to see how people behave when in these different modes of transport.