Constant DIY can be a pain. I think there are a lot of people working on their properties who cannot afford to move up now, as well as lots of new people moving in wanting to do DIY, in addition to other people who just like \ need to do their own DIY.
HOP (which is clearly much better than Forest Hill Nottinghillbilly ) has lots of great things. I love it as do many other people, but it depends what you want. Coffee shops and the like are not important to me.
For a young family SE23 is great IMHO but I suppose it depends what you want to do.
Good luck with your move but if you take the half glass full approach there is plenty to like in SE23 for a young family.