My understanding of the boundaries is that South Norwood and Selhurst Park were not part of London County prior to 1965. Therefore, Crystal Palace were not a London team when they were founded.
Forest Hill was part of London and we have the boundary markers (between the boroughs of Camberwell and Lewisham, I think) to prove it.