Wrong Side Of The Tracks Meaning

(idiomatic) The part of town that is not inhabited by the wealthy (from municipalities where the sections were divided by the railroad tracks). May refer to area where the working class, poor or extremely poor live.

Example:   He grew up on the wrong side of the tracks, but he made a success of himself.