In Fringe Season 2, Episode 16, it's revealed that Walter's son Peter is actually Peter from a parallel universe.