Jon Gosselin leaves his New York City apartment with a birthday cake and heads to a birthday party for his twin daughters, Cara and Mady.