Take the air-train to Jamaica station and then take the Long Island RR to Penn Station. At Penn station you can get a NJ Transit train directly to Newark Liberty Station instead of Newark Penn. Newark Liberty Station is at Newark Airport and connects directly with the Airtrain. With a small child and baggage you will be much more comfortable on the trains rather than the subway. The cost is about the same.
JFK to Newark