Hi, don't go to Penn Station if you need to get to NEw Haven. It is more convenient to take the Metro North train from Grand Central station in NYC. There is a shuttle bus from JFK that will take you to Grand central station, and trains are departing almost every 15 minutes since you are arriving during the rush hour. Hope this helps.
From JFK to NEw Haven