Taxi would be VERY expensive. Consider taking a bus or Amtrak train from Providence to Penn Station-NY. From there you can take either E subway or LIRR to Jamaica Station and Airtrain from there to all terminals. Airtrain/subway is $7.25, Amtrak is about $40, bus is likely cheaper.
Taxi would be VERY