You could just write decent specs, or generate decent specs and get this done in 1/5th of the time with smaller models. Complete waste of electricity to run $500k in GPUs full throttle, if not more, for 18 hours straight to migrate from spark to pandas. Maybe try using your brain.