Fresh off the press - fugueFugue collection just got released to PyPI!
This collection makes it easy to move from a local development with Pandas to a distributed computing framework such as Spark or Dask.
How does it work? Simply swap the fugue Fugue Block name to point to a Databricks or Coiled cluster, and the same code will be parallelized across several compute nodes on Spark or Dask, and it will just work - no code modification required, no hardcoding credentials.
Give @Kevin Kho a star on this repository! ⭐