Fresh off the press -
fugue Fugue collection just got
released to PyPI!
This collection makes it easy to move from a local development with
Pandas to a distributed computing framework such as Spark or Dask.
How does it work? Simply swap the
fugue Fugue Block name to point to a
Databricks or
Coiled cluster, and the same code will be parallelized across several compute nodes on
Spark or
Dask, and it will
just work - no code modification required, no hardcoding credentials.
Give
@Kevin Kho a star on this repository! ⭐