Fresh off the press - :fugue: Fugue collection
just got released to PyPI
This collection makes it easy to move from a local development with Pandas
to a distributed computing framework such as Spark or Dask.
How does it work? Simply swap the :fugue: Fugue Block name to point to a Databricks
cluster, and the same code will be parallelized across several compute nodes on Spark
, and it will just
work - no code modification required, no hardcoding credentials.
Give @Kevin Kho
a star on this repository! ⭐