Anna Geller

08/11/2022, 6:12 PM
Fresh off the press - fugue Fugue collection just got released to PyPI! This collection makes it easy to move from a local development with Pandas to a distributed computing framework such as Spark or Dask. How does it work? Simply swap the fugue Fugue Block name to point to a Databricks or Coiled cluster, and the same code will be parallelized across several compute nodes on Spark or Dask, and it will just work - no code modification required, no hardcoding credentials. Give @Kevin Kho a star on this repository!
👀 9
highfive 3
🙌 15
🔥 17
fugue 13
🙏 1