Ling Chen
03/10/2022, 5:18 PMKevin Kho
03/10/2022, 5:20 PMLing Chen
03/10/2022, 5:23 PMKevin Kho
03/10/2022, 5:29 PM<http://df.to|df.to>_parquet
so that itโs not held in memory because Prefect holds the mapped results and then you pass the location string instead of the df.Ling Chen
03/10/2022, 5:37 PMAnna Geller
03/10/2022, 5:38 PMdel df
Ling Chen
03/10/2022, 5:39 PMAnna Geller
03/10/2022, 5:40 PMdel my_object
gc.collect()
https://stackoverflow.com/a/1316793/9509388Kevin Kho
03/10/2022, 5:58 PM