Bernardo Galvao

12/23/2022, 12:21 PM
Hii all. We're about to have Christmas, so no rush in answering this. My question is: what is the best way to package artifacts (a parquet file) and environment variables for a Prefect Flow to work as intended?

Ryan Peden

12/23/2022, 2:22 PM
Hi Bernardo! How do you plan to run your flows? The best way might differ if you're running flows as processes on a single machine vs. running them in a Docker container vs running them as an ECS task. Also, how large do you expect the Parquet files to be?

Bernardo Galvao

12/26/2022, 10:44 AM
Hi 🙂 Came back on the 26th to respect holidays. For one flow, these are the files
The parquet file in question is under 1MB
ideally, I can run the flow using a codebase, like a git repo
I suppose it is easier to run in a docker container