Fábio Alves

08/03/2020, 11:10 PM
Hi Everyone, I'm trying to run multiple dask-workers through Dockerfile and also dask-scheduler is it possible? The reason i'm doing this is to simulate a local run but using AWS EC2 instance resources

Kyle Moon-Wright

08/03/2020, 11:27 PM
Hey @Fábio Alves, I'm not too familiar with the specifics on Dask with a Dockerfile, but you can certainly create a DaskCloudProviderEnvironment, specify your workers, and their configurations for your Prefect Flow that way. More information can be found in the documentation on that Dask environment here.