hi
@Gopal, my sense is that Elastic Beanstalk won't be a good fit for Dask since it's (Beanstalk) focused specifically on deploying web apps. We use AWS EKS (Elastic Kubernetes Service) in conjunction with Dask Kubernetes (
https://kubernetes.dask.org/en/latest/) That approach has been very successful for us. Using that, we create a Dask cluster in EKS that we then run Prefect on using their DaskExecutor.