Laura Vaida
03/02/2021, 4:52 PM#define executor as dask executor with tcp from load balancer
flow.executor = DaskExecutor(address="35.198.104.230:8786") # tcp:port address of dask load balancer
flow.storage = Docker(registry_url="<http://gcr.io/keller-steering-enabling/flows|gcr.io/keller-steering-enabling/flows>", image_name="billwerk-contracts",python_dependencies=["pandas", "oauthlib ", "requests", "requests_oauthlib", "datetime", "oauth2client", "snowflake"])
flow.run_config = KubernetesRun()
flow.register('Billwerk')
Mariia Kerimova
03/02/2021, 4:57 PMoauthlib
in python_dependencies. Let me check with the team!Laura Vaida
03/02/2021, 5:10 PMLaura Vaida
03/02/2021, 5:10 PMMariia Kerimova
03/02/2021, 5:22 PMRUN pip install oauthlib
command was successful. I'm looking into it, let you know what I will findZanie
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
Powered by