Hello, quick question: prefect’s dask scheduler does not seem to support the security specification that allows for things like ssl auth. Do you guys have any general recommendations in terms of executor authentication/security?
z
Zachary Hughes
11/07/2019, 9:15 PM
Hi Melanie! I don't believe we've come across this issue yet, but let me ask around and see if I can find some resources for you.
Zachary Hughes
11/07/2019, 9:43 PM
Following up: according to the linked doc, it looks like TLS/SSL can be implemented via keyword arguments on the Dask Client. We pass all extra keyword arguments to
DaskExecutor(**more_kwargs)
to the client, so this might be an effective workaround.
https://distributed.dask.org/en/latest/tls.html
Aside from that, you raise a good point, and we'd love to implement more robust support for this in the future. Thank you for raising this point!
👍 1
⬆️ 1
m
Melanie Kwon
11/07/2019, 10:22 PM
Awesome thanks so much .
c
Chris White
11/08/2019, 7:14 PM
@Marvin archive “Can I configure Prefect to use Dask’s TLS / SSL communication hooks?”
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.