Preston Marshall

02/06/2020, 3:31 PM
Ok, another question. Would you mind describing at a high level how I would, on a schedule: reach out to an SFTP server, list the files (dynamic workflows!), copy them somewhere, and send a slack notification? I think the dynamic part has me the most confused right now, the rest is just stringing tasks together from the library


02/06/2020, 3:35 PM
Here’s how I would set it up: • First task which reaches out to the SFTP server, gets the information back and returns it • Downstream task which maps over the results from the upstream fetch and copies them somewhere (this is where the dynamic task creation part happens) • Either use a slack state handler or a downstream task to directly talk to slack • Attach a schedule to the flow to fit your desired run cadence

Preston Marshall

02/06/2020, 3:37 PM
awesome, thanks