hi all,
Does prefect have integration with talend?
thanks.
k
Kevin Kho
10/21/2021, 6:50 AM
Hey @AJ, it appears we don’t at this time. We often have people moving from talend. I’ll talk to our team members that handle talend and ask if something is in progress
Kevin Kho
10/21/2021, 3:02 PM
There are no plans for a talend integration
a
Adam Brusselback
11/01/2021, 1:57 PM
@AJ I have utilized shelltask to call my talend jobs from Prefect (I mainly wanted to use Prefect as the orchestration piece here)
Adam Brusselback
11/01/2021, 1:58 PM
So I can use Prefect to pass through my parameters into Talend as context variables, schedules can be setup easily with whatever parameters necessary, etc.
Adam Brusselback
11/01/2021, 2:03 PM
Right now I am manually building my shell script call with context vars based on the params from prefect, i'll very soon figure out a way to do that programmatically to reduce code redundancy that I have right now.
Adam Brusselback
11/01/2021, 2:03 PM
I do not have Talend interacting with Prefect in any deep way right now, though if I could figure out a way to allow talend job outputs to be read into prefect as a results tuple, that would be amazing. There would need to be some translation from java data types to python though, and I have no idea how that works right this second.