Hey everyone. I have a need to use the PostgresExecute task to run a specific function call, but the host/user/password that it runs for is determined dynamically during flow execution. It seems like this isn't possible due to how the task is setup
k
Kevin Kho
10/04/2021, 8:00 PM
Hey @Adam Brusselback, looks like you are 100% right. There is an outstanding issue for this. We’d certainly welcome a PR if you are interested. Otherwise, my best advice for now would be to subclass the task and override the
run()
method to be configurable.
✅ 1
a
Adam Brusselback
10/05/2021, 4:27 AM
Alright, @Kevin Kho with that link I remembered I looked into this already 6 months ago and had commented on that issue (as Tostino). This now is blocking progress for me, so I sat down and fixed the postgres tasks. Will submit a pull request shortly
k
Kevin Kho
10/05/2021, 4:28 AM
I felt this sounded familiar!
a
Adam Brusselback
10/05/2021, 4:34 AM
Hmm, when creating the PR, do I need to do something with the /changes dir?
annotation only python 3.8 and up? I think it's not available in python 3.7? But I'm not really sure. I think it still needs to be import
from typing import Tuple
a
Adam Brusselback
10/05/2021, 4:44 AM
Hmm, it was already used in the PostgresExecute and that line was unchanged by me, the line I changed from list to tuple, that is a copy paste issue...appreciate you catching that.
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.