Hi’yall I need some advice here. I am writing ETL using API which uses a JWT token that auto-refreshes from time to time (24 hr). How are you guys handling this?
j
Jan Malek
10/17/2023, 8:23 AM
A simple approach would be to put the token in a Secret Block then have a separate flow that fetches the refreshed token and puts it into the Block daily.
Depending on the timing, you might want to have something in your main flow with retries + backoff to wait for the refresh to finish.
g
Gregory Hunt
10/31/2023, 1:52 PM
I would write a task that checks the expire time on the token and refetches if expired
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.