Hi all - I have a bit of an open-ended question, but would it be acceptable security-wise to store all our secrets into GoogleSecretManager and then have a prefect task read in the secrets and then pass in those secrets to subsequent tasks in the flow?
k
Kyle Moon-Wright
11/23/2020, 7:11 PM
Hey @Riley Hun,
I think this is certainly viable - as long as there’s no checkpointing in your flow, the data is simply passed in memory. I’d recommend using a PrefectSecret task to ensure that the values never checkpoint.
Curious to know others’ opinions here!
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.