Hi!
When writing DWH tables from Prefect, are there any recommended metadata fields that should be attached to the rows. I'm thinking about things like flow label and version as well as created / updated timestamps. Are there ready to use functions in Prefect for this?
k
Kevin Kho
02/09/2022, 2:57 PM
No we don’t have for label and version specifically. You’d likely need to query the GraphQL API to get that information. Created/updated timestamps for the flow or data? If for the flow, it would be GraphQL also. If you data like
last_processed
, we recommend using the KVStore to store that timestamp
a
Andreas
02/09/2022, 4:29 PM
Thank you @Kevin Kho! Timestamp would be something like