https://prefect.io logo
a

Andreas

02/09/2022, 2:53 PM
Hi! When writing DWH tables from Prefect, are there any recommended metadata fields that should be attached to the rows. I'm thinking about things like flow label and version as well as created / updated timestamps. Are there ready to use functions in Prefect for this?
k

Kevin Kho

02/09/2022, 2:57 PM
No we don’t have for label and version specifically. You’d likely need to query the GraphQL API to get that information. Created/updated timestamps for the flow or data? If for the flow, it would be GraphQL also. If you data like
last_processed
, we recommend using the KVStore to store that timestamp
a

Andreas

02/09/2022, 4:29 PM
Thank you @Kevin Kho! Timestamp would be something like
last_processed
, yes. I will have a look at KVStore.
6 Views