Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
pacc-clearcover-june-12-2023
pacc-may-31-2023
ppcc-may-16-2023
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Powered by
Title
r
redsquare
07/06/2022, 4:00 PM
Is there any guidance for checkpointing in 2.0?
k
Kevin Kho
07/06/2022, 4:04 PM
Are you asking this in comparison to 1.0? I think checkpointing might have a different meaning so is there something specific you are trying to do?
r
redsquare
07/06/2022, 4:05 PM
in my head I mean where are we upto in a stream or what was the last time this ran so I can add a where clause to the query
k
Kevin Kho
07/06/2022, 4:07 PM
Ah I understand. In 1.0 we had a
KVStore
but it’s not part of the 2.0 GA so you’d need to persist that watermark somewhere else for now
r
redsquare
07/06/2022, 4:08 PM
ok cheers - yeah a built-in 'persistent' redis would be nice
6 Views
#best-practices-coordination-plane
Join Slack