https://prefect.io logo
m

Matt Drago

10/27/2020, 7:38 AM
Hey Folks, I'm looking for an example ELT or similar to extract data from an RDBMS and for subsequent runs of the extraction task to pick-up where the previous run got up to. I've come across
States
and
Caching and Persisting Data
in the doco. Would I be able to store the position that the extract got up to in one of these things, or is the
Result
object the right thing to use and then interrogate the Result of the last successful run of the Task?
j

Jenny

10/27/2020, 1:35 PM
Hello @Matt Drago - The result is part of the state object and is where data is persisted so I guess you're right with all three. You can use the result object in different ways depending on your needs/use case. You can see more in the results section of the docs.
m

Matt Drago

10/28/2020, 5:55 AM
Ah great, Thanks @Jenny. I've almost got a small PoC going for one of the scenarios that I want to cover. THen I'll start playing around with the Results api to see what I can do with it to solve the other case.
👍 1
4 Views