https://prefect.io logo
d

Deceivious

07/10/2023, 8:30 AM
HI, Does prefect support task retry dependancy [Ill explain ]? Consider the following use case. 1. Task 1: Fetches data from API. Returned junk data 20% of the time. Categorizing response as junk data is a complex CPU intensive parsing task. 2. Task 2: Parses the response and categorizes into good / bad data. Raises Custom Exception "BadDataException". In case Task 2 raises the exception, I want to return Task1 and Task2. I still want the 2 "task" to be 2 "Prefect Task" as I use result storage for task 1 and different task concurrency tag limiter for the 2 tasks. Id say something like
ChainedTask
if that makes sense 😄