https://prefect.io logo
a

Andrew Hannigan

11/06/2020, 9:51 PM
Suppose I have a class called
ReadTable
which extends
Task.
This class just SELECTs data from a big SQL table. I want to perform this SELECT in parallel with say n sub-Tasks. So the
ReadTable(n)
object should spawn n sub-Tasks when it runs. How would this work within Prefect's OOP paradigm, where
ReadTable
inherits
Task
?
z

Zanie

11/06/2020, 10:21 PM
If you want your subtasks to be tracked by Prefect within your flow I would recommend making use of the ‘Mapping’ paradigm https://docs.prefect.io/core/concepts/mapping.html
4 Views