In Toloka, each labeling pipeline may consist of several projects created by requesters in which tasks of a particular nature are solved with the help of a diverse crowd from all over the world. Considering the light barrier to entry and since markup of each task is paid by a requester, any failure in the pipeline leads to money loss. Hence, such Prefect semantics as сaching and persisting data became a key to the vast improvement & budget preservation! We conducted a talk based on the popular example of a data-labeling task and want to share it with you. We are super happy to be part of a Prefect community and looking forward to deepening our collaboration:) If you have any questions or feedback regarding the integration, I will be happy to comment on them in the thread here. If you want to share your pain&ideas&proposals with our engineering team directly, you’re welcome to join our Toloka Global Community.