Hi guys, can you confirm it’s only possible to have a nice progress-bar in the schematic task if you are mapping a task ?
More details in thread …
upvote 1
Daniel Kornhauser
01/17/2022, 4:09 PM
It would be sweet to be able to create a progress bar in serial non mapped tasks, where you would set the total and increment via some API calls a la tqdm …
Note is just a “nice to have”, given the Timeline graph in the Overview tab already acts as a progress bar.
Daniel Kornhauser
01/17/2022, 4:11 PM
For example, in the attached screenshot.
transform_xml_to_jsonl
has has a nice progress bar given that its’ mapped.
But given that I must index serially in order
index_jsonl
has not progress bar given that it’s not mapped.
k
Kevin Kho
01/17/2022, 4:13 PM
We can’t have this progress bar because we don’t know the code running inside a task
👍 2
a
Anna Geller
01/17/2022, 4:14 PM
You can check if perhaps you can publish some progress report using intermediary tasks and Artifacts API
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.