Hello everybody, I have two quick questions 1. Do...
# prefect-community
t
Hello everybody, I have two quick questions 1. Does a mapped task (of size n) count for 1 task or n tasks in terms of billing? 2. I have a workflow that generates a list of size n and then all subsequent tasks use
map
for each item. On the UI it says "No heartbeat detected from the remote task; marking the run as failed.", but the result of the workflow is marked as "Success". I checked my database and everything looks like the task succeeded. Any idea what is going on and how can I avoid it? Have a nice day!
k
Each mapped task is 1 task because it is first class and contains retries Maybe this will help on the second question
t
@Kevin Kho Thank you very much for the answer. With regards to Question 1. Where would I find information or where should I ask to find what would be the best way to organize the tasks so that they do not consume a large number of credits. Right now I have to process ~1600 entities and I map it subsequently, costing me around 6000 tasks.
k
You can introduce parallelism without the Prefect interface if each of those doesn’t need retries and checkpoints, etc. Or you could talk to Sales and get discounts if your usage is large
t
@Kevin Kho Great, thank you very much