https://prefect.io logo
Title
b

bardovv

03/24/2020, 10:48 AM
Does dotted lines indicate parallel processing?
e

emre

03/24/2020, 11:27 AM
Not really, it means that the parameters on the dotted line are being mapped over by the recieving task.
b

bardovv

03/24/2020, 11:30 AM
what does that mean?
I am a newbie
e

emre

03/24/2020, 11:31 AM
So
Constant[range]
is returning a range, in other words a list right?
b

bardovv

03/24/2020, 11:31 AM
yes
e

emre

03/24/2020, 11:32 AM
You are calling
dec.map(x=range_task)
instead of
dec(x=range_task)
if you had called the latter,
dec
would receive the entire list as a parameter.
b

bardovv

03/24/2020, 11:33 AM
yes
what does map in prefect do?
e

emre

03/24/2020, 11:34 AM
when you call it like
dec.map(x=range_task)
prefect iterates over the input list it receives from
range_task
, and runs a
dec
task for each element in the received list.
instead of running a single task and receiving the whole list as input.
b

bardovv

03/24/2020, 11:35 AM
so it's parallelization right?
e

emre

03/24/2020, 11:35 AM
If you run your tasks parallel, sure.
b

bardovv

03/24/2020, 11:36 AM
It's using dask executor
when you use dask worker you are using it parallelly right?
e

emre

03/24/2020, 11:36 AM
nice, dask should be running tasks in parallel.
b

bardovv

03/24/2020, 11:37 AM
do you use prefect in production? Is it possible just to use prefect core only in production?
e

emre

03/24/2020, 11:38 AM
yes, right now I am doing that, its lacking a lot of features that are offered in prefect cloud, but I am happy with what I got
b

bardovv

03/24/2020, 11:38 AM
you mean you are using only prefect core you mean?