Rob Fowler
10/15/2020, 7:55 AMRob Fowler
10/15/2020, 7:57 AMRob Fowler
10/15/2020, 9:26 AMclass CFExecutor(Executor):
def __init__(self):
self.pool = ThreadPoolExecutor(3)
def submit(self, fn: Callable, *args: Any, extra_context: dict = None, **kwargs: Any) -> Any:
return self.pool.submit(fn, *args, **kwargs)
def wait(self, futures: Any) -> Any:
print(f"type {type(futures)}")
return next(as_completed((futures,))).result()
Rob Fowler
10/15/2020, 10:19 AMupstream_states = executor.wait(
{e: state for e, state in upstream_states.items()}
)
Rob Fowler
10/15/2020, 10:20 AMfinal_states = executor.wait(
{
t: task_states.get(t, Pending("Task not evaluated by FlowRunner."))
for t in final_tasks
}
)
Rob Fowler
10/15/2020, 10:24 AMRob Fowler
10/15/2020, 10:28 AMZanie
Zanie
LocalExecutor
that uses a thread pool?Zanie