james.lamb
10/26/2020, 10:31 PMprefect
source code. help(LocalResult)
shows the following:
LocalResult(dir: str = None, validate_dir: bool = True, **kwargs: Any) -> None
Result that is written to and retrieved from the local file system.Is it fair to say that "local" in this case means "local to where the task is physically run" and not "local to wherever
flow.run()
is called from"?LocalResult
together with a remote executor like DaskExecutor
pointed at a dask-kubernetes
cluster, the results are written to the filesystem of the Dask workers.Kyle Moon-Wright
10/26/2020, 10:44 PMIs it fair to say that "local" in this case means "local to where the task is physically run" and not "local to whereverYes, the result would be local to the execution environment - I think this is one of those cases where the Hybrid Model giveth and taketh. Happy to clarify further.is called from"?flow.run()
james.lamb
10/26/2020, 10:47 PMKyle Moon-Wright
10/26/2020, 10:49 PMBen Perry
10/26/2020, 11:01 PMflow.run(...)
, with the scheduled flow we were hoping to use LocalResult to collect that data on the filesystem of the notebook. Any other ways to do that? Preferably without a remote store like S3Result.Kyle Moon-Wright
10/26/2020, 11:22 PMBen Perry
10/26/2020, 11:44 PMjames.lamb
10/27/2020, 4:26 AM