Hi everyone, I use local storage for result persis...
# ask-community
t
Hi everyone, I use local storage for result persistence. I'd like to set different paths for different workflows that are deployed together (through the
.to_deployment
+
serve
scheme). If I set the environment variable
PREFECT_RESULTS_LOCAL_STORAGE_PATH
, it's set to the same value for all workflows. I asked Marvin and I was told to set
result_storage
in the flow decorator, either to
LocalFileSystem(basepath=path1)
or
Path(path1)
but it fails. Somehow I need to call
.save()
on the
LocalFileSystem
instance beforehand to create a block server-side. I find this a bit convoluted for a fairly simple need, especially since I otherwise don't need to do it when using the
PREFECT_RESULTS_LOCAL_STORAGE_PATH
variable set to arbitrary values. Marvin also told me that I could pass
PREFECT_RESULTS_LOCAL_STORAGE_PATH
as a job variable to the deployment, but that it was not the recommended solution. What would you recommend? Also, if there are no other solutions than what I described, I would argue that being allowed to simply provide a
Path
object to
result_storage
would be a reasonable behaviour to expect and I would be interested in discussing it or filing an issue on GitHub. Thanks!