Hi All, is anyone using Module storage option?
# ask-communitym
Milly gupta
04/19/2021, 1:24 PMHi All, is anyone using Module storage option?
k
Kevin Kho
04/19/2021, 1:28 PM
Hi @Milly gupta! What question do you have about model storage?
Kevin Kho
04/19/2021, 1:30 PM
I read you other thread asking for a working example. I provided one here
m
Milly gupta
04/19/2021, 1:33 PMThanks @Kevin Kho. I am looking for working examples as documentation doesn't explain much
Milly gupta
04/19/2021, 1:48 PM Copy code
So I have created test_module.py from prefect import task, Flow
from prefect.storage import Module
@task
def say_hello():
print("hello world")
flow = Flow("hello-flow")
flow.storage = Module("test_module")
flow.storage.add_flow(flow)
flow.add_task(say_hello)Milly gupta
04/19/2021, 1:48 PMand a separate script to register
Milly gupta
04/19/2021, 1:49 PM Copy code
from test_module import flow
flow.run_config = LocalRun(labels=["mg-test"])
flow.register(project_name="CDP")Milly gupta
04/19/2021, 1:49 PMSo this work but wondering if it's the right way
f
Florian Kühnlenz
04/19/2021, 1:52 PMbiggest problem I ran into was that the module storage needs the code to be installed as a package in the environment.
k
Kevin Kho
04/19/2021, 1:52 PM
I believe this will work but just a couple of comments. First is that while this is right, we recommend the functional API.
with Flow("") as flow:flow.registerKevin Kho
04/19/2021, 1:52 PM
Thank you for the reminder @Florian Kühnlenz!
Kevin Kho
04/19/2021, 1:53 PM
@Marvin open “Docs around ModuleStorage Need More Details on Usage”
m
Marvin
04/19/2021, 1:53 PMm
Milly gupta
04/19/2021, 1:58 PMyeah thanks @Florian Kühnlenz. That's the intention to use packages eventually
Milly gupta
04/19/2021, 1:58 PM@Kevin Kho Yeah we use functional API, this is just a test example to understand module storage