Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

hey yall, observing that the modal worker image build adds a `modal_requirements.txt` that downgrades fastapi + pydantic + prefect dependencies. If i try to override this default, it has starlette==0.32 hardcoded, which prevents installing any other versions.

hi <@U07L853J7NZ> - can you show how you're observing that? and also your setup if possible

<https://gist.github.com/PrathamSoni/9f6ef61b146bb44793f69c1c82178abf> logs here. so you'll notice there's a `modal_requirements.txt` step which is after our image is unpacked which downgrades pydantic via fastapi. then there's a `python -m pip install prefect starlette==0.32.0.post1` which then forces prefect 2 via pydantic

as far as setup, it's pretty trivial, just copying our entire monorepo rn with a requirements.txt via prefect deploy cli

Hey <@U02GMEZU18B>, any chance you could take a call on this tomorrow? would be super helpful for getting us unblocked :smiley:

hi <@U07L853J7NZ> if you need dedicated time, i'll point you <https://www.prefect.io/|here> to book a demo. otherwise feel free to ask one off questions here in <#CL09KU1K7|>

Thanks Nate, yeah if we could get clarity on this that would be great then. Think we do have some call scheduled for later today but will report back after that

unfortunately it got rescheduled <@U02GMEZU18B> have you had a chance to look into this

image.png

Hi <@U07L853J7NZ> here are some diagrams from our call:

Hi <@U02GMEZU18B> / <@U03AT2QB6LF> — I’m running into the same issue re: the `python -m pip install prefect starlette==0.32.0.post1` preventing running prefect 3.0 with a custom image on modal. Did you get to the bottom of this? I can’t tell from the context in this thread if there’s a workaround. Thanks!!!

hey <@U076XH7UXQS> we gave up on it. think azure/aws are better supported on their end and should be easier to set up

Ahh, too bad. Thanks for letting me know. I set up AWS ECS in the meantime as a workaround but modal is a lot less overhead (when it works). What’s odd is that when using the default prefect image, modal pools seem to work just fine with prefect 3.0.

<@U07L88HE9MK> Just FYI it looks like you might have run into the same issue described in this thread (just searching this slack)

Hey <@U076XH7UXQS>, yeah we moved to ACI since it was better supported. Thanks for the shout