Howdy, Oh man I am struggling to figure out why all my tasks are failing with

Failed to load and execute Flow's environment: ModuleNotFoundError("No module named '/home/magnox/'")

Env: • Local Agent + Local Storage (Running in docker [python:3.10] ... yeah yeah lol) • External Postgres 12 • Prefect Server in Kubernetes (Official HELM) • Django Integrated Code: The Source is located in

/code/

We have added

/code

to the path and Python path on execution. Notes: • Sometimes a single container will work fine (using the same exact image and everything)(Cant seem to figure out why) • I have tried with and without Dask • I tried to symlink the /code -> /home/magnox to no avail

Hey @Max Watermolen, this thread will help you with that. Can you Move some of the code snippets in the thread to keep the main channel cleaner?

Thanks for the reply, and for sure Please help, Im lost lol Code Flow: 1. Launch.sh (Sets Env) a. Entrypoint.py i. Registration.py 1. Tasks.py tasks.py:

with Flow('AutomoxSyncOrginizations', executor=LocalDaskExecutor(), schedule=automox_sync_orgs_schedule) as automox_sync_orgs:
    x= dummy()

Registration.py:

def register(schedule=True):
    automox_sync_orgs.run_config = run_config
    automox_sync_orgs.register(
        project_name=os.getenv("RELEASE").lower(),
        labels=["REACTOR", "AUTOMOX"],
        set_schedule_active=schedule,
        add_default_labels=False,
        idempotency_key=automox_sync_orgs.serialized_hash()
    )

Agent in entry.py:

############################
# TASK IMPORTS BELOW
############################
import automox.registration

############################
# REGISTER FLOWS BELOW
############################
print(f"[+] About to Register Flow - {os.getenv('RELEASE').lower()}")
automox.registration.register(schedule=True)
print("[+] DONE Registering Flow")
############################
# LAUNCH AGENT BELOW
##########################

LocalAgent(labels=["REACTOR","AUTOMOX"], hostname_label=False, name=os.getenv("HOSTNAME"), import_paths=["/code"]).start()

Launch.sh:

#!/bin/bash

cd /code
export PYTHONPATH="/code"
export PATH="${PATH}:/code"

echo $PATH
echo $PYTHONPATH
python /code/entrypoint.py

Let me look a bit at the setup

Yes, So are there any downsides to storing as a script? although is there a way to force it to pickle it even if its already registered?

No downside. In my opinion it’s preferred. I don’t think there is a point to pickle if you used script based

Excellent, Ill test that and report back! Thank you so much!

You can pair LocalAgent with LocalRun and

LocalRun

can take in a working dir like this so if you import other modules, it will have access to them

Oh thats what I forgot to post

run_config = LocalRun(
    working_dir="/code",
    env={
        "DJANGO_SETTINGS_MODULE": "magnox.settings.base"
    }
)

Wait, are you good now? Cuz that sounds right

Well I somehow need to clear that hostname label

flow.storage = Local(…, add_default_labels=False)

and then re-registering should work. Maybe you put it on the Flow object?

I think the .register() on the flow takes it, and it is set. Somehow changing the storage to local seems to be overriding it

That’s why you add the

add_default_labels

to the storage. This is to enforce local agents across multiple machine exclusively pick up the Local storage Flows.

Ahh ok, I see It wasnt listed in the params

Ah cuz it is in the base Storage class

Yeah, I passed it so it should take as a kwarg