hey prefect fam, do you have a docker compose template for running prefect 2 locally?

Jon

11/03/2023, 6:18 PM

hey prefect fam, do you have a docker compose template for running prefect 2 locally?

Jon

11/03/2023, 6:19 PM

this looks outdated? https://medium.com/the-prefect-blog/how-to-self-host-prefect-orion-with-postgres-using-docker-compose-631c41ab8a9f

Nate

11/03/2023, 7:50 PM

that should be roughly correct if you replace all instances of "orion" or "ORION" with "server" / "SERVER"

Nate

11/03/2023, 7:51 PM

this page may be helpful

Jon

11/03/2023, 8:02 PM

nice. this is great, thank you!

Jon

11/03/2023, 8:04 PM

since prefect ships with sqlite, we can whack the postgres container entirely, yeah?

Nate

11/03/2023, 8:04 PM

if you're cool with sqlite then yeah you wouldnt need pg around

✅ 1

Jon

11/03/2023, 9:02 PM

i'm getting this error:

Copy code

^^^^^^^^^^
pipelines-orion-1     | sqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked
pipelines-orion-1     | [SQL: DELETE FROM flow_run_notification_queue WHERE flow_run_notification_queue.id IN (SELECT 1 FROM (SELECT 1) WHERE 1!=1) RETURNING id]
pipelines-orion-1     | (Background on this error at: <https://sqlalche.me/e/20/e3q8>)

Jon

11/03/2023, 9:02 PM

whether i try to use pg or not

Jon

11/03/2023, 9:02 PM

Copy code

networks:
  prefect:
    name: prefect

services:
  prefect-server:
    image: prefecthq/prefect:2-python3.11
    command: prefect server start
    ports:
      - 4200:4200
    environment:
      PREFECT_API_URL: <http://127.0.0.1:4200/api>
    networks:
      - prefect

Nate

11/03/2023, 9:03 PM

hmm i have seen that before with sqlite, when you're using pg, though have you set this?

Copy code

PREFECT_API_DATABASE_CONNECTION_URL="<postgresql+asyncpg://postgres:yourTopSecretPassword@localhost:5432/prefect>"

Jon

11/03/2023, 9:03 PM

yeah.

Jon

11/06/2023, 6:12 PM

fyi @Nate -- looks like that error is not problematic: https://github.com/PrefectHQ/prefect/issues/10956 can set this env var and it goes away with no problems:

PREFECT_API_SERVICES_FLOW_RUN_NOTIFICATIONS_ENABLED: false

Nate

11/06/2023, 6:37 PM

oops, this dropped off my radar. oh - nice! glad you figured it out

Open in Slack

Previous Next

Prefect Community

Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.