Rajan Subramanian
03/02/2022, 5:37 PMAnna Geller
03/02/2022, 5:41 PMprefect orion database reset -y
But note that this will delete the metadata from your local DB.
Having said that, we are aware of the issue and are working on that 👍Rajan Subramanian
03/02/2022, 5:43 PMprefect deployment create redis_to_postgres_deployment.py
prefect deployment execute redis_to_postgres_pipeline/redis-to-postgres-deployment
i see the deployment on the UI. the first one executes. but the ones that are scheduled to run every 5 minutes never end up executing. Any help here?
My deployment.py file:
import os
from datetime import timedelta
from exchange_feeds.exchange_constants import EXCHANGEPATH
from prefect.deployments import DeploymentSpec
from prefect.orion.schemas.schedules import IntervalSchedule
POSTGRESPATH = os.path.join(EXCHANGEPATH, "feed_ingestor_to_postgres.py")
schedule = IntervalSchedule(interval=timedelta(minutes=5))
DeploymentSpec(
name="redis-to-postgres-deployment",
flow_location="redis_to_postgres_pipeline.py",
tags=["phobos-check", "test"],
parameters={"shell_task": POSTGRESPATH},
schedule=schedule,
)
Kevin Kho
03/03/2022, 10:15 PMprefect orion start
Rajan Subramanian
03/03/2022, 10:15 PMKevin Kho
03/03/2022, 10:16 PMRajan Subramanian
03/03/2022, 10:16 PMKevin Kho
03/03/2022, 10:21 PMRajan Subramanian
03/03/2022, 10:21 PMKevin Kho
03/03/2022, 10:23 PMprefect work-queue create "global-queue"
in another process. And you can read more on this here . Work queues will be the way work is picked up moving forwardRajan Subramanian
03/03/2022, 10:23 PMKevin Kho
03/03/2022, 10:32 PMZanie
03/03/2022, 10:59 PMRajan Subramanian
03/04/2022, 4:53 PMKevin Kho
03/04/2022, 4:54 PMRajan Subramanian
03/04/2022, 4:54 PM