Mike Ninov
07/24/2020, 11:15 PMGreg Desmarais
07/28/2020, 1:50 PMLast State Message
[9:35am]: Failed to load and execute Flow's environment: ModuleNotFoundError("No module named 'rightsize'")
Greg Desmarais
07/28/2020, 8:04 PMBivu Raj
07/30/2020, 4:55 PMclient.create_flow_run("a14f9774-e94d-40cc-b019-cb9044e120d4", run_name=f"manually_run_flow")
I understand that there can be multiple versions of the same flow. However, is there a way to query the latest version of UUID for a given flow from the client class itself and not using the graphql api? ThanksRoy
07/31/2020, 12:49 PMflow.run()
. However, these runs do not show up in the Prefect Dashboard, even when I .register()
them (the flow shows up in the web interface and I can run it from there, but starting it with .run()
does not show them as a Run). Is there a way to make them show up without running an agent?Bivu Raj
08/01/2020, 7:59 PMprefect backend server
), is there a way to run a flow every 10 seconds. Right now, I take an error saying that the cloud runner's minimum time delta is 1 minute? Thanksemmanuel
08/07/2020, 9:23 AMtenant
being None
🤷♂️emmanuel
08/07/2020, 12:18 PMLukas N.
08/12/2020, 9:43 AMprefect server start --version 0.13.2
gives me an error. It's looking for the manifest for prefecthq/apollo:0.13.2
which doesn't exist. Using the latest
works, but I would rather not use the latest tag in a production system as it may change when you don't want to. Looking at tags of prefecthq/server, prefecthq/apollo and prefecthq/ui the latest common version was 0.12.6
. Where can I find which versions of those Prefect components are compatible?Jeremiah
08/12/2020, 11:30 AMRafi Rubin
08/12/2020, 7:04 PMRafi Rubin
08/12/2020, 11:09 PMAdam
08/14/2020, 2:48 PMRiley Hun
08/14/2020, 5:18 PMElie Hamouche
08/16/2020, 10:38 AMfrom datetime import timedelta
import prefect
from prefect import Flow, task
from prefect.schedules import IntervalSchedule
prefect.config.debug = True
prefect.config.logging.level = "DEBUG"
@task(name="orchestrate", log_stdout=True)
def orchestrate():
logger = prefect.context["logger"]
logger.info("Orchestrating")
for i in range(1, 60):
logger.error(f"Counting {i}")
return True
flow = Flow("Cloud Flow", schedule=IntervalSchedule(
interval=timedelta(minutes=1),
))
with flow:
orchestrate()
flow.register(project_name="dev")
flow.run_agent(token="XXXX")
And I start the agent with:
python example.py
Agent seems to come up fine but just hangs:
(venv) ibraflow (master|✚5…) python example.py
Result check: OK
Flow: <https://cloud.prefect.io/ysft/flow/b7f56496-54df-4eeb-a0b6-2e274c39ed80>
____ __ _ _ _
| _ \ _ __ ___ / _| ___ ___| |_ / \ __ _ ___ _ __ | |_
| |_) | '__/ _ \ |_ / _ \/ __| __| / _ \ / _` |/ _ \ '_ \| __|
| __/| | | __/ _| __/ (__| |_ / ___ \ (_| | __/ | | | |_
|_| |_| \___|_| \___|\___|\__| /_/ \_\__, |\___|_| |_|\__|
|___/
[2020-08-16 10:34:38,874] INFO - agent | Starting LocalAgent with labels ['MacBook-Pro-2.local', 'azure-flow-storage', 'gcs-flow-storage', 's3-flow-storage', 'github-flow-storage', 'webhook-flow-storage']
[2020-08-16 10:34:38,874] INFO - agent | Agent documentation can be found at <https://docs.prefect.io/orchestration/>
[2020-08-16 10:34:38,875] INFO - agent | Agent connecting to the Prefect API at <https://api.prefect.io>
[2020-08-16 10:34:39,009] INFO - agent | Waiting for flow runs...
On the cloud's UI I see the correct version and task, so that rules out authentication and network issues?
But the tasks never run and are always marked "late" - attachment:Riley Hun
08/17/2020, 5:27 PMBivu Raj
08/18/2020, 6:26 PMCraig
08/19/2020, 8:25 PMMarwan Sarieddine
08/19/2020, 8:29 PMraman
08/19/2020, 11:20 PMCharles Leung
08/21/2020, 1:56 PMMatt Allen
08/25/2020, 3:34 PMError: (psycopg2.errors.SyntaxError) syntax error at or near "REFERENCING"
LINE 61: ...rting_state AFTER INSERT ON public.flow_run_state REFERENCIN...
Charles Leung
08/25/2020, 9:26 PMCharles Leung
08/27/2020, 3:39 PMCharles Leung
08/27/2020, 6:07 PMcomet
08/28/2020, 2:29 AMUnexpected error: AttributeError("'NoneType' object has no attribute 'is_finished'")
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/prefect/engine/runner.py", line 48, in inner
new_state = method(self, state, *args, **kwargs)
File "/usr/local/lib/python3.7/site-packages/prefect/engine/task_runner.py", line 359, in check_upstream_finished
if not all(s.is_finished() for s in all_states):
File "/usr/local/lib/python3.7/site-packages/prefect/engine/task_runner.py", line 359, in <genexpr>
if not all(s.is_finished() for s in all_states):
AttributeError: 'NoneType' object has no attribute 'is_finished'
any comment?Vipul
08/28/2020, 3:35 PMChris Goddard
08/29/2020, 12:28 AMDavid Stern
08/31/2020, 6:32 AM"Failed to start flow run. Please wait a few moments and try again"
😅 Any ideas with what could be wrong? Searching google and this channel didn't turn anything up :/Matt Allen
08/31/2020, 8:32 PMMatt Allen
08/31/2020, 8:32 PMKyle Moon-Wright
08/31/2020, 8:49 PM--use-volume
flag with your instance of Prefect Server, then everything should be stored in your ~/.prefect/pg_data
directory. From here, all of the configurations for your database should be stored in the postgresql.conf
file, which you should be able to adjust for the logging configurations you need. So no policy in place per se, but you should be able to adjust your db configurations there. Otherwise, deleting a flow should also delete its logs.Matt Allen
08/31/2020, 8:50 PMMikael
09/04/2020, 4:37 AMMatt Allen
09/04/2020, 3:30 PM