• Florian Guily

    Florian Guily

    6 months ago
    Hi, i'm just getting into logging. Is there more log type than info and warning ? if so where can i find this list ?
    Florian Guily
    Anna Geller
    7 replies
    Copy to Clipboard
  • Nelson Griffiths

    Nelson Griffiths

    6 months ago
    I am running a prefect agent with Orion right now with a deployed flow. The agent runs flows just fine if I start it and go hit quick run in the UI. But if I leave the agent sitting for too long I start getting this 403 error:
    Traceback (most recent call last):
      File "/home/nelson/miniconda3/envs/my_project/lib/python3.9/site-packages/prefect/cli/base.py", line 59, in wrapper
        return fn(*args, **kwargs)
      File "/home/nelson/miniconda3/envs/my_project/lib/python3.9/site-packages/prefect/utilities/asyncio.py", line 120, in wrapper
        return run_async_in_new_loop(async_fn, *args, **kwargs)
      File "/home/nelson/miniconda3/envs/my_project/lib/python3.9/site-packages/prefect/utilities/asyncio.py", line 67, in run_async_in_new_loop
        return anyio.run(partial(__fn, *args, **kwargs))
      File "/home/nelson/miniconda3/envs/my_project/lib/python3.9/site-packages/anyio/_core/_eventloop.py", line 56, in run
        return asynclib.run(func, *args, **backend_options)
      File "/home/nelson/miniconda3/envs/my_project/lib/python3.9/site-packages/anyio/_backends/_asyncio.py", line 233, in run
        return native_run(wrapper(), debug=debug)
      File "/home/nelson/miniconda3/envs/my_project/lib/python3.9/asyncio/runners.py", line 44, in run
        return loop.run_until_complete(main)
      File "/home/nelson/miniconda3/envs/my_project/lib/python3.9/asyncio/base_events.py", line 642, in run_until_complete
        return future.result()
      File "/home/nelson/miniconda3/envs/my_project/lib/python3.9/site-packages/anyio/_backends/_asyncio.py", line 228, in wrapper
        return await func(*args)
      File "/home/nelson/miniconda3/envs/my_project/lib/python3.9/site-packages/prefect/cli/agent.py", line 71, in start
        await agent.get_and_submit_flow_runs()
      File "/home/nelson/miniconda3/envs/my_project/lib/python3.9/site-packages/prefect/agent.py", line 88, in get_and_submit_flow_runs
        submittable_runs = await self.client.get_runs_in_work_queue(
      File "/home/nelson/miniconda3/envs/my_project/lib/python3.9/site-packages/prefect/client.py", line 747, in get_runs_in_work_queue
        response = await <http://self._client.post|self._client.post>(
      File "/home/nelson/miniconda3/envs/my_project/lib/python3.9/site-packages/prefect/utilities/httpx.py", line 137, in post
        return await self.request(
      File "/home/nelson/miniconda3/envs/my_project/lib/python3.9/site-packages/prefect/utilities/httpx.py", line 80, in request
        response.raise_for_status()
      File "/home/nelson/miniconda3/envs/my_project/lib/python3.9/site-packages/httpx/_models.py", line 1510, in raise_for_status
        raise HTTPStatusError(message, request=request, response=self)
    httpx.HTTPStatusError: Client error '403 Forbidden' for url '<https://api-beta.prefect.io/api/accounts/df4b7089-cc2a-48ae-b4ce-baea44b163d6/workspaces/b22af91f-f810-4bc3-ac90-a1fa0e042c55/work_queues/c91e1439-be7e-4a98-8df0-da39515197b2/get_runs>'
    For more information check: <https://httpstatuses.com/403>
    An exception occurred.
    Any ideas what might be causing this?
    Nelson Griffiths
    Kevin Kho
    +1
    28 replies
    Copy to Clipboard
  • s

    Shrikkanth

    6 months ago
    Hi guys , Is there a Query to execute or run a prefect flow from prefect Interactive API?
    s
    Kevin Kho
    4 replies
    Copy to Clipboard
  • Chris Reuter

    Chris Reuter

    6 months ago
    Hey all! Join @Kevin Kho and myself on PrefectLive 📺 today at 3p Eastern. He'll be running through some data validation workflows, and I'll be distracting Kevin. See 👀 you in chat!
  • Kyle Austin

    Kyle Austin

    6 months ago
    Our team wrote a flow state handler that changes the new_state of the flow to Finished('message'). For some reason this causes our flows to look like they are running ad infinitum. For example The flows We ran a week ago show run duration of 7 days. But there isnt anything running as far as we can tell. Any ideas why changing the state to Finished State causes the flow runs in prefect UI to look like they are running forever? When I change our philosophy to setting the new state to Cancelled('message") we dont get see this behavior. The flow duration is exactly what it should be in that case. Just when we try to set the new state to a Finished instance.
    Kyle Austin
    Kevin Kho
    18 replies
    Copy to Clipboard
  • Daniel Komisar

    Daniel Komisar

    6 months ago
    Hello everyone, in prefect cloud is there any way to turn off the Lazarus retry? Thank you.
    Daniel Komisar
    Kevin Kho
    5 replies
    Copy to Clipboard
  • Domenico Di Gangi

    Domenico Di Gangi

    6 months ago
    Hi all, I am experimenting with orion and I find it amazing so far. I noticed that there is no mention in the orion docs of logging the stdout, as is possible in prefect 1.0 . Also
    @task(log_stdout=True)
    gives an error in orion. Is there an alternative way to log the stdout in orion ?
    Domenico Di Gangi
    Kevin Kho
    3 replies
    Copy to Clipboard
  • j

    Jake

    6 months ago
    What does it mean when there are “Late submittable runs”? Our agent was successfully registered and labelled with the right labels but the flows are not running.
    j
    Kevin Kho
    10 replies
    Copy to Clipboard
  • Florian Guily

    Florian Guily

    6 months ago
    Hello, i'm running into an issue were i have tasks that are skipped when none of their upstream tasks fail. When looking at the execution schema in the dashboard, i see that the task in charge of loading secrets like api key has been skipped because the first task that needed it has been skipped (this one is an intended behaviour). I suppose that my last task got skipped because the secret it needs as an argument has been previously skipped. Am i right ? if so how can i "force" the task to get the secret ? Here is the schema :
    Florian Guily
    Kevin Kho
    6 replies
    Copy to Clipboard
  • Rachel Funk

    Rachel Funk

    6 months ago
    Hello! We're running into the same
    no heartbeat detected
    error that I've seen a few other folks flag. I read through the discourse documentation and the FAQ. I don't think it's a memory issue because a much larger Flow is running from the same agent + Google Cloud VM without any issues. I can't seem to use the proposed solutions to configure heartbeats to use threads because I'm realizing that my Flows do not use:
    *from* prefect.run_configs
    So, I'm not using Universal Run or ECSRun. I'm guessing the setup of my flow might pre-date that library. Is that possible? Should I import that library if my Flows have been running fine without it? I should mention that this heartbeat issue only started to crop up a few days ago.
    Rachel Funk
    Kevin Kho
    15 replies
    Copy to Clipboard