Andrew Lawlor05/13/2022, 3:10 PM
Taras Svirskyi05/13/2022, 4:05 PM
env var to point to a default location (
) before running an agent didn’t help.
Muhammad Daniyal05/13/2022, 5:29 PM
def workflow1(): @task def abc(): somelogichere with Flow('one') as f: abc() f.run() @task def xyz(): workflow1() with Flow('main flow') as f: xyz() f.run()
Benny Warlick05/13/2022, 6:21 PM
Jake05/13/2022, 6:27 PM
John Kang05/13/2022, 6:43 PM
Malthe Karbo05/13/2022, 6:52 PM
was moved into a new module (
), that is not available in 2.0b4 - even though it is available in the orion branch in the repo. I created an issue at GH also: https://github.com/PrefectHQ/prefect/issues/5787
Arnas05/13/2022, 7:27 PM
Andrew Lawlor05/13/2022, 8:46 PM
when retrying tasks run on dask. is there special configuration i need to do for a retry with dask?
Error during execution of task: KeyError(<Thread(Dask-Default-Threads-12-578, started daemon 140412823688960)>)
Frederick Thomas05/13/2022, 9:32 PM
Exception raised while calling state handlers: SystemError('unknown opcode') Traceback (most recent call last): File "/mnt/data/prefect/venv/lib/python3.8/site-packages/prefect/engine/cloud/flow_runner.py", line 119, in call_runner_target_handlers new_state = super().call_runner_target_handlers( File "/mnt/data/prefect/venv/lib/python3.8/site-packages/prefect/engine/flow_runner.py", line 116, in call_runner_target_handlers new_state = handler(self.flow, old_state, new_state) or new_state File "/mnt/data/prefect/venv3.10/lib/python3.10/site-packages/prefect/utilities/notifications/notifications.py", line 65, in state_handler def state_handler( SystemError: unknown opcode
Steve s05/14/2022, 2:48 PM
) tasks. One of these steps is followed up with a
, which has always worked without issue until today. Now it's throwing this error:
. I'm not seeing how this could be, since I can see in the logs that the upstream task did in fact finish successfully. I tried explicitly setting the result of
ValueError: The task result cannot be loaded if it is not finished
as an upstream dependency of
(which i think shouldn't be needed), and I also tried setting the
, but still no luck. Does anyone have any ideas?
Ramzi05/15/2022, 2:44 AM
I have already defined the s3 bucket as the storage in prior steps and make sure to even reset it as the default before hand. I have no problem creating the deployment locally only an issue when running it on github actions.
You have not configured default storage on the server or set a storage to use for this deployment but this deployment is using a Kubernetes flow runner which requires remote storage.
Mikkel Duif05/15/2022, 11:07 AM
import asyncio import pendulum from datetime import timedelta from prefect.orion.schemas.schedules import IntervalSchedule winter_schedule = IntervalSchedule( interval=timedelta(hours=24), anchor_date=pendulum.datetime(2022, 1, 1, 0, 30, 0, tz="Europe/Copenhagen") ) summer_schedule = IntervalSchedule( interval=timedelta(hours=24), anchor_date=pendulum.datetime(2022, 4, 1, 0, 30, 0, tz="Europe/Copenhagen") ) print(asyncio.run(winter_schedule.get_dates(1))) print(asyncio.run(summer_schedule.get_dates(1))) >>> "2022-05-16T01:30:00+02:00" >>> "2022-05-16T00:30:00+02:00"
Frank Embleton05/15/2022, 11:38 AM
Return a future
If a flow returns one or more futures, the final state is determined based on the underlying states.
```from prefect import task, flow
raise ValueError("I am bad task")
x = always_fails_task()
y = always_succeeds_task()
return y```What does it mean by futures here? My understanding was that futures are to do with threading and async in Python, of which I see neither here? What am I missing? 🤔
Raviraja Ganta05/15/2022, 5:25 PM
Nash Taylor05/15/2022, 11:44 PM
davzucky05/15/2022, 11:58 PM
Ryan Sattler05/16/2022, 4:09 AM
in the flow config env doesn’t seem to work.
Horatiu Bota05/16/2022, 10:35 AM
. I've tried various combinations of repo/project/auth credentials for Bitbucket storage, but all with the same issue - has anyone successfully set up Bitbucket storage? (using Prefect 1.1.0)
404 Client Error: Not Found for url
Pedro Machado05/16/2022, 12:05 PM
Mathijs Carlu05/16/2022, 12:12 PM
Florian Guily05/16/2022, 12:33 PM
Daniel Nilsen05/16/2022, 12:48 PM
raise signals.FAIL(message=f"Task failed") # This should log with ERROR level, not INFO
PRASHANT GARG05/16/2022, 1:18 PM
Tanasorn Chindasook05/16/2022, 2:32 PM
Wei Mei05/16/2022, 4:19 PM
Dammalapati Sai Krishna05/16/2022, 5:07 PM
Andrew Lawlor05/16/2022, 5:15 PM
in my gke logs, im seeing
Creating a new Dask cluster with `__main__.get_executor.<locals>.<lambda>`...`
raise TimeoutError( asyncio.exceptions.TimeoutError: Nanny failed to start in 60 seconds
Malthe Karbo05/16/2022, 7:32 PM
, a 403/timeout response will cause flows to fail - is there a way to see api limits for prefect orion cloud? We get forbidden (403) occasionally - it appears to be due to throttling
Dekel R05/17/2022, 6:21 AM