Ben Muller
02/03/2023, 2:11 AMState message: Flow run encountered an exception. MissingResult: State data is missing. Typically, this occurs when result persistence is disabled and the state has been retrieved from the API.
I have set prefect config set PREFECT_RESULTS_PERSIST_BY_DEFAULT=True
The only flows that fail are ones that have a large number of .submit
calls with the DaskTaskRunner
I don't really care if a few of the tasks have missing results, is there a way to handle this?
I already do something like this, but the errors still persist.
data = []
for chunk in chunks(query, 500):
futures = [query_api.submit(query=GetStockPrices, kwargs=kw, session=session) for kw in chunk]
raw += [f.result(raise_on_failure=False) for f in futures]
Task run '6a621f32-e889-4b37-a271-b38294142f4b' received abort during orchestration: Error validating state: DBAPIError("(sqlalchemy.dialects.postgresql.asyncpg.Error) <class 'asyncpg.exceptions.QueryCanceledError'>: canceling statement due to statement timeout") Task run is in RUNNING state.
Christopher Boyd
02/03/2023, 10:51 PMCarlos Cueto
02/04/2023, 3:31 PMBen Muller
02/04/2023, 7:07 PMCarlos Cueto
02/04/2023, 7:08 PMBen Muller
02/04/2023, 7:15 PMWalter Cavinaw
02/06/2023, 3:27 AMAnkit
02/06/2023, 4:25 AMCarlos Cueto
02/06/2023, 3:36 PMChristopher Boyd
02/06/2023, 3:37 PMBen Muller
02/06/2023, 6:30 PMCarlos Cueto
02/06/2023, 6:30 PMWalter Cavinaw
02/06/2023, 6:31 PMBen Muller
02/06/2023, 6:34 PMSamuel Kohlleffel
02/06/2023, 11:09 PMKaranveer Mohan
02/07/2023, 12:23 AMStéphan Taljaard
02/07/2023, 6:14 AMChristopher Boyd
02/07/2023, 11:12 AMJean-Michel Provencher
02/07/2023, 2:13 PMCarlos Cueto
02/07/2023, 2:19 PMChristopher Boyd
02/07/2023, 4:37 PMCarlos Cueto
02/07/2023, 4:37 PMChristopher Boyd
02/07/2023, 4:37 PMSamuel Kohlleffel
02/07/2023, 4:38 PMChristopher Boyd
02/07/2023, 4:50 PMNikhil Joseph
02/08/2023, 11:38 AMCarlos Cueto
02/08/2023, 2:16 PMBen Muller
02/08/2023, 6:33 PMChristopher Boyd
02/08/2023, 6:40 PMTanay Kothari
02/12/2023, 2:57 AMStéphan Taljaard
02/13/2023, 7:30 AMCarlos Cueto
02/14/2023, 1:52 PMBen Muller
02/22/2023, 10:06 PMTask run '6528d660-f15f-4cd3-bcb6-201c2a517fab' received abort during orchestration: This run cannot transition to the RUNNING state from the RUNNING state. Task run is in RUNNING state.
Jean-Michel Provencher
02/22/2023, 10:06 PMCarlos Cueto
02/22/2023, 10:06 PMBen Muller
02/22/2023, 10:12 PMChristopher Boyd
02/23/2023, 9:05 PMBen Muller
02/23/2023, 9:14 PMKalise Richmond
02/23/2023, 9:59 PMBen Muller
02/23/2023, 10:03 PMIlya Galperin
02/28/2023, 11:10 PMMissingResult
error) intermittently on 2.8.2 when submitting a large number of concurrent tasks to a DaskTaskRunner.
Are folks in this thread still experiencing the same in addition to the RUNNING state? Not sure if we should start a new thread here to continue reporting this issue, or if it related to the behavior described in issue #8602.