https://prefect.io logo
Title
k

Karim Soliman

09/19/2022, 11:45 PM
Hi! I have a problem running a mapped "create_flow_run" on Prefect 1.0. This used to work for us and is working on a registered flow but when running local python, the task ends with status mapped and never executes the actual entities of the map. log from Prefect UI from a run on our fargate machine
16 September 2022,01:33:41 	prefect.CloudTaskRunner	INFO	Task 'create_ingestion_params': Starting task run...
16 September 2022,01:33:41 	prefect.CloudTaskRunner	INFO	Task 'create_ingestion_params': Finished task run for task with final state: 'Success'
16 September 2022,01:33:41 	prefect.CloudTaskRunner	INFO	Task 'create_flow_run': Starting task run...
16 September 2022,01:33:41 	prefect.CloudTaskRunner	INFO	Task 'create_flow_run': Finished task run for task with final state: 'Mapped'
16 September 2022,01:33:42 	prefect.CloudTaskRunner	INFO	Task 'create_flow_run[0]': Starting task run...
16 September 2022,01:33:42 	prefect.create_flow_run[0]	INFO	Creating flow run 'fierce-flounder-Tome Ingestion' for flow 'Tome Ingestion'...
16 September 2022,01:33:42 	prefect.create_flow_run[0]	INFO	Created flow run 'fierce-flounder-Tome Ingestion': <https://cloud.prefect.io/tome/flow-run/8d5af013-baa8-4830-be75-7d212a4f3e74>
16 September 2022,01:33:42 	prefect.CloudTaskRunner	INFO	Task 'create_flow_run[0]': Finished task run for task with final state: 'Success'
16 September 2022,01:33:43 	prefect.CloudTaskRunner	INFO	Task 'create_flow_run[1]': Starting task run...
16 September 2022,01:33:43 	prefect.create_flow_run[1]	INFO	Creating flow run 'fierce-flounder-Tome Ingestion' for flow 'Tome Ingestion'...
16 September 2022,01:33:43 	prefect.create_flow_run[1]	INFO	Created flow run 'fierce-flounder-Tome Ingestion': <https://cloud.prefect.io/tome/flow-run/7729a5c3-5fb3-474f-bfbc-7d2fbce841d8>
16 September 2022,01:33:44 	prefect.CloudTaskRunner	INFO	Task 'create_flow_run[1]': Finished task run for task with final state: 'Success'
log from my local python execution
[2022-09-19 23:44:08+0000] INFO - prefect.CloudTaskRunner | Task 'create_ingestion_params': Starting task run...
INFO     [task_runner.py:241] Task 'create_ingestion_params': Starting task run...
[2022-09-19 23:44:14+0000] INFO - prefect.CloudTaskRunner | Task 'create_ingestion_params': Finished task run for task with final state: 'Success'
INFO     [task_runner.py:335] Task 'create_ingestion_params': Finished task run for task with final state: 'Success'
[2022-09-19 23:44:14+0000] INFO - prefect.CloudTaskRunner | Task 'create_flow_run': Starting task run...
INFO     [task_runner.py:241] Task 'create_flow_run': Starting task run...
[2022-09-19 23:44:14+0000] INFO - prefect.CloudTaskRunner | Task 'create_flow_run': Finished task run for task with final state: 'Mapped'
INFO     [task_runner.py:335] Task 'create_flow_run': Finished task run for task with final state: 'Mapped'
[2022-09-19 23:44:15+0000] INFO - prefect.CloudTaskRunner | Task 'get_task_run_result': Starting task run...
INFO     [task_runner.py:241] Task 'get_task_run_result': Starting task run...
Code is exactly the same and I have tried running with local agent or just local python.
params = create_ingestion_params(documents, clause_snapshot_id, report_id)

    ingestion_flows = create_flow_run.map(flow_name=unmapped("Tome Ingestion"), project_name=unmapped("development"), parameters=params)

    results = get_task_run_result.map(flow_run_id=ingestion_flows, task_slug=unmapped("get_drr-1"))
m

Matt Conger

09/20/2022, 12:11 AM
Hey Karim, just to confirm, you are working with the most up-to-date version of Prefect 1.0 correct?
k

Karim Soliman

09/20/2022, 12:28 AM
Running "prefect version" shows 1.2.2!
I can try upgrading but I could have sworn it was working ~1 month ago (when I was developing the deployed flow)
upgraded to 1.4 and still the same issue
a

Anna Geller

09/20/2022, 6:27 PM
It might be an issue with the execution layer, could you share a full flow code example? ideally, a complete minimal example so that we can reproduce. you can open a GitHub issue and comment all the steps you have taken for this minimal example and share here and this way we can validate at which step something went wrong
:thank-you: 1
k

Karim Soliman

09/21/2022, 12:08 AM
Will do @Anna Geller!
a

Anna Geller

09/21/2022, 3:13 AM
Feel free to tag me there or link here
k

Karim Soliman

09/21/2022, 11:01 PM
created and linked here https://github.com/PrefectHQ/prefect/issues/6918 Happy to hop on a call as well to resolve. I did book a time tomorrow 10am to chat with prefect engineer as well!
🙌 1
a

Anna Geller

09/22/2022, 12:49 AM
Thanks a lot. We do calls only in scope of paid support channel, if you're interested you can reach out to cs@prefect.io I responded on the issue
❤️ 1