Maybe I m missing something obvious Can t seem to persist my Prefect Community #ask-community

Maybe I'm missing something obvious. Can't seem to...

An Hoang

07/20/2021, 1:26 PM

Maybe I'm missing something obvious. Can't seem to persist my task/flow result. The folder

./test_prefect

is created but nothing is outputted. Here's my very simple code:

Copy code

## test_prefect.py
result = LocalResult(dir="./test_prefect")

@task(target="func_task_target.txt", checkpoint=True, result = result)
def test(val):
    return val

with Flow("simple_test",result=result) as test_flow:
    result = test(99)
    

test_flow.run()

I did set

PREFECT__FLOWS__CHECKPOINTING=true

before doing

python test_prefect.py

Kevin Kho

07/20/2021, 1:32 PM

Hey @An Hoang, I think

LocalResult

takes in an absolute path. Could you try that?

An Hoang

07/20/2021, 1:37 PM

@Kevin Kho I tried it and still didn't work. From the tutorial it seems like it also accepts relative path? https://docs.prefect.io/core/tutorial/07-next-steps.html#storing-task-results

Kevin Kho

07/20/2021, 1:50 PM

One sec I’ll try this

Kevin Kho

07/20/2021, 1:52 PM

Your code is working for me. What Prefect version are you on?

An Hoang

07/20/2021, 2:04 PM

I'm on 0.15.1
. When I do

result.write()

it works, I thought it might have been a permission thing cause i'm ssh-ing into a server. Also did

prefect run

. No idea why it doesn't work

Kevin Kho

07/20/2021, 2:17 PM

I upgraded to test and it still works. Are you running this in the same directory as the file? Just checking if the reltive paths are what you expect.

An Hoang

07/20/2021, 2:18 PM

@Kevin Kho so I have more info: •

python test_prefect.py

with

test_flow.run()

test_prefect.py

creates the folder but not the file •

prefect run -p test_prefect.py -n "simple_test"

creates the folder but not the file. • both

prefect run -n simple_test --execute

(cloud backend) and

prefect run -n simple_test

(cloud backend with agent registered) creates the file!

Kevin Kho

07/20/2021, 2:30 PM

I tried the

prefect run -p test_prefect.py -n "simple_test"

and

prefect run -p test_prefect.py

with the copy of the code you posted and both created a file for me on 0.15.1 🤔

Kevin Kho

07/20/2021, 2:32 PM

What is your OS?

An Hoang

07/20/2021, 2:35 PM

Copy code

LSB Version:	core-9.20170808ubuntu1-noarch:printing-9.20170808ubuntu1-noarch:security-9.20170808ubuntu1-noarch
Distributor ID:	Ubuntu
Description:	Ubuntu 18.04.5 LTS
Release:	18.04
Codename:	bionic

Kevin Kho

07/20/2021, 2:46 PM

I think there shouldn’t be a problem on Ubuntu

Open in Slack

Previous Next