Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-australia
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Title
j
Josh
04/20/2022, 3:21 AMAny idea what might be causing errors with artifact generation? I’m getting these errors in my task runs:
Error during execution of task: ClientError([{'path': ['create_task_run_artifact'], 'message': 'Task run <task_run_id> not found', 'extensions': {'code': 'INTERNAL_SERVER_ERROR'}}])k
Kevin Kho
04/20/2022, 3:23 AMI think so. Artifacts are attached to tasks and use the task id as an identifier. You might be making one outside of a task?
j
Josh
04/20/2022, 5:09 PMit’s made from the task that it’s in.
Or at least I was trying to call create artifact from within the task.run method
k
Kevin Kho
04/20/2022, 5:11 PMMaybe we can try to grab it from text to pass it in manually one sec
So it’s tried to just pull it but I guess it can’t. Is that a
task.run()taskFlowj
Josh
04/20/2022, 5:16 PMsomething like
class Task():
def run():
# do something
create_markdown()
task = Task()
with Flow("my flow") as Flow:
task()k
Kevin Kho
04/20/2022, 5:17 PMThis looks pretty right to me. Would you be able to give me a minimal example?
Or I can try in a couple of hours
j
Josh
04/20/2022, 10:07 PMI don’t think this is an easily reproducable issue. The problem occurred in a few mapped tasks of a flow run. I can DM you the IDs of the tasks if you want so you can try and locate the logs of those attempts. The errors indicate that there could be something possibly logged on the prefect cloud side that might let you know what the problem was.
k
Kevin Kho
04/20/2022, 10:20 PMWe dont have any more logs than the ones you see either on your Flow. Can test this tonight.
So I got around to trying, is your code just something like this?
from prefect import Task, Flow
from prefect.backend.artifacts import create_markdown_artifact
class MyTask(Task):
def run(self, x):
create_markdown_artifact("# Heading\n\nText with [link](<https://www.prefect.io/>).")
mytask = MyTask()
with Flow("artifact_test") as flow:
mytask.map(list(range(100)))
flow.register("databricks")j
Josh
04/21/2022, 6:58 PMyeah exactly
we run it on docker agent with local dask executor if that makes any difference
k
Kevin Kho
04/21/2022, 6:59 PMI dont think the docker agent will affect but I can try the local dask executor
v
Vinny Tunnell
05/15/2022, 10:48 PMI am facing the same issue with a mapped task that calls
create_markdown_artifact