Jessica Smith
01/20/2023, 7:35 PMTony Alfonse
01/20/2023, 7:46 PMBrian Roepke
01/20/2023, 7:53 PMs3fs, boto3, prefect_aws, prefect, prefect-snowflake
). But I'm running into an error when I start the Flow as a run from Prefect Cloud.
The agent will pick up the job without a problem - but I'm getting the following error: (note the blank S3 path)
Downloading flow code from storage at ''
Flow could not be retrieved from deployment.
Full dump of the error in the thread. Could anyone think of a missing dependency or authentication step I missed?
(also - if I go into python3
and run from prefect.filesystems import S3; s3_block = S3.load("s3-prefect"); print(s3_block)
that works just fine... )Aaron
01/20/2023, 8:40 PMresult
is no longer supported by prefect.orion.schemas.states.State
and will be removed in a future release. When result retrieval is needed, use prefect.states.State
.
result = await state.result(raise_on_failure=False, fetch=True)Jason Noxon
01/20/2023, 8:42 PMTadej Svetina
01/21/2023, 10:39 AMECSTask
infrastructure type?Rob Fowler
01/22/2023, 3:53 AMBrian Roepke
01/22/2023, 1:15 PMAndreas
01/23/2023, 3:12 AM_persist_result_=True
,is it possible to get that result value from the flow run using only Prefect's Orion REST API? I know that I can read the flow run state and state type using the Rest API but how can I get the actual result value using API calls?Karthik Anavarth
01/23/2023, 5:14 AMtalat
01/23/2023, 7:36 AMAnkit
01/23/2023, 8:30 AMxyzz
01/23/2023, 8:49 AMNoam Banay
01/23/2023, 10:38 AMHenning Holgersen
01/23/2023, 12:46 PMTim-Oliver
01/23/2023, 1:31 PM.git
) in the cloud UI? Can I do that or should I just wait until cloud UI is updated?
Thanks!Mohit Singhal
01/23/2023, 1:45 PMAleksandr Liadov
01/23/2023, 2:17 PMrun_deployment
? I want to deploy only parent flow, and not subflows.
allow_failure
doesnt work.
Code to show what I want in threads.Mark NS
01/23/2023, 2:18 PMcontent-type
on the uploaded file is always binary/octet-stream
s3bucket: S3 = S3.load("default")
with open(local_path, "rb") as f:
s3bucket.write_path(to_path, f.read())
Does anyone have a pointer on how to set the metadata on upload? @Marvin ?Trevor Kramer
01/23/2023, 3:39 PMAlix Cook
01/23/2023, 4:32 PMMansour Zayer
01/23/2023, 5:21 PMFlowRunFilter
. The problem is that prefect.orion.schemas.filters.FlowRunFilter
requires a parameter of type FlowRunFilterState
as state
But FlowRunFilterState
object doesn't exist in the API reference. There's only FlowRunFilterStateType
How can I create such a filter? FlowRunFilter(state=FlowRunFilterState(name='COMPLETED'))
(this doesn't work)
Thank youNimesh Kumar
01/23/2023, 5:33 PMOmar Sultan
01/23/2023, 5:45 PMSamuel Kohlleffel
01/23/2023, 6:22 PMChristina Lopez
01/23/2023, 7:26 PMscott
01/24/2023, 3:35 AMwait_for
where the tasks will be run async, but it’s not clear how to be able to use wait_for
kent
01/24/2023, 7:41 AMStephen Lloyd
01/24/2023, 8:36 AMStephen Lloyd
01/24/2023, 8:42 AMfrom atlan import atlan_flow
from prefect.deployments import Deployment
from prefect.filesystems import S3
from prefect_aws.ecs import ECSTask, AwsCredentials
aws_credentials_block = AwsCredentials.load("dev-aws-credentials")
ecs_task_block = ECSTask.load("ecs-task-poc-dev")
s3_block = S3.load("poc-s3-storage")
deployment = Deployment.build_from_flow(
flow=atlan_flow,
name='atlan poc deployment',
infrastructure=ecs_task_block,
description='a flow deployment',
tags=['poc'],
work_queue_name='poc-queue',
output=True,
apply=True,
# storage=s3_block
)