Chris Goddard
09/06/2022, 10:09 PMAlexey Stoletny
09/06/2022, 10:11 PMChris Goddard
09/06/2022, 10:11 PMAlexey Stoletny
09/06/2022, 10:12 PMKhuyen Tran
09/06/2022, 10:13 PMAlexey Stoletny
09/06/2022, 10:13 PMChris Goddard
09/06/2022, 10:13 PMJeff Hale
09/06/2022, 10:16 PMKhuyen Tran
09/06/2022, 10:24 PMChris Goddard
09/06/2022, 10:24 PMAlexey Stoletny
09/06/2022, 11:16 PMChris Goddard
09/06/2022, 11:45 PMloop.create_task
to try to schedule the sub-flow but I’m getting an unknown error Crash detected! Execution was interrupted by an unexpected exception
- I feel like I’m missing something obvious. (I haven’t done much in asyncio before so it’s very possible)Pierre LIBAULT
09/07/2022, 2:22 AM2022-09-07 11:17:55,962 - distributed.worker - WARNING - Compute Failed
Key: 6b8ff000-ad9a-4de0-ac5a-0b9c35c93fe0
Function: begin_task_run
args: ()
kwargs: {'task': <prefect.tasks.Task object at 0x7ff4aaaff760>, 'task_run': TaskRun(id=UUID('44d28b18-a961-43a8-9f5f-e02134767737'), name='say_goodbye-261e56a8-0', flow_run_id=UUID('16b3db98-966b-44b6-b73b-c4ff4682c878'), task_key='__main__.say_goodbye', dynamic_key='0', cache_key=None, cache_expiration=None, task_version=None, empirical_policy=TaskRunPolicy(max_retries=0, retry_delay_seconds=0.0, retries=0, retry_delay=0), tags=[], state_id=UUID('4543c5be-881c-47e5-9464-4ef76eef5130'), task_inputs={'name': []}, state_type=StateType.PENDING, state_name='Pending', run_count=0, expected_start_time=DateTime(2022, 9, 7, 2, 17, 54, 691980, tzinfo=Timezone('+00:00')), next_scheduled_start_time=None, start_time=None, end_time=None, total_run_time=datetime.timedelta(0), estimated_run_time=datetime.timedelta(0), estimated_start_time_delta=datetime.timedelta(microseconds=56332), state=Pending(message=None, type=PENDING, result=None)), 'parameters': {'name': 'arthur'}, 'wait_for': None, 'result_filesyste':
Exception: "PermissionError(13, 'Permission denied')"
Does everyone know how I can remove this PermissionError ?
I feel that it tries to modify a file or something but I am not sure..Slackbot
09/07/2022, 8:01 AMBarada Sahu
09/07/2022, 8:20 AMPrefectFuture
to a downstream task or does the task result always get evaluated and then passed as an argument?Bal Raj
09/07/2022, 8:23 AMYu Shen
09/07/2022, 9:07 AMwonsun
09/07/2022, 9:38 AMLucien Fregosi
09/07/2022, 10:31 AMGeorgi Yanev
09/07/2022, 10:34 AMAndrew Stewart
09/07/2022, 1:25 PMJavier Ochoa
09/07/2022, 3:05 PM{
flow_group(
where: {
flows: {
project: {
name: { _eq: "sonarlink-dev" }
}
}
}
order_by: {created: desc}
limit: 100
) {
name
id
labels
schedule
flows { id name version project { id name } }
}
}
Josh Paulin
09/07/2022, 3:18 PM@task
decorator and run it like a normal function, it works as expected.
Stepping into the engine code I can see it shows a final_state
of NotReady
here.Soren Daugaard
09/07/2022, 5:01 PMPREFECT_API_KEY
from secrets manager and set it in my Python code when creating a new Prefect client.
Is something like this the right approach:
from prefect.settings import PREFECT_API_KEY
async def start_flow(flow_deployment_name, params):
secret_key = load_my_secret()
with temporary_settings(updates={PREFECT_API_KEY: secret_key}):
client = get_client()
deployment = await client.read_deployment_by_name(name=flow_deployment_name)
run = await client.create_flow_run_from_deployment(deployment.id, parameters=params)
return run.id
I want to avoid using profiles because I would like to avoid having the secret stored on disk.James Phoenix
09/07/2022, 5:48 PMGCS
storage block be used to save data?James Phoenix
09/07/2022, 5:49 PMJames Phoenix
09/07/2022, 5:49 PMfrom prefect import flow, task
from prefect.filesystems import GCS
@flow
async def analyse_youtube_video():
# 1. Download the video from YouTube and upload it to GCS
gcs_block = GCS.load("buffalo-raw-video-files")
# Make some fake JSON data:
data = {"name": "John", "age": 30, "city": "New York"}
result = await gcs_block.write_path(
"video.mp4", data)
print(result)
return 42
James Phoenix
09/07/2022, 5:49 PMsys:1: RuntimeWarning: coroutine 'create_then_begin_flow_run' was never awaited
James Phoenix
09/07/2022, 5:49 PMQwame
09/07/2022, 5:56 PMsqlite3.OperationalError: no such table: json_each
Has anyone experienced this?Qwame
09/07/2022, 5:56 PMsqlite3.OperationalError: no such table: json_each
Has anyone experienced this?Bianca Hoch
09/07/2022, 6:19 PMprefect version
?Nate
09/07/2022, 6:21 PMrm ~/.prefect/orion.db
and prefect orion database reset -y
Qwame
09/07/2022, 7:00 PMNate
09/07/2022, 7:02 PMprefect version
would be helpfulQwame
09/07/2022, 8:59 PM