Mike Grabbe
07/26/2022, 5:39 PMSebastián Montoya Tapia
07/26/2022, 8:14 PMGeert-Jan Van den Bogaerde
07/26/2022, 9:51 PMCharles Phares
07/27/2022, 12:43 AMflow.run()
"
Yeah. Exactly.
...and where would I find these logs???Viet Nguyen
07/27/2022, 1:13 AMChris Hansen
07/27/2022, 2:25 AMFaheem Khan
07/27/2022, 3:11 AMPedro Machado
07/27/2022, 5:46 AMfiles
argument in 1.0 Docker storage). ThanksEd Burroughes
07/27/2022, 7:51 AMRiccardo Tesselli
07/27/2022, 8:59 AMResponse: {'detail': 'The request specified API version 0.7.0 but this serverrequires version 0.8.0 or higher.'}
btw I’m using default image for KubernetesJob and my code is up to date with version 2.0b15
Viet Nguyen
07/27/2022, 11:40 AMImportError: cannot import name 'DaskTaskRunner' from partially initialized module 'prefect_dask' (most likely due to a circular import)
I used 2.0b15
latest prefect-dask
on Python 3.8.13
3.9
3.8.4
3.7.13
(freshly installed Conda envs), I'm wondering if you have come across this issue before? Many thanksSana Shaikh
07/27/2022, 11:41 AMBenjamin.bgx
07/27/2022, 1:10 PMFileNotFoundError: [Errno 2] No such file or directory: 'python'
when running a flow on an agent from prefect cloud 2 ?Josh Paulin
07/27/2022, 1:27 PMThis flow is archived and cannot be run
, when I flip back to an old version. Wanted to make sure that’s always expected and I’m not just doing something wrong when registering new versions of the flow.Stephen Herron
07/27/2022, 1:46 PMprefect register flows
workflow does not appear to return an error code when the there’s a issue with deploying a flow..
Only thing I can see I’m doing differently is that i’m using a matrix to
• for each prefect project
• deploy changed flows in each project
has anyone had this problem before?Adam
07/27/2022, 3:13 PMJack Sundberg
07/27/2022, 3:52 PMJohn
07/27/2022, 4:04 PM@task
def update_task(file_type: str):
update_files(file_type=file_type)
@flow
def update_flow(file_type: str):
update_task(file_type=file_type)
if __name__ == '__main__':
update_flow(file_type="incremental")
I am running it as python -m tasks.prefect_flows.update_flow
. This takes 10+ minutes to run. By comparison, just running the same code with a click CLI takes 10s. Any idea what's going on?Chris Hansen
07/27/2022, 4:21 PMJehan Abduljabbar
07/27/2022, 5:02 PMApoorva Desai
07/27/2022, 5:55 PMMansour Zayer
07/27/2022, 8:02 PMMars
07/27/2022, 9:08 PMAnna Geller
Andreas Nigg
07/27/2022, 11:16 PMprefect deployment build ../flows/r_script_automation.py:r_script_automation --name retention_cohort_analysis_deployment -t k8s -sb gcs/gcs-prefect-stprage -i kubernetes-job
If I then run "prefect apply..." and "prefect run..:", the job gets created, however it fails with:
Flow could not be retrieved from deployment.
FileNotFoundError: [Errno 2] No such file or directory: '/home/andreas/github/r_automation/flows/r_script_automation.py'
Note, that the directory /home/andreas.... is my local flow location, where I created the deployment from. It seems that somehow the job is not downloading the flow from GCS?
My GCS storage block configuration is correct (I guess), because all my subprocess-flows work - only the KubernetesJobs have this problem. Any tips for me? 🙂Seth Coussens
07/27/2022, 11:38 PMCharles Phares
07/27/2022, 11:40 PMSlackbot
07/28/2022, 12:49 AMKelvin
07/28/2022, 2:09 AMDenys Volokh
07/28/2022, 3:38 AMKV Store operations are only supported while using Prefect Cloud as a backend
and here is my setup:
1. My flow and run config using KubernetesRun:
with Flow(
name="Import Benchmark Index Data",
storage=Local(
path="/app/workflows/benchmarks/flow_import_index_data.py",
stored_as_script=True,
),
run_config=KubernetesRun(
image="prefect-workflows:latest",
image_pull_policy="Always",
),
) as flow:
benchmarks_states = task_fetch_benchmarks_state()
2. Docker file for prefect-workflows image
FROM prefecthq/prefect:1.2.4-python3.9
WORKDIR /app
ADD . .
RUN pip install --upgrade pip
RUN pip install -r requirements.txt
RUN pip install -e .
RUN prefect backend cloud
3. Agent configuration: