Kacper Kwasnioch
12/15/2023, 3:49 PMname: cross
prefect-version: 2.11.5
# build section allows you to manage and build docker images
build:
# push section allows you to manage if and how this project is uploaded to remote locations
push:
# pull section allows you to provide instructions for cloning this project in remote locations
pull:
- prefect.deployments.steps.git_clone:
repository: my-repo.git
branch: main
access_token: '{{ prefect.blocks.secret.gitlab }}'
- prefect.deployments.steps.set_working_directory:
directory: /tmp/.*/my-repo/dags/cross/
- prefect.deployments.steps.run_shell_script:
id: conda-env-setup
script: conda activate my-env
stream_output: true
# the deployments section allows you to provide configuration for deploying flows
deployments:
- name: name
version:
tags: []
description:
entrypoint: cross_flow.py:flow_cross
parameters: {}
work_pool:
name: w-p
work_queue_name: w-q
job_variables: {}
schedule:
Unfortunetly set_working_directory
show error file not found and run_shell_script
shows that i need to specify conda init before changing which also not work. Do you have any recommendation to this situation?
Thanks!Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.
Powered by