Jiaqiang Li
03/27/2024, 3:24 PMif __name__ == "__main__":
everflow_clicks_conversions_api_to_gcp.serve(
name="everflow_deployment",
cron="0 10 * * *",
tags=["testing", "tutorial"],
description="Given a GitHub repository, logs repository statistics for that repo.",
version="tutorial/deployments",
)
my deploy code Everflow_deployment_test1.py is: if __name__ == "__main__":
from prefect import flow
from prefect_gitlab.repositories import GitLabRepository
from prefect_gitlab.credentials import GitLabCredentials
from prefect.blocks.system import Secret
if __name__ == "__main__":
flow.from_source(
source=GitLabRepository(
repository="<https://gitlab.com/excelimpact/data_eng/data_etl/prefect/repository.git>",
reference="main",
credentials=GitLabCredentials(token="glpat-******-*********")
),
entrypoint="workflow/everflow_workflow_test1.py:everflow_clicks_conversions_api_to_gcp",
).deploy(
name="Everflow-deployment-test1",
work_pool_name="my-managed-pool",
cron="0 10 * * *"
)
my gitlab-ci.yml
stages:
- deploy
deploy:
stage: deploy
image: python:3.10
before_script:
- export PREFECT_API_KEY=$PREFECT_API_KEY
#- echo $PREFECT_API_KEY
- pip install -r requirements.txt
#- |
# curl -s -H "Authorization: Bearer $PREFECT_API_KEY" "<https://api.prefect.cloud/api/me/>"
- prefect cloud login --key $PREFECT_API_KEY --workspace excelimpact/default
- prefect profile inspect
script:
- python Everflow_deployment_test1.py
# - python everflow_workflow_test1.py
only:
- main # Adjust branch as needed
tags:
- k8s-runner-excel-staging
the error is: File "/builds/excelimpact/data_eng/data_etl/prefect/prefect_gitlab/repositories.py", line 202, in get_directory
raise OSError(f"Failed to pull from remote:\n {err_stream.read()}")
OSError: Failed to pull from remote:
Cloning into '/tmp/tmpmn90f52sprefect'...
remote: You are not allowed to download code from this project.
fatal: unable to access '<https://gitlab.com/excelimpact/data_eng/data_etl/prefect.git/>': The requested URL returned error: 403