tas
07/18/2022, 3:01 PMTarek
07/18/2022, 3:02 PMKubernetesRun
and Docker
registry for storage. In our Gitlab CI/CD pipeline, we want to register the flow when the feature branch is merged into main. However one problem we’re facing is that our CICD pipeline runs on docker, and since Prefect builds the docker image in the registration step, our pipeline fails (docker in docker). I’ve been looking for workaround around this and would be grateful for any ideas: I can tell you about what I have tried so far in the commentsPranit
07/18/2022, 3:18 PM-sh: prefect: command not found
Am I missing some step?Farooque Shaikh
07/18/2022, 3:37 PMrectalogic
07/18/2022, 5:49 PMScott Aefsky
07/18/2022, 6:20 PMJosh Paulin
07/18/2022, 7:50 PMTraceback (most recent call last):
File "/Users/joshuapa/.pyenv/versions/3.9.9/lib/python3.9/site-packages/prefect/client/client.py", line 1055, in create_project
res = self.graphql(
File "/Users/joshuapa/.pyenv/versions/3.9.9/lib/python3.9/site-packages/prefect/client/client.py", line 464, in graphql
raise ClientError(result["errors"])
prefect.exceptions.ClientError: [{'path': ['create_project'], 'message': 'Uniqueness violation.', 'extensions': {'code': 'INTERNAL_SERVER_ERROR'}}]
Shaoyi Zhang
07/18/2022, 8:35 PM401 unauthorized
error. This error applies to both the email invitation and the invitation in Prefect Cloud UI. A different team member was able to accept invitation to tenant A recently.Christian Nuss
07/18/2022, 8:57 PM.run(...)
on a task within a task an antipattern?Emerson Franks
07/18/2022, 11:39 PMNikolaus Landgraf
07/19/2022, 7:15 AM2.0b8
we have experienced 2 things:
• performance of single flows became around 2x slower (we are using the Sequential task runner) and have a lot of database operations in our tasks
• Some Flows get interrupted by a 403 forbidden error and do not pick up from where they were left. Is there a way of increasing the lifetime of the token?Mike Geeves
07/19/2022, 7:57 AMVlad Tudor
07/19/2022, 10:11 AMprefect server start
I get this error:
OSError: [Errno 8] Exec format error: 'docker-compose'
I suspect it might be a docker-compose
version issue, since the last version is called by running docker compose
(without -
) Should I downgrade? (Cuurently Docker Compose version v2.6.0)xyzz
07/19/2022, 10:22 AMRiccardo Tesselli
07/19/2022, 1:16 PMMatthew Seligson
07/19/2022, 2:48 PMYiwei Hou
07/19/2022, 3:06 PMMichael Reynolds
07/19/2022, 3:43 PMcheckpoint = False
flag will be introduced into orion
/ prefect 2.0?Alvaro Durán Tovar
07/19/2022, 3:47 PMprefect.exceptions.ClientError: [{'path': ['create_project'], 'message': 'Uniqueness violation.', 'extensions': {'code': 'INTERNAL_SERVER_ERROR'}}]
Michelle Brochmann
07/19/2022, 4:50 PMMichael Reynolds
07/19/2022, 5:32 PMAmogh Kulkarni
07/19/2022, 5:48 PMChu
07/19/2022, 7:35 PMwith Flow as flow:
for i in id_list:
dbt_run_function(i)
(I’m wondering if a simple for loop would achieve parallelism?)Sebastián Montoya Tapia
07/19/2022, 8:38 PMSeth Goodman
07/19/2022, 9:32 PMIlya Galperin
07/19/2022, 9:50 PMlist_sum
function in the flow. Is there a configuration I might be missing that enables this, or has there been any progress in getting the output of DaskExecutor logs into Prefect Cloud?Matthew Seligson
07/19/2022, 10:14 PMMaikel Penz
07/20/2022, 2:22 AMEmma Rizzi
07/20/2022, 7:22 AMRiccardo Tesselli
07/20/2022, 8:08 AMconfig = CustomConfig.load('my_block')
Deployment(
name="My deployment",
flow=my_flow,
parameters={
"password": config.password
}
)
when I run this command from CLI
prefect deployment create my_deployment.py
I get this error
AttributeError: 'coroutine' object has no attribute 'password'
Failed to load deployments from 'my_deployment.py'
sys:1: RuntimeWarning: coroutine 'Block.load' was never awaited
How can I do that?Riccardo Tesselli
07/20/2022, 8:08 AMconfig = CustomConfig.load('my_block')
Deployment(
name="My deployment",
flow=my_flow,
parameters={
"password": config.password
}
)
when I run this command from CLI
prefect deployment create my_deployment.py
I get this error
AttributeError: 'coroutine' object has no attribute 'password'
Failed to load deployments from 'my_deployment.py'
sys:1: RuntimeWarning: coroutine 'Block.load' was never awaited
How can I do that?Anna Geller
07/20/2022, 10:33 AMRiccardo Tesselli
07/20/2022, 11:24 AMDeployment.create()
, but now I’m facing with this error:if __name__ == '__main__':
config = CustomConfig.load('my_setup')
deployment = Deployment(
name="MyDeployment",
flow=my_flow,
parameters={
"password": config.password,
"slack_webhook": config.slack_webhook }
)
deployment.create()
and I get this
TypeError: Object of type 'AsyncWebhookClient' is not JSON serializable
if __name__ == '__main__':
config = CustomConfig.load('my_setup')
deployment = Deployment(
name="MyDeployment",
flow=my_flow,
parameters={
"password": config.password,
"slack_webhook": config.slack_webhook.url }
)
deployment.create()
Anna Geller
07/20/2022, 12:50 PM