Hey I ve encountered a problem with prefect 2 0b12 I m runni Prefect Community #prefect-community

Hey, I've encountered a problem with prefect 2.0b1...

Andreas Nigg

07/23/2022, 6:46 AM

Hey, I've encountered a problem with prefect 2.0b12 (I'm running on prefect cloud 2.0). I changed my flow_runner configurations in my deployments to infrastructure. I'm using yaml-configuration for deployments. When trying to create the deployment with prefect deployment create <my-path>, I get the following error:

Copy code

Found 1 invalid deployments:
    1 validation error for deployment with name 'sync_goodread_score_to_volat_bigquery'
    infrastructure
      Can't instantiate abstract class Infrastructure with abstract methods preview, run (type=type_error)

Please find my deployment in the thread

✅ 1

Andreas Nigg

07/23/2022, 6:47 AM

Copy code

name: sync_goodread_score_to_volat_bigquery
flow:
  path: ./sync_drive_goodread_score.py
  name: sync_drive_goodread_score
tags:
- k8s
infrastructure: 
  type: process
schedule:
  cron: "0 2 * * *"    
  timezone: "Europe/Vienna"

Anna Geller

07/23/2022, 1:00 PM

are you on self-hosted or Cloud? let me try to reproduce that

Anna Geller

07/23/2022, 1:00 PM

btw check this if any of the changes in 2.0b12 are confusing https://discourse.prefect.io/t/prefect-2-0b12-removes-flow-runners-in-favor-of-more-flexible-infrastructure-blocks/1232

👍 1

Anna Geller

07/23/2022, 1:11 PM

ok, @Andreas Nigg I was able to reproduce - this is a bug until we fix that, could you switch to the definition in Python rather than YAML? this should work

Copy code

from prefect.infrastructure import Process
from prefect.deployments import Deployment
from prefect import flow


@flow
def hello_world():
    print("Hello world!")


Deployment(
    name="example",
    flow=hello_world,
    infrastructure=Process(),
)

Anna Geller

07/23/2022, 1:14 PM

@Marvin open "Deployments from YAML using

infrastructure

fail with: `Can't instantiate abstract class Infrastructure with abstract methods preview, run (type=type_error)`"

Marvin

07/23/2022, 1:14 PM

https://github.com/PrefectHQ/prefect/issues/6051

Andreas Nigg

07/24/2022, 5:23 AM

Thanks for investigating! Sorry for my late reply. • With regards to the chnages documentation you sent: Perfectly describes what needs to be done. • With regards to the workaround: I switched to python Deployment Definitions where I needed to specify an Infrastructure. (Like KubernetesJob). ◦ For all "Process" Deployments, I simply removed the "infrastructure" from the yaml definition - I've seen in the Source code, that Process is the default Infrastructure - so that seems fair 🙂 Thanks for your support!

🙌 1

Anna Geller

07/24/2022, 1:45 PM

nice work! Freut mich, dass ich helfen konnte 🙂

3 Views

Open in Slack

Previous Next