• Tim Enders

    Tim Enders

    6 months ago
    Is there an upper limit on what version of Prefect is compatible with Prefect Cloud? (obviously not Orion/2.0, looking at jumping to 1.1 right now)
    Tim Enders
    1 replies
    Copy to Clipboard
  • Bradley Hurley

    Bradley Hurley

    6 months ago
    Hi Folks - I have a question about using the return value from a task as input in another task. I have searched around and am not sure if I am missing something. 🧵
    Bradley Hurley
    Kevin Kho
    17 replies
    Copy to Clipboard
  • d

    David Beck

    6 months ago
    Hi, I'm working on implementing opentelemetry traces & metrics for python into my Prefect code. Are there any examples or references for how to structure flows and tasks with them? I was hoping to use state_handlers for referencing the current trace, but doesn't seem to work at all.
    d
    Kevin Kho
    +1
    8 replies
    Copy to Clipboard
  • k

    kensuke matsuura

    6 months ago
    Excuse my first question. I want to access a container that is already started in my local environment and run a job. (I don’t want to use DockerRun to create a container for each job, I want to leave the container running.) I would like to know if there is any way to achieve this with PREFECT.
    k
    Kevin Kho
    2 replies
    Copy to Clipboard
  • Mukamisha jocelyne

    Mukamisha jocelyne

    6 months ago
    Hi! I am trying to create a directory within a container, something simple that looks like the code snippet below (in the thread). The task is running successfully but failing to create the data directory. I was thinking that it's supposed to create the directory without any issue, any suggestions to what I am missing please? Thank you
    Mukamisha jocelyne
    Kevin Kho
    18 replies
    Copy to Clipboard
  • James Harr

    James Harr

    6 months ago
    Hi, I'm trying to work through the Prefect Orion tutorial for running flows in Kubernetes (https://orion-docs.prefect.io/tutorials/kubernetes-flow-runner/) and I keep running into the same problem. When I run the deployment,
    prefect deployment run test-flow/test-deployment
    , the UI shows that the flow run is Pending. When I look at the logs in Kubernetes with
    kubectl logs -l job-name=voracious-antelope2b89g
    , I see a FileNotFound stack trace Thank you for your help!
    James Harr
    Kevin Kho
    +1
    5 replies
    Copy to Clipboard
  • t

    Tomer Cagan

    6 months ago
    Hello, Trying to get a performance report based on the information executors documentation. I am getting an error - see in thread
    t
    Anna Geller
    +1
    9 replies
    Copy to Clipboard
  • Dekel R

    Dekel R

    6 months ago
    Hey, I’m trying to run a flow with LocalDaskExecutor - this is my code (simplified - I have multiple tasks after those 2)-
    CREDENTIALS_SECRET_NAME = 'PREFECT_SERVICE_ACCOUNT_CREDENTIALS'
    
    
    with Flow('comparable-products-data-extraction-development',
              storage=Docker(registry_url="us-central1-docker.pkg.dev/xxx/",
                             dockerfile="./Dockerfile"), executor=LocalDaskExecutor(scheduler="processes")) as flow:  # , schedule=daily_schedule
        raw_credentials = PrefectSecret(CREDENTIALS_SECRET_NAME)
        # raw_credentials = get_local_credentials()
        google_credentials = parse_credentials(credentials=raw_credentials)
    And here is the parse_credentials task -
    from prefect import task
    from google.oauth2 import service_account
    
    
    @task()
    def parse_credentials(credentials):
        return service_account.Credentials.from_service_account_info(credentials)
    This works fine in multiple flows when not using Dask executor - and it also runs without any problem locally when using Dask…. When running this in Prefect cloud - (PREFECT_SERVICE_ACCOUNT_CREDENTIALS is saved as a json secret, and it works in other flows) I get this Dask error - (see at the my first comment) Any solution for this? what am I missing? Thanks
    Dekel R
    Anna Geller
    5 replies
    Copy to Clipboard