• e

    Erick House

    2 months ago
    When will secrets be available in the prefect cloud beta? Will the mechanisms be different from prefect 1.0? I'm not seeing anything in the docs that are specific to prefect 2.0. I do not have experience with prefect 1.0. I'm creating a prototype to see if our existing workflows can be ported over to prefect 2.0 when it's ready.
    e
    Kevin Kho
    +1
    5 replies
    Copy to Clipboard
  • Tim Helfensdörfer

    Tim Helfensdörfer

    2 months ago
    In the prefect 2b8:
    File "/Users/****/Library/Caches/pypoetry/virtualenvs/equation-kGZ4A1K9-py3.8/lib/python3.8/site-packages/prefect/cli/cloud.py", line 231, in login
        exit_with_success(
      File "/Users/****/Library/Caches/pypoetry/virtualenvs/equation-kGZ4A1K9-py3.8/lib/python3.8/site-packages/prefect/cli/_utilities.py", line 36, in exit_with_success
        app.console.print(message, **kwargs)
    AttributeError: 'PrefectTyper' object has no attribute 'console'
    When trying to run (which worked in 2b7:
    await login(
                key=os.environ.get("PREFECT_API_KEY"),
                workspace_handle=os.environ.get("PREFECT_WORKSPACE_HANDLE"),
            )
    Tim Helfensdörfer
    Kevin Kho
    +1
    6 replies
    Copy to Clipboard
  • s

    Scott Henley

    2 months ago
    Greetings, I am having an issue registering a Flow with a simple ShellTask (Prefect/Cloud 1.0). The RunConfig for the flow is pointing to a custom image in ECR that contains the binary that we are attempting to run via the shell task (using the ECSRun type). The path to the binary in the shell command does not exist locally. When I attempt to register the flow, it fails with a “no such file or directory” error. Does the register cli command attempt to verify the shell task locally? How can I get around this when I only want it to reference the location in the container image?
    s
    Kevin Kho
    16 replies
    Copy to Clipboard
  • b

    Binoy Shah

    2 months ago
    Regarding the Recent changes in Prefect Orion, Blocks - Is blocks needed if our ecosystem is Kubernetes + ConfigMap for Non-secure values and Kubernetes + Vault/Opaque secrets for Secure values ?
    b
    Kevin Kho
    3 replies
    Copy to Clipboard
  • Kevin Kho

    Kevin Kho

    2 months ago
    Thank you to everyone here! Just letting you all know July 22 will be my last day at Prefect.
    Kevin Kho
    Tom Klein
    +1
    3 replies
    Copy to Clipboard
  • o

    Omar Sultan

    2 months ago
    Hi Guys, we are currently relying on Prefect 1.2 for some critical production ETLs. We are starting to discuss whether we should consider moving to Prefect 2.0. However, I can't find anything in the documentation related to an Imperative API, Do we still have one in Prefect 2.0?
    o
    Kevin Kho
    5 replies
    Copy to Clipboard
  • Walter Cavinaw

    Walter Cavinaw

    2 months ago
    we have a schedule with two clocks: every friday, and the first of every month. Sometimes these overlap. Will prefect generate two events, or just one?
    Walter Cavinaw
    1 replies
    Copy to Clipboard
  • Apoorva Desai

    Apoorva Desai

    2 months ago
    Can we schedule flows so a new run is created as soon as the previous one finishes?
    Apoorva Desai
    Anna Geller
    +2
    7 replies
    Copy to Clipboard
  • Jack Sundberg

    Jack Sundberg

    2 months ago
    Hello! The Orion beta is amazing. Thanks for putting together such an awesome package. Could I get some feedback on the client's use with filters? I'm not sure if there's a better way to achieve what I'm doing:
    # Minimal example of my current use, where I need to build filter objects
    
    from prefect.client import get_client
    from prefect.orion.schemas.filters import FlowFilter, FlowRunFilter
    
    async with get_client() as client:
        response = await client.read_flow_runs(
            flow_filter=FlowFilter(
                name={"any_": ["example-flow"]},
            ),
            flow_run_filter=FlowRunFilter(
                state={"name": {"any_": ["Completed", "Running"]}}
            ),
        )
    Is there a way to query with the client like this instead:
    # Avoids the need to import and manually initialize FlowFilter+FlowRunFilter
    
    from prefect.client import get_client
    
    async with get_client() as client:
        response = await client.read_flow_runs(
            flow_filter={"name": {"any_": ["example-flow"]}},
            flow_run_filter={"state": {"any_": ["Completed", "Running"]}},
        )
    Or even:
    # Allows exact matching without use of {"any_": [...]}
    
    from prefect.client import get_client
    
    async with get_client() as client:
        response = await client.read_flow_runs(
            flow_filter={"name": "example-flow"},
            flow_run_filter={"state": "Completed"},
        )
    Jack Sundberg
    Anna Geller
    17 replies
    Copy to Clipboard
  • Tom Klein

    Tom Klein

    2 months ago
    Hey again 🙋 We’re trying to test out the (ad-hoc) Dask cluster option for execution but we’re getting errors it and seems like we’re missing something (code in the thread)
    Tom Klein
    Anna Geller
    +1
    75 replies
    Copy to Clipboard