• Lone Pine Account

    Lone Pine Account

    1 year ago
    the DatabricksRunNow task works when part of a flow, but when part of a task I get:
  • Lone Pine Account

    Lone Pine Account

    1 year ago
    Unexpected error: AssertionError('A databricks connection string must be supplied as a dictionary or through Prefect Secrets')
  • Lone Pine Account

    Lone Pine Account

    1 year ago
    is there some scope problem here?
  • r

    Robert Bastian

    1 year ago
    Hello! I’m seeing an issue where mapped tasks are limited to 2 in Prefect Cloud but are unlimited locally. Is this a standard plan limitation?
    r
    Kevin Kho
    5 replies
    Copy to Clipboard
  • haf

    haf

    1 year ago
    I'm trying to find the
    Secrets page
    in the cloud UI: I know I've been there, but I can't for the life of me find my way back there... Where is it? Could someone provide a link? Google says nothing and the docs link back to itself.
    haf
    Kevin Kho
    6 replies
    Copy to Clipboard
  • haf

    haf

    1 year ago
    If I may point out a design inconsistency: that parameters and secrets sometimes are "values as declaration time" and sometimes "values as output by tasks" — this looks like an anti-pattern to me:
    haf
    Kevin Kho
    19 replies
    Copy to Clipboard
  • haf

    haf

    1 year ago
    When trying to set parameters in the Cloud UI, the parameters input textarea alternates between the existing value, an empty object after I start to change it (back and forth making it impossible to insert anything there)
    haf
    Jenny
    +1
    6 replies
    Copy to Clipboard
  • haf

    haf

    1 year ago
    The docs aren't reflecting the latest release, I just noticed. https://github.com/PrefectHQ/prefect/releases
    haf
    2 replies
    Copy to Clipboard
  • k

    Kha Nguyen

    1 year ago
    I have been looking at the Executor options, and there is a DaskExecutor
    executor = DaskExecutor(
        cluster_class="dask_cloudprovider.FargateCluster",
        cluster_kwargs={
            "image": "prefecthq/prefect:latest",
            "n_workers": 5,
            ...
        },
    )
    Does it mean that Prefect can also create a Dask cluster when there is some flows to run, and tear down the Dask cluster on Fargate once all flows have been run? I already have a setup using ECSAgent. Does this executor mean that I don’t need that ECS agent any longer?
  • k

    Kha Nguyen

    1 year ago
    I mainly use Prefect for forecasting. An important feature that I am looking for is to pass data (large pandas dataframe of about 1.5GB in csv, or numpy array) between tasks. Does Prefect already support serialising significant data between tasks? I saw something called PandasSerializer, but not sure what it is for.
    k
    Kevin Kho
    6 replies
    Copy to Clipboard