• Paul Lucas

    Paul Lucas

    2 months ago
    Hi I’m trying to implement a dbt flow that runs our process but when I look at the tasks I just get
    DbtShellTask
    which isn’t very helpful. Is there a way to rename the individual tasks to something more useful? I’ve tried using
    name
    and
    task_run_name
    arguments but without any luck.
    Paul Lucas
    Anna Geller
    2 replies
    Copy to Clipboard
  • haris khan

    haris khan

    2 months ago
    what is Perimeter class in prefect 1.0 in prefect orion ? just change it to a Task class ?
    haris khan
    Anna Geller
    3 replies
    Copy to Clipboard
  • Priyank

    Priyank

    2 months ago
    Hi there! I am running a local prefect server and now wants to collect some useful data from the database, like start_time, end_time, duration, for each and every flow and their tasks. We can clearly see this data on prefect dashboard but how I can query this data from the db. I tried listing all the tables in database but didn't get how they are linked to each other. Can you share a visual representation of how the tables in the database are linked to each other? and some queries too cause duration and other things are already on the dashboard so prefect must be querying this data somehow? or is there an easy way to get this info. And also can we get how many times a task failed? At the end we want to use this data for our analysis, how much time each task is taking and how it is changing, is there a particular time when our task fails and more? We are using prefect 1.0 for now.
    Priyank
    Sylvain Hazard
    4 replies
    Copy to Clipboard
  • Emil Barbuta

    Emil Barbuta

    2 months ago
    Hello! I'm trying to create a flow of flows in which some child flows depend on others. When trying to make 2 of them run sequentially using the following code snippet,
    wait_for_flow_run
    fails by throwing
    TypeError: Object of type FlowRunView is not JSON serializable
    . Am I passing the wrong object type as input?
    from prefect.tasks.prefect import create_flow_run, wait_for_flow_run
    
    with Flow("run-pipeline") as flow:
        flow_a_id = create_flow_run(flow_name=flow_a.name, ...[SOME INPUT PARAMS])
        flow_a_wait = wait_for_flow_run(flow_a_id)
    (I'm using prefect 1.0.0)
    Emil Barbuta
    Sylvain Hazard
    5 replies
    Copy to Clipboard
  • Josh Paulin

    Josh Paulin

    2 months ago
    Is there any documentation on which permissions the Slack app requires?
    Josh Paulin
    Kevin Kho
    4 replies
    Copy to Clipboard
  • t

    tas

    2 months ago
    Hi there! Is there a documentation on how to setup prefect server for dask cluster that is running on the same machine but in docker containers?(So scheduler is in a container and its workers are also in separate containers)? I've created that cluster using our codebase, but then whenever running the flow from Prefect UI, the task goes to dask scheduler, then worker, but then it fails with "requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=4200): Max retries exceeded with url". during initialising the run (it fails with that on dask worker). The task runs when I run it locally with flow.run(). Is there a config var that would point it to outside of dask container?
    t
    Anna Geller
    7 replies
    Copy to Clipboard
  • t

    Tarek

    2 months ago
    Hello Prefect folks! For my flow I am using
    KubernetesRun
    and
    Docker
    registry for storage. In our Gitlab CI/CD pipeline, we want to register the flow when the feature branch is merged into main. However one problem we’re facing is that our CICD pipeline runs on docker, and since Prefect builds the docker image in the registration step, our pipeline fails (docker in docker). I’ve been looking for workaround around this and would be grateful for any ideas: I can tell you about what I have tried so far in the comments
    t
    Anna Geller
    4 replies
    Copy to Clipboard
  • Pranit Sherkar

    Pranit Sherkar

    2 months ago
    I installed prefect and was able to make cloud run jobs on my local few days ago. But today I am not able to get prefect server started. It says
    -sh: prefect: command not found
    Am I missing some step?
    Pranit Sherkar
    Kevin Kho
    6 replies
    Copy to Clipboard
  • f

    Farooque Shaikh

    2 months ago
    I am trying to run a graphql query in Python using the below code: params={ "date_obj":"2022-07-18T01:32:26.584864+00:00", "curr_obj":"2022-07-18T05:32:26.584864+00:00", } query=client.graphql( { 'query($date_obj: timestamptz=': { 'flow_run(where: {start_time: {_gte: $date_obj}})': { 'flow_id' } } however the parameter value for date_obj is not getting passed. Can someone please help on this
    f
    Kevin Kho
    7 replies
    Copy to Clipboard
  • r

    rectalogic

    2 months ago
    I setup MFA for my account, but it never prompts for the token when I login. Any idea why?
    r
    Kevin Kho
    +1
    7 replies
    Copy to Clipboard