• Aqib Fayyaz

    Aqib Fayyaz

    10 months ago
    can we forcefully register the flow, i have not make change to flow but to the functions that are in flow but it does not register the flow when i run the command prefect register, it skips
    Aqib Fayyaz
    Anna Geller
    2 replies
    Copy to Clipboard
  • Aqib Fayyaz

    Aqib Fayyaz

    10 months ago
    import requests
    
    query = """
     mutation {
      create_flow_run(input: { flow_id: "9479ea34-f558-4616-8e64-50c7a508787d" }) {
        id
      }
    }
    """
    
    url = "<https://api.prefect.io>"
    response = <http://requests.post|requests.post>(
        url, json={"query": query}, headers={"authorization": "Bearer your-api-key"}
    )
    print(response.status_code)
    print(response.text)
    I am using above python code to invoke flow in prefect cloud, i have given the value of Api key and changed the flow_id as well but when i run this file i get the following error 200 {"errors":[{"path":["create_flow_run"],"message":"Unauthenticated","extensions":{"code":"UNAUTHENTICATED"}}],"data":{"create_flow_run":null}}
    Aqib Fayyaz
    Kevin Kho
    8 replies
    Copy to Clipboard
  • Aqib Fayyaz

    Aqib Fayyaz

    10 months ago
    Did someone tried deploying prefect agent on GKE using skaffold.yaml file?
    Aqib Fayyaz
    Anna Geller
    2 replies
    Copy to Clipboard
  • a

    Adam Everington

    10 months ago
    Morning @Anna Geller! Quick one this morning... can you force a flow to run in the UI when it has a schedule defined within the flow? My flow runs at 8pm each night but for some reason it failed on Friday and gave an error saying Lazarus couldn't reschedule so I want to run it now. I press "Quick Run" and "Start Now" but nothing happens
    a
    Anna Geller
    5 replies
    Copy to Clipboard
  • a

    Adam Everington

    10 months ago
    I get a Failed to load and execute Flow's environment: TypeError("'type' object is not subscriptable") only on my AZ deployment of Prefect... locally it runs absolutely fine?
    a
    Anna Geller
    23 replies
    Copy to Clipboard
  • Joseph Oladokun

    Joseph Oladokun

    10 months ago
    I’m trying to deploy my flow backend to EC2, anyone has any resources to guide me?
    Joseph Oladokun
    Anna Geller
    +1
    11 replies
    Copy to Clipboard
  • g

    Greg Adams

    10 months ago
    Question about the prefect.io cloud: are there any plans for something like an “agent/compute hosting service”? Devops/infrastructure is kind of my weak point (and therefore my orgnizations’ weak point), so managing a docker instance on a VM is kind of a pain. I’d totally pay for someone to do that for me and I can just focus on the pipeline code.
    g
    Jeremiah
    +1
    6 replies
    Copy to Clipboard
  • m

    Martin Goldman

    10 months ago
    Hi all. I’m trying to figure out whether any of the Prefect products would be suitable to help me support a multi-tenant model. What I mean by that is: • I want to have a single orchestrator that’s owned/managed by me. • Each customer would have their own agent(s) which they would self host. • Each customer would have one or more flows, that only they would be able to see or run. I have 2 specific questions about this: • I see that the Cloud product offers RBAC, but I can’t figure out if that actually does what I want. I see you can create custom roles with specific permissions. But is it possible to prevent one user from seeing another user’s flows? • I understand that you could use labels to tell Customer A’s agent to only run Customer A’s flows, for example. But I don’t know if you can actually prevent Customer A from applying Customer B’s label, and then having Customer B’s flow runs go to Customer A’s agent. Is there any mechanism to lock that down?
    m
    1 replies
    Copy to Clipboard
  • j

    John Jacoby

    10 months ago
    Hi all. I'm getting an error when I try to use task mapping with multiple return values. Is this possible? This is the error: 'TypeError: Task is not iterable. If your task returns multiple results, pass 'nout' to the task decorator/constructor, or provide a 'Tuple' return-type annotation to your task.' I have done both of the suggested steps and it works for non-mapped tasks, but not on mapped tasks. Is this feature supported?
    j
    Kevin Kho
    2 replies
    Copy to Clipboard
  • Kostas Chalikias

    Kostas Chalikias

    10 months ago
    Some questions about moving off a completely local agent & execution model on Heroku, along with the cloud scheduler, to a more scalable GCP based execution model. Here is what we would like to achieve, with some questions... • Flow descriptions are read directly from Github • We build a single Docker container from our python monorepo which can be used to both resolve flows/task structure and run the tasks • We don't really need parallelisation inside a specific flow although if it's free it wouldn't hurt • However we would like to be able to scale up execution for our flows in general (on GCP), ideally without just increasing the size of a single VM. So either just scale up to as many VMs as flows running at the same time, or using a fixed pool of them. • We don't re-register/restart everything on every release like we do today to be safe that changes are picked up We've been through the docs a few times and have a few questions... • If we declare flows in our codebase, using the github storage, what causes the definition to be re-read or a new flow to be discovered? • What is the right run_config for our flows so they just run as containers with some controllable CPU/memory requirements with reasonable defaults? • What is the right type of agent? Presumably it depends on the choice of run_config. • What is the recommended way to get secrets/config env vars to the flows & running tasks?
    Kostas Chalikias
    Kevin Kho
    4 replies
    Copy to Clipboard