• Todd Lindstrom

    Todd Lindstrom

    1 year ago
    Dear Community - New Issue. I have created an m5.large EC2 instance and I am running conda python 3.8.8 and installed docker, docker-compose, and pip installed prefect. On the EC2 Instance I opened up port 8080 and 4200. I can get to the UI at port 8080 and I can connect to graphql, I can startup the local agent - all that works. But when I try to create a project I get errors on the console for a Foreign Key Violation..... So after a while I fired up a new ssh console and tried to create a project from the command line. And that worked fine. And then I tried to create another project again back from the UI - and this time it worked. What exactly happened? Is this normal?
    Todd Lindstrom
    bastianwegge
    5 replies
    Copy to Clipboard
  • Nathan Walker

    Nathan Walker

    1 year ago
    Hey folks, is there a way to add metadata tags/labels to Flows/Flow Groups? Adding a Label to a Flow Group has the added feature of helping decide which Agent to run on, but I'm looking for something that's purely informational. The goal is to be able to query GraphQL for flows with specific tags and do something with that list of IDs. For example, if we want to pause all jobs for Client X, but not Client Y or Z (and there's nothing in the flow naming convention to indicate), we want to be able to just run a query for all jobs with tag "Client-X" and then run a mutation to pause/delay those flows. Or maybe we want to track slow flows -- so we query for flows running 50% slower than their past monthly average runtime and add a "slow" tag so we can make some changes. Does this exist? Is there a place in a flow for arbitrary information? Maybe a "tags" parameter that just never gets used?
    Nathan Walker
    Michael Adkins
    7 replies
    Copy to Clipboard
  • Jason Prado

    Jason Prado

    1 year ago
    My prefect agent was unreachable for several hours and a bunch of jobs got queued up behind it. When the agent restarted, it ran a bunch of duplicate jobs in a row. They’re idempotent so I think they’re okay, but I’m worried I’ll introduce a bug that depends on being the only job of its kind running at the same time, and in this kind of situation something bad could happen. Can I specify that a
    Schedule
    try and run, and if it fails expire the job after 60 seconds of trying?
    Jason Prado
    Kevin Kho
    5 replies
    Copy to Clipboard
  • Robin

    Robin

    1 year ago
    Hey prefect people, a
    resource manager
    related question: I am trying to setup a resource manager to do some larger-than-memory computations within a task. I wanted to start simple, but even the example gives the following error for me:
    multiprocessing\spawn.py", line 134, in _check_not_importing_main
        raise RuntimeError('''
    RuntimeError:
            An attempt has been made to start a new process before the
            current process has finished its bootstrapping phase.
    
            This probably means that you are not using fork to start your
            child processes and you have forgotten to use the proper idiom
            in the main module:
    
                if __name__ == '__main__':
                    freeze_support()
                    ...
    
            The "freeze_support()" line can be omitted if the program
            is not going to be frozen to produce an executable.
    Robin
    Kevin Kho
    +2
    35 replies
    Copy to Clipboard
  • Adam Brusselback

    Adam Brusselback

    1 year ago
    So, one more question for the day, may not have an easy solution for Prefect atm from what i've read... What is the best way to deal with needing a persistent database connection between tasks, because those tasks are doing work within a transaction? I have some Talend jobs which currently deal with that just fine, but I simply cannot see a similar way to do it in Prefect.
    Adam Brusselback
    Kevin Kho
    +2
    22 replies
    Copy to Clipboard
  • Jonathan Chu

    Jonathan Chu

    1 year ago
    The flow run names (e.g.
    daffy-wolf
    ) already look very docker-name like It seems like it'd be pretty slick if the
    DockerAgent
    then also used the same name for launching containerized flows. Not strictly needed, and maybe only relevant for our setup where our log aggregator shows the container name that the logs came from
    Jonathan Chu
    nicholas
    +1
    19 replies
    Copy to Clipboard
  • Samuel Hinton

    Samuel Hinton

    1 year ago
    Hi all, is there a good way of deleting flows. Trying to delete a flow gives a popup error:
    We could not delete your flow. Please try again. If this problem continues, contact <mailto:help@prefect.io|help@prefect.io>
    Samuel Hinton
    ciaran
    +1
    7 replies
    Copy to Clipboard
  • Samuel Hinton

    Samuel Hinton

    1 year ago
    Hi all, Im experiencing the dread “white dashboard screen” once again (and have upgraded to v0.14.17). In the chrome extension browser I see:
    Uncaught (in promise) AuthSdkError: PKCE requires a modern browser with encryption support running in a secure context.
    The current page is not being served with HTTPS protocol. PKCE requires secure HTTPS protocol.
    Maybe this is causing issues for the dashboard (even though I can see a flows runs without issue if I navigate to the url). Currently the IP address of the server is only accessible within a VPN so we have been using http, and it used to be fine. Is there a way of saying “Dont care about this?” or a way of attaching a certificate to a given service. Very similar to this old bug here: https://github.com/PrefectHQ/ui/issues/588 Did some env vars not propagate correctly again? Confused as to why this used to work, but a redeploy from the prefect images no longer does so
    Samuel Hinton
    Jenny
    7 replies
    Copy to Clipboard
  • Jeremy Phelps

    Jeremy Phelps

    1 year ago
    Hi all, does anyone know of any condition that should cause a flow to become totally stuck? This diagram seems to indicate that all the tasks upstream from this one are done, so I'd expect that this one (or another one with no pending upstream tasks) should start running. Currently there is only one flow run, and all tasks are either completed or pending. The flow run has been idle for 8 hours. Running Prefect 0.14.2.
    Jeremy Phelps
    Kevin Kho
    +1
    82 replies
    Copy to Clipboard
  • s

    Sean Perry

    1 year ago
    Has anyone seen this message?
    TypeError: ‘ContextualVersionConflict’ object is not iterable
    I have a flow that I am trying to call
    run()
    on to run it locally.
    s
    Kevin Kho
    3 replies
    Copy to Clipboard