• Carlo

    Carlo

    1 year ago
    Hi. I just upgraded my server 0.13.5, and the UI thinks the url is localhost. { "config_overrides": { "server": { "ui": { "appollo_url": true } } }, "env_vars": [], "system_information": { "platform": "Linux-4.14.193-149.317.amzn2.x86_64-x86_64-with-glibc2.10", "prefect_version": "0.13.5", "python_version": "3.7.3" } }
    Carlo
    nicholas
    +1
    12 replies
    Copy to Clipboard
  • Amanda Wee

    Amanda Wee

    1 year ago
    Hi friends, I'm quite sure I found a discussion on deploying prefect server on ECS (not directly on EC2, but as containers in ECS), including a sample config of some sort, but it seems to have disappeared probably due to the free Slack limit. Would anyone who has successfully deployed prefect server on ECS like to lend a hand? I'm taking reference from the
    docker-compose.yml
    for
    prefect server start
    to create a task definition for
    hasura
    ,
    graphql
    ,
    towel
    , and
    apollo
    containers on a single ECS service, with postgres on an aurora cluster and prefect-ui on another ECS service. Unfortunately, the hasura container keeps stopping and we aren't getting logs, so I'd like to compare with someone who has a working setup.
  • s

    Satoru Kadowaki

    1 year ago
    Hello everyone. I've been using Prefect Server for my work for the recent 2 months. So, I'd like to get Prefect-UI operation logs, such as flow run actions. How do I check that these logs? It seems to output the logs in several containers, but I don't get to know specific actions from these logs.
    s
    Dylan
    5 replies
    Copy to Clipboard
  • Josef Trefil

    Josef Trefil

    1 year ago
    Hi everyone, can anyone please help me with getting loggs from Kubernetes
    RunNamespacedJob
    to TASK RUN window in the UI? So far I'm getting just:
    12:21:32
    INFO
    RunNamespacedJob
    Job test-app has been created.
    12:21:37
    INFO
    RunNamespacedJob
    Job test-app has been completed.
    12:21:37
    INFO
    RunNamespacedJob
    Job test-app has been deleted.
    but I'd also like to see what's going on INSIDE the job itself. Thank you in advance! 🙂👍
    Josef Trefil
    Dylan
    +1
    9 replies
    Copy to Clipboard
  • David Harrington

    David Harrington

    1 year ago
    Hi! We are interested in running multiple types of Flows via the Prefect Server using the Kubernetes Agent. We understand this requires using
    Docker
    storage for each job. We construct the images ourselves and may have many flows. We want to avoid constructing a unique image for each specific Flow, and we also want to avoid creating an image that contains every flow. Instead, we want to provide a base image that the Kubernetes Agent can run, and subsequently the launched Job can ask for the necessary Flow at runtime. Ultimately, we want to avoid serializing the Flow within the built image and still use the Kubernetes Agent. A thought we had was to build an image whose entrypoint would query for the Flow, place the serialized Flow in the appropriate file location and start Prefect. Looking for any thoughts on how to best use k8s agent with these constraints! Thanks
    David Harrington
    Dylan
    4 replies
    Copy to Clipboard
  • r

    Ross Rochford

    1 year ago
    Hi everyone, I would like to use Prefect with python-trio and Im willing to develop the necessary integrations. I found some discussion on this topic and according to them, the best option is to add support for AnyIO. I think I can make progress on this with a little support. I guess a first step is to look at adapting the existing code for Twisted and Asyncio?
    r
    Michael Adkins
    +4
    17 replies
    Copy to Clipboard
  • Aiden Price

    Aiden Price

    1 year ago
    Hi Prefecters, ran into a spot of bother while trying out the spectacular new helm chart in the server repo. I am deploying it to our Azure Kubernetes Service with an Azure Managed PostgreSQL instance as the backing database. Everything went perfectly fine with the Hasura deployment, but the graphql service wouldn't start. I had a look at the logs and it was the
    db-upgrade
    initcontainer that had failed and stopped the deployment. The error mentioned an invalid character in the
    PREFECT_SERVER__DATABASE__CONNECTION_URL
    and that lead me to the fix.
  • Aiden Price

    Aiden Price

    1 year ago
    Azure Managed Postgres hands out user names in the form of;
    username@my-unique-instance-name
    , so most often you actually need to URL encode the username to avoid having two
    @
    symbols in your connection string, e.g.
    username%40my-unique-instance-name
    . This is what I did and what the
    db-upgrade
    container was upset about. I hardcoded the full connection string in the helm template with the two
    @
    symbols and it worked straight away.
  • Aiden Price

    Aiden Price

    1 year ago
    I suspect there may be an issue where Hasura would prefer URL encoding and
    db-upgrade
    prefer there would be an extra
    @
    symbol.
    Aiden Price
    Michael Adkins
    15 replies
    Copy to Clipboard
  • Adithya Ramanathan

    Adithya Ramanathan

    1 year ago
    Hi all, Had a quick question trying to better understand the difference/relationship between the object that we store in as a
    .prefect
    file in storage when submitting a flow to the server, versus the serialized variant of a flow that is used to register with the GraphQL API? To motivate the reasoning, we have a need to directly invoke the GraphQL API, and are therefore manually serializing flows ourselves. As per our current understanding, we also need to build the
    .prefect
    file in storage and make sure that is referenced in the serialization, but given the fact that the
    tasks
    are captured in the serialized flow anyway, we were curious as to what the
    .prefect
    file is used for, what other information is captured there? Mainly trying to understand why, rather than perhaps build a work around of any kind. Thanks in advance!
    Adithya Ramanathan
    j
    11 replies
    Copy to Clipboard