https://prefect.io logo
Docs
Join the conversationJoin Slack
Channels
announcements
ask-marvin
best-practices-coordination-plane
data-ecosystem
data-tricks-and-tips
events
find-a-prefect-job
geo-australia
geo-bay-area
geo-berlin
geo-boston
geo-chicago
geo-colorado
geo-dc
geo-israel
geo-japan
geo-london
geo-nyc
geo-seattle
geo-texas
gratitude
introductions
marvin-in-the-wild
prefect-ai
prefect-aws
prefect-azure
prefect-cloud
prefect-community
prefect-contributors
prefect-dbt
prefect-docker
prefect-gcp
prefect-getting-started
prefect-integrations
prefect-kubernetes
prefect-recipes
prefect-server
prefect-ui
random
show-us-what-you-got
Powered by Linen
ask-marvin
  • j

    Jeremiah

    01/11/2023, 5:21 PM
    @Marvin whats up
    m
    • 2
    • 3
  • k

    Kyle McChesney

    01/11/2023, 6:07 PM
    @Marvin what is the meaning of life?
    m
    j
    • 3
    • 2
  • d

    Dmytro Ponomarchuk

    01/12/2023, 1:17 PM
    @Marvin How to run a subtask from a task in Prefect 2.0?
    m
    • 2
    • 1
  • k

    Karim Amrani

    01/13/2023, 7:56 AM
    @Marvin what's the strangest question you've ever had to answer?
    m
    • 2
    • 3
  • t

    Tim-Oliver

    01/13/2023, 9:51 AM
    @Marvin How can I fix this error
    Task run 'f4eca18a-0509-46e9-b3ea-832074006308' received abort during orchestration: This run cannot transition to the RUNNING state from the RUNNING state. Task run is in RUNNING state.
    ?
    m
    j
    a
    • 4
    • 10
  • e

    Emma Rizzi

    01/26/2023, 9:36 AM
    @Marvin are you an open-source bot ?
    m
    j
    • 3
    • 8
  • d

    Dmytro Ponomarchuk

    01/26/2023, 12:39 PM
    @Marvin Why manual retries from the UI work only for flow runs triggered from deployments?
    m
    j
    • 3
    • 5
  • d

    Dmytro Ponomarchuk

    01/26/2023, 12:43 PM
    @Marvin How to retry not deployed sub-flows from the UI?
    m
    • 2
    • 1
  • s

    Slackbot

    02/01/2023, 12:29 PM
    This message was deleted.
    m
    l
    • 3
    • 2
  • l

    Luca Vehbiu

    02/01/2023, 12:32 PM
    @Marvin can you suggest a project template for a prefect etl repository
    m
    • 2
    • 1
  • e

    Emil Sorensen

    02/01/2023, 9:08 PM
    @Marvin how do I get started with prefect?
    m
    c
    • 3
    • 2
  • n

    Nate

    02/02/2023, 12:55 AM
    @Marvin how can I define a parent deployment that kicks off a bunch of child flow runs from different deployments and uses the child flow run results in the parent flow run?
    m
    • 2
    • 2
  • d

    Dmytro Ponomarchuk

    02/09/2023, 8:08 AM
    @Marvin How to stop using inactive AWS ECS TaskDefinition by a Prefect agent?
  • b

    Bigya Man Pradhan

    02/09/2023, 9:38 AM
    @Marvin How to fetch "flow name" in a running task method in Prefect 2 ?
  • d

    Dmytro Ponomarchuk

    02/09/2023, 11:45 AM
    @Marvin Are you alive?
    m
    • 2
    • 1
  • d

    Dmytro Ponomarchuk

    02/09/2023, 11:45 AM
    @Marvin How to stop using inactive AWS ECS TaskDefinition revisions by a Prefect agent?
    a
    • 2
    • 2
  • a

    Anna Geller

    02/09/2023, 12:11 PM
    @Marvin tell me how to stop using inactive AWS ECS TaskDefinition by a Prefect agent
    😆 1
  • a

    Alireza

    02/14/2023, 2:04 PM
    @Marvin I’ve got too many 429 errors on my local agent, is it because of my rate limit to call the api?
    m
    m
    • 3
    • 6
  • a

    Alireza

    02/14/2023, 8:07 PM
    @Marvin Is it possible to pass the number of DaskTaskrunner workers as a parameter of a flow?
    m
    • 2
    • 7
  • m

    Mrityunjoy Das

    02/16/2023, 7:14 AM
    @Marvin what's the possible cause for the following issue ?: Task run 'fc1c29d3-2aab-47ae-b898-c5d7604861e7' received abort during orchestration: This run cannot transition to the RUNNING state from the RUNNING state. Task run is in RUNNING state.
    m
    • 2
    • 1
  • s

    Slackbot

    02/16/2023, 12:49 PM
    This message was deleted.
    m
    • 2
    • 2
  • j

    Jen Evenson

    02/16/2023, 9:50 PM
    @Marvin How do we get
    prefect.context.flow_name
    in Prefect 2?
    m
    n
    • 3
    • 5
  • t

    Tameem Syed

    02/18/2023, 7:40 AM
    @Marvin What is equivalent of apply_map in Prefect 2?
    m
    • 2
    • 1
  • t

    Tameem Syed

    02/18/2023, 2:11 PM
    @Marvin How to programmatically create Service Accounts and Customs Roles in Prefect 2?
    m
    • 2
    • 1
  • t

    Tameem Syed

    02/18/2023, 2:16 PM
    @Marvin How to deploy Prefect 2 Agent in Azure Kubernetes Cluster using Helm Charts?
    m
    • 2
    • 1
  • s

    Slackbot

    02/18/2023, 7:15 PM
    This message was deleted.
    m
    • 2
    • 1
  • t

    Tameem Syed

    02/19/2023, 2:31 PM
    @Marvin Does Prefect 2 support imperative API?
    m
    • 2
    • 1
  • b

    Bigya Man Pradhan

    02/21/2023, 9:07 AM
    @Marvin Does prefect 2 have LOOP context?
  • j

    Joshua Grant

    02/21/2023, 9:54 PM
    @Marvin in prefect 2 what is the environmental variable to set to specify the flow path?
    m
    m
    a
    • 4
    • 27
  • j

    Jen Evenson

    02/23/2023, 10:27 PM
    @Marvin Is there a new jira integration for Prefect2?
    s
    n
    • 3
    • 10
Powered by Linen
Title
j

Jen Evenson

02/23/2023, 10:27 PM
@Marvin Is there a new jira integration for Prefect2?
s

StĂŠphan Taljaard

02/24/2023, 4:09 PM
Hi Jen. Looking at the Collections Catalog, it does not seem that the Jira has been ported from the Prefect 1 task library to Prefect 2's collections However, it should be relatively easy to create a custom task containing the old code almost unchanged. You could use a Secret block instead of the toml file
j

Jen Evenson

02/24/2023, 4:20 PM
Thanks. We did create our own Jira task, but the new Secret block doesn't read from a config file or env variable. We were hoping to not have to write our own task to do that, but it looks like we will.
s

StĂŠphan Taljaard

02/24/2023, 4:20 PM
I presume you prefer to not save the secret value itself inside the secret block?
j

Jen Evenson

02/24/2023, 4:22 PM
To set it in code, we'd have to commit it to git, so yeah, we're not doing that. And setting it in the UI looks like a manual process, which we're not interested in.
Orrrr maybe we're just not understanding the new Secret blocks. We are usually underwhelmed by the Prefect docs. Love the product, but man it's not easy to use. (Our workflows are complicated, so the tutorials are usually completely unhelpful.)
Also, thanks for taking the time to respond, even though it looks like you don't work for Prefect.
n

Nate

02/24/2023, 4:32 PM
hi @Jen Evenson - you don’t have to hard code / commit secrets to version control to save them in a secret block programmatically. you can do something like
from prefect.blocks.system import Secret

my_new_secret = Secret(value=“secret”)
my_new_secret.save(“my-new-secret”)

#so now you have a secret block saved on your workspace
assert Secret.load(“my-new-secret”).get() == “secret”
Is there a new jira integration for Prefect2?
what functionality would you like to see from a jira collection? we can work on adding a jira collection at some point
j

Jen Evenson

02/24/2023, 4:45 PM
Thanks, @Nate. The issue is getting
"secret"
to stuff into this bit:
my_new_secret = Secret(value="secret")
For Prefect 1, we were retrieving all the tokens we need from Vault when building the Prefect Docker image and setting env variables/writing to a config.toml file (I forget which we did as I didn't work on that piece) in that image - which gets deployed to our own self-hosted Prefect Cloud in k8s. The jira task then just grabbed the token it needed using the old Secret class. This also allowed each developer to set the tokens needed locally and test locally rather than having to build a new image and push to our Prefect Cloud every 5 minutes. I guess now each task that needs something from Vault will have to get it itself. We wanted to be lazy and keep getting tokens out of Vault the same way. 🙂
RE a jira collection -- We create jira tickets when certain things go wrong. (We aren't updating or closing tickets from our flows.) We already have a custom jira task because your v1 jira_task required the assignee to have a "name" property and our implementation doesn't have that. (We apparently have the largest standalone implementation of jira and it's highly customized by an internal team.) We were hoping you had a v2 jira task that would work for us so we have less code to maintain. Again, wanting to be lazy and reduce our codebase.
View count: 2