• Josiah Berkebile

    Josiah Berkebile

    1 year ago
    Does Prefect have something analogous to the Airflow Operator for starting, monitoring, and terminating AWS EMR clusters?
    Josiah Berkebile
    Kevin Kho
    +1
    10 replies
    Copy to Clipboard
  • Tim Chklovski

    Tim Chklovski

    1 year ago
    Has anyone experimented with rigging prefect flows which execute jupyter notebooks? We have folks who author scrapes in a no-code tool, and then they may need to set up scheduled postprocessing of incremental ingested data. Anyone doing something similar?
    Tim Chklovski
    Kevin Kho
    6 replies
    Copy to Clipboard
  • Julie Sturgeon

    Julie Sturgeon

    1 year ago
    @channel Experiencing a weird issue with Prefect Cloud. We have twice experienced flows that have stopped scheduling themselves ~1.5 hours after the scheduler is enabled (see image). This flow was deployed yesterday afternoon and is scheduled to run every 10 minutes. The first instance of schedule “running out” happened at 2:40 PM (PST). Disabling and renabling the flow schedule allowed more flow runs to be schedule. This happened again at 4:40 PM PST. Tagging @nicholas and also going to follow up with sales@prefect.io. Hoping to get this resolved soon so my devs and I can avoid flipping switches every 1.5 hours and enjoy our long weekend 😉
    Julie Sturgeon
    Jeremiah
    4 replies
    Copy to Clipboard
  • o

    Omar Sultan

    1 year ago
    Hi Everyone, I am using Webhook Storage to register flows on our onprem prefect server, and the flows are configured to used Kubernetes Run .. .I am trying to understand who does the actual GET API Call to the webhook to download the file (Agent Pod, Job Pod) and when does that happen? Does it happen when the flow is about to run or when the flow is being registered?
    o
    Kevin Kho
    2 replies
    Copy to Clipboard
  • o

    Omar Sultan

    1 year ago
    I'm wondering if anyone has a custom job_template YAML for KubernetesConfig that they used to assign some environment variables. I can find it in the documentation for the legacy components but not for the current one. Thanks
    o
    Kevin Kho
    4 replies
    Copy to Clipboard
  • Hari Krishna Sunkari

    Hari Krishna Sunkari

    1 year ago
    Using prefect, is it possible to implement tasks in different programming languages, we already have our business login in Nodejs and I couldn't find any docs related to this
    Hari Krishna Sunkari
    John Shearer
    2 replies
    Copy to Clipboard
  • Benjamin Rousselière

    Benjamin Rousselière

    1 year ago
    Hi ! I'm trying to register a flow from a flask API. This flow register successfully, but i always get an error in the prefect logs (c.f. picture). Do you have any idea ? Tell me if you need more informations.
    Benjamin Rousselière
    Kevin Kho
    10 replies
    Copy to Clipboard
  • Benjamin Rousselière

    Benjamin Rousselière

    1 year ago
    Thanks you !
  • Michael

    Michael

    1 year ago
    I have a (maybe silly) question. Is it expected that when mapping tasks, the flow exists when the first element of the map succeeds (i.e. the first branch of the reference task)? That seems to be what’s happening to me, but perhaps I’ve missed an implementation detail. As a followup, if I want to wait for all mapped results, do I have to make the final reference task a reduction over upstream mapped results?
    Michael
    3 replies
    Copy to Clipboard
  • Michael Hadorn

    Michael Hadorn

    1 year ago
    Hi there I'm facing again this error with the current version 0.15.5:
    requests.exceptions.ConnectionError: HTTPConnectionPool(host='host.docker.internal', port=4200): Max retries exceeded with url: / (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f43cca967c0>: Failed to establish a new connection: [Errno 111] Connection refused'))
    First time i got this was in 0.14.19, but not in 0.15.4.
    Michael Hadorn
    Kevin Kho
    9 replies
    Copy to Clipboard