• h

    Hui Zheng

    1 year ago
    Hello, recently, after I switched to M1 macbook, I found my prefect flow docker build and registry often frozen at this step below
    - prefect.Docker | Pushing image to the registry...
    Does it happen to other people?
    h
    Kevin Kho
    +2
    22 replies
    Copy to Clipboard
  • a

    Abhas P

    1 year ago
    Hi ! Background : I was beginning to write a few basic tests for my flows which basically extract data from db, transform and load data back into DB.Intention : I want to test my custom flow in term of : composition, serialization and tasks in terms of : high level structuring, input/output, mapping. Is there another place or point of reference for unit testing(think of CI) real time custom flows apart from link in this page (this places essentially points out how prefect unit tests its own platform if I am not wrong).
    a
    Kevin Kho
    +2
    12 replies
    Copy to Clipboard
  • Max Kureykin

    Max Kureykin

    1 year ago
    Hi guys! The question is about prefect/dask combo. Is there any way to limit dask scheduler not to push so many tasks on workers? In prefect cloud I've found Task Concurrency feature, but I believe this stuff will not work with dask. Thx)
    Max Kureykin
    Kevin Kho
    3 replies
    Copy to Clipboard
  • Nadav Nuni

    Nadav Nuni

    1 year ago
    Hey I might have missed something in the docs, so I’ll ask here: I have a kubernetesAgent which runs all my tasks, and we want to make stuff parallel. is it ok to use the mapping features (here) with a
    LocalExecutor
    ? or is there something else I need to do? the docs here state that I need to a
    DaskExecutor
    for mapping to work…but I’m not sure which mapping, and I’m also not sure I understand why…
    Nadav Nuni
    Kevin Kho
    2 replies
    Copy to Clipboard
  • s

    Svyat

    1 year ago
    Hi all, Is there a documented recipe for deploying a Prefect flow on AWS ECS EC2? Specifically looking for a walkthrough for
    run_config
    parameters in
    ECSRun
    class
    s
    Kevin Kho
    4 replies
    Copy to Clipboard
  • Lukáš Pravda

    Lukáš Pravda

    1 year ago
    Hi all, I’m trying to get auto documentation using Sphinx from docstrings. The code base uses a lot of task decorators. I’ve done some research, but all those answers are ~ a year old, so not sure if things have not developed further. Ideally. I’d like to have a nice sphinx autogenerated documentation using automoduledirective. Based on what I’ve found here and here. I can now get nice documentation, provided I define a function manually using
    autofunction
    directive (tedious and not ideal). I can achieve a similar behaviour when I define the task using class and run() method (would require a lot of changes in the code base, so not ideal too), and I’ve also came across a plugin for celery…. So my question is: is there anything else I can do with present version of prefect to set up sphinx documentation using
    automodule
    ? If so, could you point me to the right direction/provide me with a code snippet? If not do you plan on making something like prefect-sphinx plugin, that would allow this functionality? Thanks in advance for any comment/suggestion!
    Lukáš Pravda
    Kevin Kho
    2 replies
    Copy to Clipboard
  • Jeremy Phelps

    Jeremy Phelps

    1 year ago
    Hi all, How do you authenticate to the Prefect GraphQL API using only Python's
    requests
    library? I need to cancel a bunch of flow runs but the Web interface is too cumbersome and the CLI tool doesn't support cancellation. I notice that the browser has a token that only lasts a few minutes.
    Jeremy Phelps
    Kevin Kho
    14 replies
    Copy to Clipboard
  • Anatoly Alekseev

    Anatoly Alekseev

    1 year ago
    Hi all, not a big deal, but my flows receive a label "Fields" out of nowhere. Is this expected? I don't have that label anywhere at the creation step....
    Anatoly Alekseev
    1 replies
    Copy to Clipboard
  • Anh Nguyen

    Anh Nguyen

    1 year ago
    Could you tell me how to invoke the class that is used between tasks? Thanks ya
    Anh Nguyen
    1 replies
    Copy to Clipboard
  • Sandip Viradiya

    Sandip Viradiya

    1 year ago
    Hello Everyone, I am really sorry I am asking this question in the wrong channel. I am trying to set up Prefect and using Bitbucket as storage.
    STORAGE = Bitbucket(
            project="PrefectDemoECS",                            # name of project
            repo="prefect",                          # name of repo in project
            path="demo.py",                      # location of flow file in repo
            workspace="sandipviradiya",	
            cloud_username_secret="bb_username",
            cloud_app_password_secret="bb_app_password"
        )
    It is showing me the 404 error as the given image. I checked the code https://github.com/PrefectHQ/prefect/blob/a2025983352d7e152da88358c3e578f3ce73778a/src/prefect/storage/bitbucket.py#L29 and it seems it is not selecting the Bitbucket cloud function and trying the Bitbucket server fetch only. Any guidance will be really helpful.
    Sandip Viradiya
    Kevin Kho
    10 replies
    Copy to Clipboard