• e

    elbaro

    1 year ago
    Hi, just wrote the first flow, the script runs the flow on its own with 0 agent and does not show up in the local UI dashboard. How to make it run on the local agent and display the runs in the dashboard? The UI only shows the flow name with 0 run.
    ...
    with Flow('flow') as flow:
        ..
    
    flow.register(project_name='project1')
    flow.run(parameters=dict(, ..))
    flow.run(parameters=dict(, ..))
    [2021-02-19 ...] INFO - prefect.TaskRunner | Task '..': Starting task run..
    [2021-02-19 ...] INFO - prefect.TaskRunner | Task '..': Finished task run for task with final state: 'Success'
    ...
    Clikcing Flow URL shows 404.
    e
    Amanda Wee
    +1
    11 replies
    Copy to Clipboard
  • JC Garcia

    JC Garcia

    1 year ago
    Hello, I am seeing flows fail if a task with an
    any_failed
    trigger is not fired because no task failed. Is there any way to fix this? docs
    JC Garcia
    nicholas
    6 replies
    Copy to Clipboard
  • Josh Greenhalgh

    Josh Greenhalgh

    1 year ago
    Hi does anyone know how I can set the node selector for the postgres that comes with the helm chart? Doesn't seem to be an option in the overrides...
    Josh Greenhalgh
    2 replies
    Copy to Clipboard
  • Diego Alonso Roque Montoya

    Diego Alonso Roque Montoya

    1 year ago
    Is there a limit to the size of the flows when pushing to the prefect server? I have a ~1500 task flow (usually 1-4 dependencies per task) that crashes graphql when I send it, but whenever I send any subparts of the graph it seems to work fine.
    Diego Alonso Roque Montoya
    nicholas
    +1
    4 replies
    Copy to Clipboard
  • Michael Hadorn

    Michael Hadorn

    1 year ago
    Hi there If I skipped some schedules in the backend, can I replan them? Even if I recreate the schedule with an other time (cron, daily) it will no recreate the skipped schedules...
    Michael Hadorn
    Dylan
    29 replies
    Copy to Clipboard
  • d

    David Car

    1 year ago
    Hello, I'm trying the tutorials and have the cloud based server instance running. The issue I'm running into is the start a local agent on my machine. I followed the directions here: https://docs.prefect.io/orchestration/tutorial/overview.html#create-a-runner-token and added the returned runner token to my ~/.prefect/config.toml. When I try to launch the local agent with: prefect agent local start I get the following stack trace:
    Traceback (most recent call last):
    File "C:\ProgramData\Miniconda3\envs\prefect\lib\site-packages\toml\decoder.py", line 511, in loads ret = decoder.load_line(line, currentlevel, multikey, File "C:\ProgramData\Miniconda3\envs\prefect\lib\site-packages\toml\decoder.py", line 778, in load_line value, vtype = self.load_value(pair[1], strictly_valid) File "C:\ProgramData\Miniconda3\envs\prefect\lib\site-packages\toml\decoder.py", line 910, in load_value raise ValueError("This float doesn't have a leading " ValueError: This float doesn't have a leading digit During handling of the above exception, another exception occurred: Traceback (most recent call last): File "C:\ProgramData\Miniconda3\envs\prefect\Scripts\prefect-script.py", line 5, in <module> from prefect.cli import cli File "C:\ProgramData\Miniconda3\envs\prefect\lib\site-packages\prefect_init.py", line 1, in <module> import prefect.utilities File "C:\ProgramData\Miniconda3\envs\prefect\lib\site-packages\prefect\utilities_init.py", line 1, in <module> import prefect.utilities.logging File "C:\ProgramData\Miniconda3\envs\prefect\lib\site-packages\prefect\utilities\logging.py", line 23, in <module> from prefect.utilities.context import context File "C:\ProgramData\Miniconda3\envs\prefect\lib\site-packages\prefect\utilities\context.py", line 69, in <module> from prefect.configuration import config File "C:\ProgramData\Miniconda3\envs\prefect\lib\site-packages\prefect\configuration.py", line 324, in <module> config = load_configuration( File "C:\ProgramData\Miniconda3\envs\prefect\lib\site-packages\prefect\configuration.py", line 300, in load_configuration user_config = load_toml(user_config_path) File "C:\ProgramData\Miniconda3\envs\prefect\lib\site-packages\prefect\configuration.py", line 177, in load_toml for key, value in toml.load(cast(str, interpolate_env_vars(path))).items() File "C:\ProgramData\Miniconda3\envs\prefect\lib\site-packages\toml\decoder.py", line 134, in load return loads(ffile.read(), _dict, decoder) File "C:\ProgramData\Miniconda3\envs\prefect\lib\site-packages\toml\decoder.py", line 514, in loads raise TomlDecodeError(str(err), original, pos) toml.decoder.TomlDecodeError: This float doesn't have a leading digit (line 3 column 1 char 39) This is on a Windows 10 machine with a conda install of prefect. Looks like it expects the token to be numeric or at least lead with a numeric value. Many thanks.
    d
    Michael Adkins
    +1
    5 replies
    Copy to Clipboard
  • d

    David Car

    1 year ago
    Quick question. Can multiple agents share the same auth token or does each have to have their own? For example, if I generate the auth token and use that for a K8S agent deployment with a replicaset of 5, can I create that deployment using that one token? Doing that only shows one agent in the Prefect Cloud server even though 5 pods exist. Thanks.
    d
    Jim Crist-Harif
    4 replies
    Copy to Clipboard
  • Sean Talia

    Sean Talia

    1 year ago
    has anyone ever had an issue with using a logger from a custom module, whereby the custom module's logs are being appropriately by agent's flow logs, but those logs seemingly do not get forwarded to your server? I do have in my config.toml:
    [logging]
    # Extra loggers for Prefect log configuration
    extra_loggers = "['custom_module']"
    # Send logs to Prefect Cloud
    log_to_cloud = true
    Sean Talia
    a
    5 replies
    Copy to Clipboard
  • Clément Chastagnol

    Clément Chastagnol

    1 year ago
    Hey there! 👋 I’ve looked in the documentation and did some google-searching but to no avail... so I’m trying my luck here 🙂 How would you go if you wanted to check a condition based on the date of the last successful run of a flow? For instance: if the data I work with wasn’t updated since the last successful run, I can skip it. My ugly simple solution at the moment is to dump a timestamp in a file somewhere. It seems that I should be able to build that using either Result or Cache, but I can’t really figure out a way to do it. I was hoping to find this information (date of last successful run of the flow) populated in
    prefect.context
    . Pointers and suggestions welcome! 🙏
    Clément Chastagnol
    Jim Crist-Harif
    4 replies
    Copy to Clipboard
  • Ondřej Melichar

    Ondřej Melichar

    1 year ago
    Hello, I was wondering if I might ask for a little assistance. I decided to try prefect.io out, so I went to the documentation site and chose a docker employment. I deployed a container via official dockerhub image and then executed "prefect backend server" and "prefect server start", which failed because there is no docker inside the prefect image nor docker-compose.