• r

    Richard Hughes

    2 years ago
    Hi All,
  • r

    Richard Hughes

    2 years ago
    is there a way to make the prefect logs in the ui display in ms or does this even log at this granularity?
    r
    Jenny
    6 replies
    Copy to Clipboard
  • j

    josh

    2 years ago
    Hey team, recently some users have been asking us to announce core releases here on a regular cadence so we are going to start doing that again! Just released
    0.13.3
    and here are a few notable changes: 🌲  More control over log levels 📦  Pass any arguments to Docker tasks 🔑  Fixed caching when no cache_key is present A big thank you to our contributors who helped out with this release! Full changelog:
  • bral

    bral

    2 years ago
    Is there right way to check executions on dask cluster? My flow:
    from prefect import task, Flow, case, Task
    from random import randint
    from prefect.schedules import IntervalSchedule
    from datetime import timedelta
    from prefect.engine.executors import DaskExecutor
    from prefect.environments import LocalEnvironment
    
    
    class Preprocess:
        def __init__(self, number):
            print(number)
            self.number = number
            self.data = None
    
        def read_file(self):
            self.data = self.number
    
        def preprocess_file(self):
            self.data = self.data * 2
    
        def save_file(self):
            self.data = self.data / 3
    
    
    @task
    def is_running():
        return False
    
    @task
    def get_files():
        return [i for i in range(0, randint(0, 15))]
    
    @task
    def _print(lst):
        print(lst)
        print(len(lst))
    
    @task
    def etl(file):
        prep = Preprocess(file)
        prep.read_file()
        prep.preprocess_file()
        prep.save_file()
    
    
    executor = DaskExecutor(address="<tcp://localhost:8786>")
    schedule = IntervalSchedule(interval=timedelta(seconds=5))
    local = LocalEnvironment(executor=executor)
    
    with Flow("process", schedule=schedule, environment=local) as flow:
        condition = is_running()
        with case(condition, False) as cond:
            files = get_files()
            _print(files)
            etl.map(files)
    
    flow.run()
    Accorging tuto : https://docs.prefect.io/core/advanced_tutorials/dask-cluster.html I started scheduler and 2 workers , and after looked at the boker-web ui. But Tasks are empy on ui.
    bral
    Jim Crist-Harif
    2 replies
    Copy to Clipboard
  • Will Goldstein

    Will Goldstein

    2 years ago
    Hi all! Is this an okay place to ask getting-started questions?
    Will Goldstein
    Jenny
    2 replies
    Copy to Clipboard
  • Will Goldstein

    Will Goldstein

    2 years ago
    I'm trying to get started with the kubernetes agent locally (and just
    prefect server start
    for the scheduler) it keeps firing up pods that try to connect to localhost:4200 for the graphql endpoint and failing because they can't access
    localhost
    from inside a pod. Is there a way to specify the endpoint the pods should be trying to connect to (e.g. to kubernetes.docker.internalinstead)?
    Will Goldstein
    Jim Crist-Harif
    2 replies
    Copy to Clipboard
  • Will Goldstein

    Will Goldstein

    2 years ago
    Tried reading through the docs and the source but I didn't see anything, so I figured I must be trying to do something non-standard
  • Cody Kaiser

    Cody Kaiser

    2 years ago
    Hi all. Using Prefect Cloud i've setup a user with read-only role, but they can't see any projects. Doesn't read-only allow them to see everything in the cloud? If not how to apply those permissions?
    Cody Kaiser
    Jim Crist-Harif
    6 replies
    Copy to Clipboard
  • c

    Chris Marchetti [Datateer]

    2 years ago
    I am having an issue where I created an account using google and then was sent an invitation to my organization's (Datateer) prefect. I followed the invitation and in messages it says that I have joined the group, but I can't see any of the organization's materials. Thanks for the help!
    c
    Chris White
    9 replies
    Copy to Clipboard
  • dennis

    dennis

    2 years ago
    Hi all, does prefect provide the feature like ""depends_on_past=True"" in Airflow when running flows on schedule? Thanks for the help!!
    dennis
    Jeremiah
    2 replies
    Copy to Clipboard