Justin Stanley
08/22/2022, 2:32 PMAndrew Richards
08/22/2022, 3:03 PMSam Garvis
08/22/2022, 3:56 PMmichael.urrutia
08/22/2022, 4:25 PMBalázs Aszódi
08/22/2022, 4:26 PMprefect deployment build mssql_dbx_flow.py:dbx_trigger_sync_flow -n airbyte-prefect-dbx-elt -t testing
I have created an agent already and I’m using prefect 2.1.1. I’ve attached my orion settings, as well.
Could you advise me on what am I missing?Slackbot
08/22/2022, 5:46 PMNova Westlake
08/22/2022, 5:55 PMJack Chang
08/22/2022, 6:01 PMTypeError: __init__() got an unexpected keyword argument 'add_default_labels'
My configuration looks like this:
# Configure a custom image
f.run_config = DockerRun(
labels=["grls"],
add_default_labels=False,
)
Anna Geller
Aaron Goebel
08/22/2022, 7:00 PMMichael Z
08/22/2022, 7:24 PMtrigger=any_failed
in my task. But I really only want to do something if the previous task has failed, and not consider all upstream tasks. Can someone point me in the right direction?Wei Mei
08/22/2022, 7:48 PM- name_input: field required
I see that in the do not edit below line part of the deployment.yaml it has name_input set to required.
from prefect import flow, task
from prefect.tasks import task_input_hash
from datetime import timedelta
@task(cache_key_fn=task_input_hash, cache_expiration=timedelta(minutes=1))
def hello_task(name_input):
# Doing some work
print(f"Saying hello {name_input}")
return "hello " + name_input
@flow
def hello_flow(name_input):
hello_task(name_input)
if __name__ == "__main__":
hello_flow("Marvin")
Hedgar
08/22/2022, 8:04 PMJosh Paulin
08/22/2022, 8:10 PMNathaniel Russell
08/22/2022, 8:19 PMfrom prefect import task, Parameter, Flow
from prefect.storage import S3
import prefect
@task
def main_task():
print("foobar")
logger = prefect.context.get("logger")
<http://logger.info|logger.info>("foobar")
storage = S3(bucket="prefect-task-behaviour", stored_as_script=True, local_script_path="main.py")
def build_flow():
with Flow("s3-to-prefect-flow", storage=storage) as building_flow:
main_task()
return building_flow
print(build_flow())
I have an S3 bucket with a copy of this code (named main.py) in it, yet I am not seeing it print out foobar, why is that?Neil Natarajan
08/22/2022, 8:21 PMschedule:
interval: 75
timezone:
However the flow doesn't actually run and I see a bunch of Scheduled
flow runs that eventually become Late
Paco Ibañez
08/22/2022, 9:41 PMMatt Melgard
08/22/2022, 10:39 PMJai P
08/22/2022, 11:51 PMsqlalchemy.exc.OperationalError: (sqlite3.OperationalError) database is locked
details in the thread!Rio McMahon
08/23/2022, 4:44 AMimport prefect
pc = prefect.get_client()
await pc.read_flow_runs()
it returns a cloudpickle error TypeError: __init__() missing 1 required positional argument: 'path'
(see comments for full stack trace). Previously I was using python 3.7 and was getting another cloudpickle error about version 5 not working. Other prefect client functions work (including read_flow_run
and read_flow_run_states
)
version stuff:
$ prefect version
Version: 2.1.1
API version: 0.8.0
Python version: 3.9.12
Git commit: dc2ba222
Built: Thu, Aug 18, 2022 10:18 AM
OS/Arch: darwin/x86_64
Profile: goodkiwi
Server type: hosted
$ python --version
Python 3.9.12
Any thoughts on how to fix?Daniel Sääf
08/23/2022, 9:00 AMTejal Singh
08/23/2022, 9:51 AMOwen Cook
08/23/2022, 11:02 AMSaman
08/23/2022, 11:32 AMprefect cloud login -k *** -w myaccount/test
will ask for a profile name. Is there a way to pass the profile name in the parameters?Karan
08/23/2022, 12:08 PMMia
08/23/2022, 12:31 PMTom Klein
08/23/2022, 2:11 PMRobert Esteves
08/23/2022, 2:27 PMIlya Galperin
08/23/2022, 2:40 PMprefect cloud login -k $PREFECT_API_KEY -w $PREFECT_WORKSPACE
in order to run a block.save
Python method? If we try authenticating through simply setting our default profile and running prefect config set PREFECT_API_KEY/PREFECT_API_URL
but not explicitly calling prefect cloud, we get an error when trying to save a storage block (noted in replies). Is there a recommended pattern to use for CI/CD to a save a block otherwise?Nikhil Jain
08/23/2022, 5:22 PM