madhav
02/24/2022, 5:34 PMJack Chang
02/24/2022, 10:36 PMprefect agent docker start
is there a way I can specify the image it's pulling from?Sen
02/25/2022, 9:29 AMPending One Run Image▾
Running One image▾
Luuk
02/25/2022, 12:22 PMFailed to load and execute flow run: Exception('Azure connection string not provided. Set `AZURE_STORAGE_CONNECTION_STRING` environment variable or save connection string as Prefect secret.')
First I was working on the Local storage, but that gave me ModuleErrors and an old prefect thread explained that it should be solved through the use of Azure/Github/etc storages.
with Flow(
"extract",
storage=Azure(container="prefect-flows"),
run_config=DockerRun(image="<http://xxx.azurecr.io/extract:latest|xxx.azurecr.io/extract:latest>", labels=["extract"], env=env_config.dict()),
) as flow:
print(env_config.dict(), file=stderr)
# Prints: {'AZURE_STORAGE_CONNECTION_STRING': 'DefaultEndpointsProtocol=https;AccountName=xxxxxx==;EndpointSuffix=<http://core.windows.net|core.windows.net>'}
jack
02/25/2022, 3:00 PMFlow xxx is archived
.ash
02/27/2022, 9:43 PMBrandon Roldan
02/27/2022, 11:05 PMjack
02/28/2022, 7:33 PMprint()
statements in code and using the @task(log_stdout=True)
decorator, running a particular flow manually emits 204 log lines, whereas only 103 lines end up in prefect.Zhibin Dai
02/28/2022, 8:14 PMTypeError: the JSON object must be str, bytes or bytearray, not FunctionTask
Austin Vecchio
02/28/2022, 9:29 PMZhibin Dai
02/28/2022, 9:33 PMwith Flow(...)
block. If you're trying to run this task outside of a Flow context, you need to call `DbtShellTask(...).run(...). My code is below. Any ideas what's wrong? Thank you!Daniel Nilsen
03/01/2022, 9:54 AMAniruddha Sengupta
03/01/2022, 12:33 PMRuslan
03/01/2022, 12:35 PMHunter Ellis
03/01/2022, 11:58 PMChristian Nuss
03/02/2022, 1:19 AMprefect get flow-runs -s
i get:
prefect.exceptions.ClientError: [{'message': 'unexpected null value for type "String"', 'locations': [{'line': 2, 'column': 5}], 'path': ['flow_run'], 'extensions': {'path': '$.selectionSet.flow_run.args.where._and[0].flow._and[0].project.name._eq', 'code': 'validation-failed', 'exception': {'message': 'unexpected null value for type "String"'}}}]
any tips on how to get around this?
i do believe that prefect-server database upgrade
was run post-upgradeAniruddha Sengupta
03/02/2022, 12:42 PM["aniruddhas", "parallel_example"]
. I have an Agent whose label's are dynamically updated every time a flow is registered so that any new labels on flows are added to the agent. So now my Agent contains these labels : ["aniruddhas", "prefect_spider", "simple_news_spider", "parallel_example"]
.
I have now experimented with it and found that when my flow has just the label ["aniruddhas"]
, the Agent is able to pick them up and run them. But if the flow run has its original labels: ["aniruddhas", "parallel_example"]
, the Agent is not able to pick them up. Why is this the case?
Thanks,
AniruddhaMehdi Nazari
03/02/2022, 4:01 PMBruno Nunes
03/02/2022, 4:14 PMVishal
03/02/2022, 4:51 PMprefect docker agent start..
with some labels on my local machine, and am running into this error that I am unable to figure out. I have registered my flow, and it shows up in Prefect UI, but when I run that flow, it goes into Submitted State, and the logs of prefect docker agent show this error:
docker.errors.NotFound: 404 Client Error for <http+docker://localhost/v1.41/containers/4675972bf8cb3506f9edd11788ac666dc61cef7d896c2e5367f38e9a9f3fdea2/json>: Not Found ("No such container: 4675972bf8cb3506f9edd11788ac666dc61cef7d896c2e5367f38e9a9f3fdea2"
Zhibin Dai
03/03/2022, 2:31 PMFailed to load and execute flow run: ImportError("cannot import name 'List' from 'pip' (/usr/local/lib/python3.7/site-packages/pip/__init__.py)")
Zhibin Dai
03/03/2022, 5:08 PMrun_env = Parameter("run_env", default="DEV")
sf_user = PrefectSecret(SF_USER + "_" + run_env)
Devin Flake
03/04/2022, 6:00 PMprefect register --project "Tests" --path hello_world.py
... lots of output ...
prefect.exceptions.AuthorizationError: Malformed response received from Cloud - please ensure that you are authenticated. See `prefect auth login --help`.
Lana Dann
03/05/2022, 12:51 AMPREFECT__*
that i can use to configure prefect?Michał
03/07/2022, 7:53 AMFabrice Toussaint
03/07/2022, 9:36 AMmadhav
03/07/2022, 2:24 PMAniruddha Sengupta
03/07/2022, 2:27 PMmake_shell
. This command does not return any exit codes, so when I tried to run it as a standalone task, my server crashed. What would be the best way to ensure that this command is passed off first before executing other shell tasks?
Thanks,Liam England
03/07/2022, 4:32 PMprefect build
to generate json for flow registration? There doesn't seem to be an option in the cli as there is for local agents, unless I've missed something.Shuchita Tripathi
03/07/2022, 4:59 PM