Riccardo Tesselli
08/01/2022, 11:51 AMtest
of a custom block type Config
, and when trying to load its values within a flow with Config.load('test')
I get this error:
except prefect.exceptions.ObjectNotFound as e:
> raise ValueError(
f"Unable to find block document named {block_document_name} for block type {block_type_slug}"
) from e
E ValueError: Unable to find block document named test for block type config
Eli Treuherz
08/01/2022, 11:55 AMScott White
08/01/2022, 12:13 PMRio McMahon
08/01/2022, 1:46 PMBilly McMonagle
08/01/2022, 2:29 PMChris Reuter
08/01/2022, 2:31 PMDominik Wagner
08/01/2022, 3:19 PMprefect deployment build…
command? i.e. i have something like this in a bash script:
prefect deployment build flows/dbt_flow.py:dbt_primary_flow \
--name prod_flow \
--tag dbt \
--tag prod \
--tag daily \
-sb gcs/gcs-block \
-ib kubernetes-job/k8s-block
And I’d like to add something like --schedule "cron/0 7 * * */Europe/Berlin"
If that’s not possible I guess I have to manually edit the deployment.yaml - if that’s the case, can I just put a cron expression in there, or do I need something else? I can’t find any examples in the docs, but maybe I’m just blind? 🙃Florian Kühnlenz
08/01/2022, 3:26 PMStephen Herron
08/01/2022, 3:31 PMRuntimeError: Set changed size during iteration
Worker information:
Approximate queue length: 0
Pending log batch length: 0
Pending log batch size: 0
I’m not trying to do anything with async but that appears to be where this is coming from (I guess it’s used via the snowflake-prefect
integration?Chu
08/01/2022, 3:51 PMHafsa Junaid
08/01/2022, 4:24 PM$ prefect backend server
Oleg Sheyner
08/01/2022, 4:52 PMEli Treuherz
08/01/2022, 5:19 PMMatthew Millendorf
08/01/2022, 5:34 PMYupei Chen
08/01/2022, 5:40 PMJoe Goldbeck
08/01/2022, 5:47 PMXavier Witdouck
08/01/2022, 5:56 PMHafsa Junaid
08/01/2022, 6:08 PMGabriel Milan
08/01/2022, 6:18 PMYupei Chen
08/01/2022, 6:37 PMfrom prefect.filesystems import S3
s3_block = S3.load("dev")
ModuleNotFoundError: No module named ‘s3fs’
ImportError: Install s3fs to access S3
RuntimeError: File system created with scheme ‘s3’ from base path ‘s3://vodori-prefect-orion’ could not be created. You are likely missing a Python module required to use the given storage protocol.
An exception occurred.
On Prefect 2.0.1Slackbot
08/01/2022, 6:37 PMLeon Kozlowski
08/01/2022, 6:37 PMChu
08/01/2022, 6:42 PMJonathan Mathews
08/01/2022, 7:38 PMrun_task_kwargs_path
for prefect agent ecs start
as it’s not picking up my VPC (not the default one) but the docs don’t say what format options.yml
should be in. Saw this issue here, but hasn’t been an update recently https://prefect-community.slack.com/archives/CL09KU1K7/p1653756981241529Nathan Ballou
08/01/2022, 7:52 PMFile "C:\Users\...\lib\site-packages\comet_ml\connection.py", line 35, in <module>
from comet_ml import config
File "C:\Users\...\lib\site-packages\comet_ml\config.py", line 59, in <module>
from everett.manager import ConfigIniEnv as UpstreamConfigIniEnv
ImportError: cannot import name 'ConfigIniEnv' from 'everett.manager'
Any thoughts?Leo Marvin
08/01/2022, 8:04 PMwith Flow(
"test-flow",
storage=S3(bucket="my-bucket"),
run_config=ECSRun(...)
but getting this error:
Failed to load and execute flow run: NoCredentialsError('Unable to locate credentials')
I added a Secret named AWS_CREDENTIALS
through the prefect cloud UI (https://cloud.prefect.io/team/secrets) with a json of the form
{
"ACCESS_KEY": "...",
"SECRET_ACCESS_KEY": "..."
}
but still getting this error. Curious if anyone one has tips to troubleshoot.Seth Coussens
08/01/2022, 8:48 PM'prefect.engine' is a package and cannot be directly executed
when trying to run a DockerContainer flow in Prefect 2.0?Yupei Chen
08/01/2022, 9:02 PMKyle McChesney
08/01/2022, 9:29 PMSebastián Montoya Tapia
08/01/2022, 9:33 PM