Jenia Varavva
08/01/2022, 6:12 AMJenia Varavva
08/01/2022, 6:25 AMAnat Tal Gagnon
08/01/2022, 7:42 AMroot@24dc674d1f7d:/flows# cat flow1.py
from prefect import flow
@flow
def my_favorite_function():
print("What is your favorite number?")
return 42
print(my_favorite_function())
Beizhen
08/01/2022, 7:47 AM14:25:23 INFO Submitted for execution: Job prefect-job-2444a873
14:25:49 ERROR Failed to load and execute flow run: ConnectionError(MaxRetryError("HTTPSConnectionPool(host='<http://www.scorpiotankers.com|www.scorpiotankers.com>', port=443): Max retries exceeded with url: /our-fleet/ (Caused by NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7efdbc010d00>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution'))"))
14:26:00 INFO Beginning Flow run for 'Destination Predict'
14:26:00 DEBUG Using executor type LocalDaskExecutor
14:26:00 INFO Flow run has already finished.
14:26:32 ERROR k8s-infra Pod prefect-job-2444a873-8887r failed.
Container 'flow' state: terminated
Exit Code:: 1
Reason: Error
The specific error seems to reflect code from another unrelated flow. Any idea how one flow can throw an error in several other completely unrelated flows? before even the flow starts?Toby Rahloff
08/01/2022, 8:09 AMOscar Björhn
08/01/2022, 8:50 AMMarius Haberstock
08/01/2022, 9:19 AMlog_to_stdout
Parameter which automatically logs all print statements. Is there something similar for Prefect 2?Martin T
08/01/2022, 9:42 AMMohamed Alaa
08/01/2022, 10:41 AMflow.visuallize()
And also im really loving prefect and cannot wait to start working with it and exploring
Thanks alotPierre Monico
08/01/2022, 11:01 AMRiccardo Tesselli
08/01/2022, 11:51 AMtest
of a custom block type Config
, and when trying to load its values within a flow with Config.load('test')
I get this error:
except prefect.exceptions.ObjectNotFound as e:
> raise ValueError(
f"Unable to find block document named {block_document_name} for block type {block_type_slug}"
) from e
E ValueError: Unable to find block document named test for block type config
Eli Treuherz
08/01/2022, 11:55 AMScott White
08/01/2022, 12:13 PMRio McMahon
08/01/2022, 1:46 PMBilly McMonagle
08/01/2022, 2:29 PMChris Reuter
08/01/2022, 2:31 PMDominik Wagner
08/01/2022, 3:19 PMprefect deployment build…
command? i.e. i have something like this in a bash script:
prefect deployment build flows/dbt_flow.py:dbt_primary_flow \
--name prod_flow \
--tag dbt \
--tag prod \
--tag daily \
-sb gcs/gcs-block \
-ib kubernetes-job/k8s-block
And I’d like to add something like --schedule "cron/0 7 * * */Europe/Berlin"
If that’s not possible I guess I have to manually edit the deployment.yaml - if that’s the case, can I just put a cron expression in there, or do I need something else? I can’t find any examples in the docs, but maybe I’m just blind? 🙃Florian Kühnlenz
08/01/2022, 3:26 PMStephen Herron
08/01/2022, 3:31 PMRuntimeError: Set changed size during iteration
Worker information:
Approximate queue length: 0
Pending log batch length: 0
Pending log batch size: 0
I’m not trying to do anything with async but that appears to be where this is coming from (I guess it’s used via the snowflake-prefect
integration?Chu
08/01/2022, 3:51 PMHafsa Junaid
08/01/2022, 4:24 PM$ prefect backend server
Oleg Sheyner
08/01/2022, 4:52 PMEli Treuherz
08/01/2022, 5:19 PMMatthew Millendorf
08/01/2022, 5:34 PMYupei Chen
08/01/2022, 5:40 PMJoe Goldbeck
08/01/2022, 5:47 PMXavier Witdouck
08/01/2022, 5:56 PMHafsa Junaid
08/01/2022, 6:08 PMGabriel Milan
08/01/2022, 6:18 PMYupei Chen
08/01/2022, 6:37 PMfrom prefect.filesystems import S3
s3_block = S3.load("dev")
ModuleNotFoundError: No module named ‘s3fs’
ImportError: Install s3fs to access S3
RuntimeError: File system created with scheme ‘s3’ from base path ‘s3://vodori-prefect-orion’ could not be created. You are likely missing a Python module required to use the given storage protocol.
An exception occurred.
On Prefect 2.0.1Yupei Chen
08/01/2022, 6:37 PMfrom prefect.filesystems import S3
s3_block = S3.load("dev")
ModuleNotFoundError: No module named ‘s3fs’
ImportError: Install s3fs to access S3
RuntimeError: File system created with scheme ‘s3’ from base path ‘s3://vodori-prefect-orion’ could not be created. You are likely missing a Python module required to use the given storage protocol.
An exception occurred.
On Prefect 2.0.1ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
boto3 1.24.19 requires botocore<1.28.0,>=1.27.19, but you have botocore 1.24.21 which is incompatible.
Rob Freedy
08/02/2022, 1:53 AMYupei Chen
08/02/2022, 2:00 AMredsquare
08/03/2022, 10:58 AMRob Freedy
08/03/2022, 1:02 PMpip install botocore==1.27.19
? Was this dependency previously installed in your environment?redsquare
08/03/2022, 1:13 PMRob Freedy
08/03/2022, 9:42 PMMarvin
08/03/2022, 9:42 PMRob Freedy
08/03/2022, 9:43 PMChris Pickett
08/03/2022, 11:35 PMpip uninstall s3fs gcsfs
pip install --upgrade aiobotocore boto3 aiobotocore
pip install s3fs
Alternatively, you could install an older version of s3fs that’s happy with your version of the boto packages which appears to be version `2022.5.0`:
pip install s3fs==2022.5.0
James Brady
08/12/2022, 11:42 AMpip
commands be placed?
I ran into the "No module named ‘s3fs’" error when running a flow in a kubernetes deployment – using the default docker image etc.