Thread
#prefect-community
    Laura Vaida

    Laura Vaida

    1 year ago
    hi folks, im getting this error when kicking of a registered flow from the ui, but have claimed that as dependency:
    #define executor as dask executor with tcp from load balancer
    flow.executor = DaskExecutor(address="35.198.104.230:8786") # tcp:port address of dask load balancer
    flow.storage = Docker(registry_url="<http://gcr.io/keller-steering-enabling/flows|gcr.io/keller-steering-enabling/flows>", image_name="billwerk-contracts",python_dependencies=["pandas", "oauthlib ", "requests", "requests_oauthlib", "datetime", "oauth2client", "snowflake"])
    flow.run_config = KubernetesRun()
    flow.register('Billwerk')
    m

    Mariia Kerimova

    1 year ago
    Hmm, looks like you add
    oauthlib
    in python_dependencies. Let me check with the team!
    Laura Vaida

    Laura Vaida

    1 year ago
    Step 1/9 : FROM prefecthq/prefect:0.14.6-python3.8 ---> 67415bcf7bcb Step 2/9 : ENV PREFECT__USER_CONFIG_PATH='/opt/prefect/config.toml' ---> Using cache ---> 4ffc0b7b4b6b Step 3/9 : RUN pip install pip --upgrade ---> Using cache ---> ee56fc384512 Step 4/9 : RUN pip show prefect || pip install git+https://github.com/PrefectHQ/prefect.git@0.14.6#egg=prefect[all_orchestration_extras] ---> Using cache ---> 28b18e331c74 Step 5/9 : RUN pip install pandas oauthlib requests requests_oauthlib datetime oauth2client snowflake wheel ---> Running in 10542c667971 Collecting pandas Downloading pandas-1.2.3-cp38-cp38-manylinux1_x86_64.whl (9.7 MB) Requirement already satisfied: oauthlib in /usr/local/lib/python3.8/site-packages (3.1.0) Requirement already satisfied: requests in /usr/local/lib/python3.8/site-packages (2.25.1) Requirement already satisfied: requests_oauthlib in /usr/local/lib/python3.8/site-packages (1.3.0) Collecting datetime Downloading DateTime-4.3-py2.py3-none-any.whl (60 kB) Collecting oauth2client Downloading oauth2client-4.1.3-py2.py3-none-any.whl (98 kB) Collecting snowflake Downloading snowflake-0.0.3.tar.gz (2.1 kB) Requirement already satisfied: wheel in /usr/local/lib/python3.8/site-packages (0.36.2) Requirement already satisfied: pytz in /usr/local/lib/python3.8/site-packages (from datetime) (2021.1) Collecting zope.interface Downloading zope.interface-5.2.0-cp38-cp38-manylinux2010_x86_64.whl (244 kB) Requirement already satisfied: rsa>=3.1.4 in /usr/local/lib/python3.8/site-packages (from oauth2client) (4.7) Collecting httplib2>=0.9.1 Downloading httplib2-0.19.0-py3-none-any.whl (95 kB) Requirement already satisfied: pyasn1>=0.1.7 in /usr/local/lib/python3.8/site-packages (from oauth2client) (0.4.8) Requirement already satisfied: pyasn1-modules>=0.0.5 in /usr/local/lib/python3.8/site-packages (from oauth2client) (0.2.8) Requirement already satisfied: six>=1.6.1 in /usr/local/lib/python3.8/site-packages (from oauth2client) (1.15.0) Collecting pyparsing❤️,>=2.4.2 Downloading pyparsing-2.4.7-py2.py3-none-any.whl (67 kB) Requirement already satisfied: python-dateutil>=2.7.3 in /usr/local/lib/python3.8/site-packages (from pandas) (2.8.1) Collecting numpy>=1.16.5 Downloading numpy-1.20.1-cp38-cp38-manylinux2010_x86_64.whl (15.4 MB) Requirement already satisfied: chardet<5,>=3.0.2 in /usr/local/lib/python3.8/site-packages (from requests) (4.0.0) Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.8/site-packages (from requests) (2020.12.5) Requirement already satisfied: idna❤️,>=2.5 in /usr/local/lib/python3.8/site-packages (from requests) (2.10) Requirement already satisfied: urllib3<1.27,>=1.21.1 in /usr/local/lib/python3.8/site-packages (from requests) (1.26.3) Requirement already satisfied: setuptools in /usr/local/lib/python3.8/site-packages (from zope.interface->datetime) (52.0.0) Building wheels for collected packages: snowflake Building wheel for snowflake (setup.py): started Building wheel for snowflake (setup.py): finished with status 'done' Created wheel for snowflake: filename=snowflake-0.0.3-py3-none-any.whl size=2967 sha256=c6766943e9d647295cb9c6e8c2b277afafb0e335d99d504cac809856d540ddab Stored in directory: /root/.cache/pip/wheels/df/c6/77/e7d262e8eec9b90fb1537feb30e68a3d4d007b275bab6a4788 Successfully built snowflake Installing collected packages: pyparsing, zope.interface, numpy, httplib2, snowflake, pandas, oauth2client, datetime Successfully installed datetime-4.3 httplib2-0.19.0 numpy-1.20.1 oauth2client-4.1.3 pandas-1.2.3 pyparsing-2.4.7 snowflake-0.0.3 zope.interface-5.2.0 Removing intermediate container 10542c667971 ---> a3d2f9f00820 Step 6/9 : RUN mkdir -p /opt/prefect/ ---> Running in 2f910a7a171a Removing intermediate container 2f910a7a171a ---> a0ff2ad3af64 Step 7/9 : COPY billwerk-contracts.flow /opt/prefect/flows/billwerk-contracts.prefect ---> 883240c963c8 Step 8/9 : COPY healthcheck.py /opt/prefect/healthcheck.py ---> 40b6716d48cf Step 9/9 : RUN python /opt/prefect/healthcheck.py '["/opt/prefect/flows/billwerk-contracts.prefect"]' '(3, 8)' ---> Running in 41d9f2dca7e0 Beginning health checks... System Version check: OK Cloudpickle serialization check: OK Result check: OK Environment dependency check: OK All health checks passed. Removing intermediate container 41d9f2dca7e0 ---> 7a19ffdb5c1a Successfully built 7a19ffdb5c1a Successfully tagged gcr.io/keller-steering-enabling/flows/billwerk-contracts:2021-03-02t16-38-57-079766-00-00 Pushing [==================================================>] 137.4MB Flow URL: https://cloud.prefect.io/keller-co-s-account/flow/bcf8d261-d562-40a2-9202-e8965dafb35d └── ID: 29f664ee-e6dd-4ffd-bbd8-87548240fedc └── Project: Billwerk └── Labels: []
    this is the output when registering
    m

    Mariia Kerimova

    1 year ago
    Thank you for providing more information. Looks like
    RUN pip install oauthlib
    command was successful. I'm looking into it, let you know what I will find
    Michael Adkins

    Michael Adkins

    1 year ago
    @Laura Vaida please do not open a second thread when we are already working to support you in another thread. See https://prefect-community.slack.com/archives/CL09KU1K7/p1614706866138300?thread_ts=1614619621.091000&amp;cid=CL09KU1K7