https://prefect.io logo
Powered by
Title
e

Edmondo Porcu

08/25/2022, 8:38 PM
I am not a pip expert, how do you install optional packages locally when doing development? 
pip install -e ".[dev]"
does not install the packages
✅ 1
a

Andrew Huang

08/25/2022, 8:39 PM
That should work if the setup.py includes a dev requires, e.g. https://github.com/PrefectHQ/prefect-dask/blob/main/setup.py#L29
j

Jeff Hale

08/25/2022, 8:39 PM
Make sure you’re in the folder that has a setup.py
e

Edmondo Porcu

08/25/2022, 8:39 PM
I am there. This won't install for example pydantic, that is required by Databricks tasks
a

Andrew Huang

08/25/2022, 8:40 PM
if there’s a requirements-dev.txt, you can also do 
pip install -r requirements-dev.txt
pydantic should be required by Prefect
e

Edmondo Porcu

08/25/2022, 8:40 PM
not in 1.0
extras = {
    "airtable": ["airtable-python-wrapper >= 0.11"],
    "aws": orchestration_extras["aws"],
    "azure": [
        "azure-core >= 1.10.0",
        "azure-cosmos >= 3.1.1",
        "azure-mgmt-datafactory >= 2.7.0",
    ]
    + orchestration_extras["azure"],
    "azureml": ["azureml-sdk"],
    "bitbucket": orchestration_extras["bitbucket"],
    "dask_cloudprovider": ["dask_cloudprovider[aws] >= 0.2.0"],
    "dev": dev_requires + test_requires,
    "databricks": ["pydantic >= 1.9.0"],
a

Andrew Huang

08/25/2022, 8:41 PM
oh then you might do 
pip install -e ".[databricks]"
e

Edmondo Porcu

08/25/2022, 8:41 PM
thanks
Can you point me out to the relevant documentation of pip so I learn something? 🙂
a

Andrew Huang

08/25/2022, 8:42 PM
perhaps https://pip.pypa.io/en/stable/cli/pip_install/
e

Edmondo Porcu

08/25/2022, 8:43 PM
tnx, point 7
#prefect-communityJoin Slack
Powered by