Hi, I'm trying to run DataBricks Tasks using a doc...
# prefect-community
j
Hi, I'm trying to run DataBricks Tasks using a docker agent. However the flow is failing when importting de DB tasks. When writting from prefect.tasks.databricks.databricks_get_job_id import DatabricksGetJobID, it fails with: 'ModuleNotFoundError: No module named 'pydantic''. I'm using the latest-python3.8 docker image
k
This is not include because it’s an installation extra. You can install it
pip install prefect[databricks]
that will include pydantic or you can install it yourself.
j
Thanks, I though the base image would have the dependencies. I've created a new image with the required libraries
k
It has quite a bunch but not all