Hi, I'm trying to run DataBricks Tasks using a docker agent. However the flow is failing when importting de DB tasks.
When writting from prefect.tasks.databricks.databricks_get_job_id import DatabricksGetJobID, it fails with: 'ModuleNotFoundError: No module named 'pydantic''.
I'm using the latest-python3.8 docker image
k
Kevin Kho
03/16/2022, 3:22 PM
This is not include because it’s an installation extra. You can install it
pip install prefect[databricks]
that will include pydantic or you can install it yourself.
j
Juan David Barreto
03/16/2022, 4:16 PM
Thanks, I though the base image would have the dependencies. I've created a new image with the required libraries