Nathan Ballou
08/01/2022, 7:52 PMFile "C:\Users\...\lib\site-packages\comet_ml\connection.py", line 35, in <module>
from comet_ml import config
File "C:\Users\...\lib\site-packages\comet_ml\config.py", line 59, in <module>
from everett.manager import ConfigIniEnv as UpstreamConfigIniEnv
ImportError: cannot import name 'ConfigIniEnv' from 'everett.manager'
Any thoughts?Nate
08/01/2022, 8:05 PMNathan Ballou
08/01/2022, 8:11 PMNate
08/01/2022, 8:14 PMRayTaskRunner
then - will try to reproduceNathan Ballou
08/02/2022, 3:56 PMNate
08/02/2022, 4:38 PM(begin_task_run pid=72046) ModuleNotFoundError: No module named 'packaging.requirements'
at any point in the stack trace while running your deployment with RayTaskRunner
?
either way, I'll probably raise this as a GitHub issue and will link it here if you want to follow along with its progressNathan Ballou
08/02/2022, 4:41 PMfrom prefect import task, flow
from prefect_ray.task_runners import RayTaskRunner
@task
def test_1():
print("hello")
@task
def test_2(i):
import comet_ml
return i
@flow(task_runner=RayTaskRunner)
def run_tasks():
test_1()
output = [test_2(i) for i in range(10)]
print(output)
if __name__ == "__main__":
run_tasks()
Nate
08/02/2022, 5:00 PMcomet_ml
within a task definitionNathan Ballou
08/02/2022, 5:06 PMpackaging.requiremments
error. Seems similar to https://github.com/PrefectHQ/prefect/issues/5976#issuecomment-1201995890Nate
08/02/2022, 5:17 PMruntime_env
field of init_kwargs
?
that could look like
@flow(
task_runner=RayTaskRunner(
init_kwargs={"runtime_env": {"pip": ["prefect==2.0.1, comet_ml, everett, ..."]}},
)
)
def your_flow():
...
Nathan Ballou
08/02/2022, 5:17 PMNate
08/02/2022, 6:50 PMNathan Ballou
08/03/2022, 6:56 PMNate
08/03/2022, 8:25 PMNathan Ballou
08/03/2022, 8:29 PMNate
08/03/2022, 8:55 PMNathan Ballou
08/03/2022, 9:04 PMNate
08/03/2022, 9:29 PM