This message was deleted.
# marvin-in-the-wild
s
This message was deleted.
m
Your message was too long by 184 tokens - please shorten it and try again. For reference, here's your message at the allowed limit:
, Hello,
I am performing data quality checks in a flow using Great Expectations and am experiencing issues with using a local subprocess worker. In my Data Quality code, I dynamically create the "gx" folder where I then place my custom expectations. During the code execution, I try to import it with an _importlib.import_module(module)._ This is the code snippet: python @property def context(self): if not self._context: project_root_dir = pathlib.Path(file).resolve().parent.parent context = FileDataContext.create(project_root_dir=project_root_dir) expectations_custom_folder = pathlib.Path(file).parent.joinpath('expectations') gx_path = project_root_dir / 'gx' if gx_path.exists(): print(f"The folder {gx_path} exists.") else: print(f"The folder {gx_path} does NOT exist.") gx_root = 'gx/plugins/expectations' dest_root = project_root_dir.joinpath(gx_root) shutil.copytree(expectations_custom_folder, dest_root, dirs_exist_ok=True) sys.path.append(str(dest_root.parent.parent)) print("sys.path after addition:", sys.path) print("dest_root:", dest_root) print("dest_root.parent.parent:", dest_root.parent.parent) for file in dest_root.iterdir(): filename = (file.name).replace(file.suffix,'') module = gx_root.replace("/",".") module += '.' +
Your message was too long by 179 tokens - please shorten it and try again. For reference, here's your message at the allowed limit:
,I am performing data quality checks in a flow using Great Expectations and am experiencing issues with using a local subprocess worker.
In my Data Quality code, I dynamically create the "gx" folder where I then place my custom expectations. During the code execution, I try to import it with an importlib.import_module(module). This is the code snippet: python @property def context(self): if not self._context: project_root_dir = pathlib.Path(file).resolve().parent.parent context = FileDataContext.create(project_root_dir=project_root_dir) expectations_custom_folder = pathlib.Path(file).parent.joinpath('expectations') gx_path = project_root_dir / 'gx' if gx_path.exists(): print(f"The folder {gx_path} exists.") else: print(f"The folder {gx_path} does NOT exist.") gx_root = 'gx/plugins/expectations' dest_root = project_root_dir.joinpath(gx_root) shutil.copytree(expectations_custom_folder, dest_root, dirs_exist_ok=True) sys.path.append(str(dest_root.parent.parent)) print("sys.path after addition:", sys.path) print("dest_root:", dest_root) print("dest_root.parent.parent:", dest_root.parent.parent) for file in dest_root.iterdir(): filename = (file.name).replace(file.suffix,'') module = gx_root.replace("/",".") module += '.' + filename print(module