Gregory Hunt
08/31/2023, 5:50 PMNate
09/01/2023, 1:14 PMGregory Hunt
09/01/2023, 1:15 PMNate
09/01/2023, 1:19 PMGregory Hunt
09/01/2023, 1:32 PMNate
09/01/2023, 1:35 PMGregory Hunt
09/01/2023, 1:35 PMNate
09/01/2023, 1:35 PMGregory Hunt
09/01/2023, 1:36 PM@flow(name="Files from Main Query Flow")
def pipeline(msg: dict):
logger = get_run_logger()
for attr, value in msg.items():
<http://logger.info|logger.info>(f"{attr}, {value}")
if msg["status"] == "MALWARE_SCAN_COMPLETE":
parse_provider_data.pipeline(msg["storage_path"])
@flow(name="Parse Provider Data from CCDA")
def pipeline(filename: str):
logger = get_run_logger()
<http://logger.info|logger.info>(f"Parsing: {filename}")
sleep(randint(1, 10))
Nate
09/01/2023, 1:38 PMGregory Hunt
09/01/2023, 1:39 PM@flow(name="Parse Provider Data from CCDA")
def pipeline(filename: str):
logger = get_run_logger()
<http://logger.info|logger.info>(f"Parsing: {filename}")
sleep(randint(1, 10))
Nate
09/01/2023, 1:44 PMParse Provider Data from CCDA
flow has no associated deployment, so I'm confused how the Parse Provider subflow get spun up in another container
- unless you're doing something under the hood with this call parse_provider_data.pipeline(msg["storage_path"])
that I can't see hereGregory Hunt
09/01/2023, 1:45 PMNate
09/01/2023, 1:46 PMFiles from Main Query Flow
- can you explain how you know that
the Parse Provider subflow get spun up in another container?
Gregory Hunt
09/01/2023, 2:00 PMNate
09/01/2023, 2:28 PM