Hey, Does anyone have any good tips for hunting d...
# ask-community
k
Hey, Does anyone have any good tips for hunting down why a Flow does not serialise?
Here is a snippet from my Flow:
Copy code
with Flow(
    name=NAME,
    schedule=CronSchedule("5 */6 * * *"),
    storage=default_flow_storage,
    run_config=default_flow_run_config,
    state_handlers=[slack_handler],
) as flow:    
    # Extract
    # ----------------------------------------------------------------
    TMP_TABLE_NAME = generate_tmp_name(NAME) <--- return type str
    search_query_total = query_total(CUSTOMER_HEADER) <--- return type int
    query_offsets = generate_offsets(
        search_query_total,
        DEFAULT_ETL_LIMIT_SIZE
    ) <--- return type list
    extracted_data = extract.map(
        offset=query_offsets,
        query_body=unmapped(CUSTOMER_SEARCH),
        limit=unmapped(DEFAULT_ETL_LIMIT_SIZE),
        query_header=unmapped(CUSTOMER_HEADER)
    ) <--- return type list
I expect the
extracted_data
task to map through the list of
query_offsets
and keep the other variables as unmapped.
However, this
is_serializable(flow, True)
is returning false and the following error:
Copy code
...subprocess.CalledProcessError: Command '/github/flock-prefect/.venv/bin/python /var/folders/p3/ycz3p7ls3c10bg3p2c4_60n00000gn/T/tmpkbedcynv' returned non-zero exit status 1.
Is my understanding of the docs off here? 🤷
k
Hey @Kieran, what do the lists contain?