An Hoang
tsv_result_partial = partial(LocalResult, dir="./test_prefect", serializer = PandasSerializer("csv", serialize_kwargs={"sep":"\t", "index": False}, deserialize_kwargs={"sep": "\t"})) parquet_result_partial = partial(LocalResult, dir="./test_prefect", serializer = PandasSerializer("parquet")) @task_no_checkpoint(target=search_result_df_file_name, result = tsv_result_partial()) def example_tsv_result_task: @task_no_checkpoint(target=another_file_name, result = parquet_result_partial()) def example_parquet_result_task: with Flow("test", result=LocalResult("./test_prefect")) as flow: param1 = Parameter() param2 = Parameter()
result_folder/param1/param2
Kevin Kho
var1
var2
context
@task(…result=Result())
@task def abc() x = 123 s3_res = S3Result(location=f"some_location/x.txt",...,...) s3_res.write() return x
Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.