Nate
11/01/2024, 8:24 PMprefect.toml
[client]
max_retries = 5
[results]
persist_by_default = true
default_result_storage = "s3-bucket/my-bucket"
[tasks]
runner.thread_pool_max_workers = 50
[logging]
level = "INFO"
which lets you define a toml
file to configure settings such as
• how many threads to use when you say some_task.map(some_iterable)
• whether / where to persist results
• logging level
• and all the rest!
if you use an IDE like VS Code, you'll find that all these settings auto-complete thanks to @alex!
feel free to leave feedback! (here's the code from the video)Constantin Teo
11/04/2024, 6:32 AM