prefect-community #pacc-sept-13-14-2023

calls in external functions (not always used from within prefect) to also end up in my flow logs. Is there any way to configure my flow so the run logger gets added as a handler for the built-in root logger?

Christopher Boyd

09/13/2023, 2:20 PM

Copy code

from prefect import get_run_logger

@task
get_weather():
    logger = get_run_logger()
    <http://logger.info|logger.info>(f"{value}")

Christopher Boyd

09/13/2023, 2:21 PM

Passing a logging object:

Copy code

from prefect import get_run_logger

@task
get_weather():
    logger = get_run_logger()
    <http://logger.info|logger.info>(f"{value}")
    not_a_task(logger)

not_a_task(log_obj):
    <http://log_obj.info|log_obj.info>("hello world")

Christopher Boyd

09/13/2023, 2:27 PM

https://docs.prefect.io/latest/concepts/results/?h=persist_result#toggling-persistence

Christopher Boyd

09/13/2023, 2:27 PM

image.png

David Maxson

09/13/2023, 2:31 PM

Result persistence also supports non-local storage which also supports distributed execution (e.g. DaskTaskRunner/RayTaskRunner)

gratitude thank you 1

👍 2

Jeff Hale

09/13/2023, 2:39 PM

Lab 102 Instructions: • Use a flow that grabs weather data from open-meteo • Add retries • Run your flow • Inspect in the UI • Stretch: create an artifact • Stretch: add caching

Bianca Hoch

09/13/2023, 2:45 PM

PSA: No need to start a perfect server instance locally, just use your Cloud accounts. ☁️

🙌 1

David Maxson

09/13/2023, 2:50 PM

https://docs.prefect.io/latest/concepts/artifacts/#create-table-artifacts

Jeff Hale

09/13/2023, 2:59 PM

We’ll get back together at 11:03am ET - 5 min. Feel free to take a break prior. 🙂

Jeff Hale

09/13/2023, 3:01 PM

Share code from 102 lab in this 🧵:

sonic 1

David Maxson

09/13/2023, 3:05 PM

Conceptually and in simple terms, what is a "deployment"? Is it a place where the code runs? Is it a snapshot of the code, or some bundling of the flow with configuration? How does the concept of a "deployment" click with the general idea of workers and work queues?

David Maxson

09/13/2023, 3:19 PM

Can we write custom block types and use them in Prefect Cloud?

David Maxson

09/13/2023, 3:20 PM

Can we deploy blocks with infrastructure-as-code tools (e.g. terraform)?

Jeff Hale

09/13/2023, 3:38 PM

Lab 103: • Use a previously made flow • Make an email notification automation for flow run completion • Run the flow a few times from the CLI • See the event feed in the UI • Create multiple deployments at once with the serve method • Stretch: create a custom event - run it and see the event in the UI

Jeff Hale

09/13/2023, 3:44 PM

Updated Day 1 Slides:

PACC Slides Sept 13, 2023 day 1 revised.pdf

Jeff Hale

09/13/2023, 3:45 PM

GitHub repo is updated, too, if you want to fetch it. 🙂

Jeff Hale

09/13/2023, 3:54 PM

Thread for 103 lab code (multiple deployments with serve and/or custom events):

🧵 1

Jeff Hale

09/13/2023, 3:54 PM

We’ll get back together in 4 minutes, at 11:58am ET.

Jeff Hale

09/13/2023, 4:02 PM

Thank you all for your hard work and attention! See you tomorrow at the same time and place. Have a great rest of your day/night! 🎉

🎉 3

💯 2

Jeff Hale

09/13/2023, 6:43 PM

🎥 Day 1 recording: https://us06web.zoom.us/rec/share/rkAKjBg49gN0i9u44js2ZwC2uIfgfB194j-MZ3KIhA0JT-qrjhKA15CrCajqBDf_.sJf34kYF1INpYCLZ Passcode: k8A=zrBA

Jeff Hale

09/14/2023, 12:45 PM

Good morning, all! ☀️ We’ll get the room open about 8:50am ET and get started at 9am ET.

🌅 4

Marcos Almeida

09/14/2023, 1:04 PM

Good morning! I'd like please ask if events and blocks are not available for Prefect server running in EKS, for example.