@Marvin prefect 3, controlflow, how can I find what prompted was passed to LLM? If it were langchain, there is Langsmith. Any alternatives for controlflow?

I searched for information related to logging or tracking the prompt inputs passed to LLMs in Prefect 3.x. Here's what I found: 1. Logging in Prefect can be customized to highlight specific output formats by configuring the logging settings, such as using

ConsoleHandler

and specified styles. However, there is no specific mention of tracking or logging LLM prompts passed through ControlFlow in the available Prefect 3.x documentation. (source: Prefect 3.x Logging Documentation) 2. No relevant issues regarding LLM prompt logging in ControlFlow were found in the Prefect GitHub issues. At this point, it seems Prefect 3.x does not have built-in features like Langsmith for tracking or analyzing inputs to LLMs directly in the workflow. You might consider implementing a custom logging mechanism to capture and store this information within your flow for further analysis. This could involve using Prefect's

get_run_logger()

in your flow to manually log the prompts being passed to the LLM. If you have further details or specific use-cases, feel free to share them for more targeted assistance!

@Marvin okay thanks

prefect itself is the observability layer, if you do ‘prefect dashboard open’ and you have the api url set to point at cloud or a server, you’ll see all your control flow work there

You're welcome! If you have any more questions or need further assistance with Prefect or anything else, feel free to ask. Have a great day!

also fwiw there’s a #C079VLLH5D3 channel!

@Nate YES thanks.