@Marvin I have a question on

prefect_databricks

on how to get job related state and information. My flow run submitted several databricks jobs with

prefect_databricks.flows.jobs_runs_submit_and_wait_for_completion

. When I ran it from local, the url of both prefect job run and databricks job run were posted. How can I view the databricks link from the UI logs when I ran the flow in cloud?

It seems that the excerpts I retrieved aren't directly providing specific information on how to view the Databricks job link from Prefect Cloud UI logs. However, from what I understand about Prefect Cloud, if you wish to view job-related information including external job links, you would typically use the Prefect Cloud UI to inspect the logs of your flow runs. In the context of a

prefect_databricks.flow.jobs_runs_submit_and_wait_for_completion

task, if it is configured to print the Databricks job run URL when executed, you should be able to find those links printed in the logs of the task within the Cloud UI. From the UI, you would need to: 1. Navigate to the flow run of interest. 2. Click on the task run that corresponds to the

jobs_runs_submit_and_wait_for_completion

operation. 3. Review the logs presented for that task run to locate URLs or other information that indicates the link to the Databricks job. Keep in mind, the availability of these URLs would depend on how the task logs output during execution and may require custom logging configuration within your Prefect Flow to ensure that these URLs are emitted to the logs. If this configuration is not present, you may need to modify your flow to log the URLs explicitly, for them to be visible in the Cloud UI logs.