Bring your towel and join one of the fastest growing data communities. Welcome to our second-generation open source orchestration platform, a completely rethought approach to dataflow automation.

Prefect Community

If anyone is interested in using Prefect Orion with a <https://learn.microsoft.com/en-us/azure/postgresql/flexible-server/|Flexible Postgres Server> on Azure, I put together a quick post on how to make it work: <https://discourse.prefect.io/t/how-to-use-azure-postgres-flexible-server-with-prefect-orion/1887>

Hi <@U03SXGWL1K4>, When can we expect <https://github.com/PrefectHQ/prefect-azure/commit/b097a7308e385c26900fe75ff010018f6285297d|Updated AzureContainerInstanceJob to pass private Docker registry credentials as a list>  to be merged, fixing private repos in prefect-azure? Was just about to submit an issue, when I saw you’d already fixed it :)

Hi Rasmus, I will make pull requests for this and a couple other small updates today and then work with the rest of the team to get them reviewed, merged and released ASAP. I'll post an update here when the new release is available.

Perfect. The ability to use serverless such as ACI as infrastructure is fantastic.

Hi,
I have started looking at running Prefect on Azure Container Images, which looks very promising - especially the ability to assign a user-managed identity is great, I assume it is only a matter of time before this feature becomes available in the UI as well.

My question though: is there any timeline for when this feature will stabilize?

The UI states very clearly that ACI is experimental and can change without warning.

Granted, ACI seems pretty experimental in Azure as well…

sorry, this is not up to date. We aren't working on it anymore and given that many are using this successfully without any issues, you should consider it stable and safe to use in production

we've got some great feedback e.g. from <@U03RA4JQ9C3> and IIRC <@U03SXGWL1K4> has recently added some UX improvements based on user feedback, so it should be :white_check_mark:

Absolutely worked beautifully for me straight out of the box.

Hello there, Are there any task libraries available as OSS for Azure services other than the very limited standard tasks that come with Prefect 2.0?

Have you seen <https://prefecthq.github.io/prefect-azure/>?

Yes. thats a very limited set of tasks...right?

Is there some specific functionality you’re looking for?

Anything to do with IAM/AD or Auth/Auth!!

or any other third party libraries that you might be aware of?

Maybe <https://github.com/PrefectHQ/prefect-azure/blob/main/prefect_azure/credentials.py>? If the functionality is missing, feel free to submit an issue for a feature request

Never mind. I was looking for more specific functionalities...Thanks for your help.

To follow up, if you want to work with Azure AD, auth and identity in Python, you'll probably need to use <https://github.com/AzureAD/microsoft-authentication-library-for-python|MSAL for Python>.

Once you've authenticated, if you want to edit AD objects like users and groups, you'd need to call the <https://developer.microsoft.com/en-us/graph|Graph API> or use the <https://devblogs.microsoft.com/microsoft365dev/introducing-the-microsoft-graph-python-sdk-now-available-for-public-preview/|MS Graph Python SDK> (not officially released yet, but available as a public preview)

Providing pre-made tasks would be tricky because there are _so_ many operations and combinations of operations you can perform on AD users and groups. Calling the Graph API or using the Graph Python SDK inside a Prefect task should work, as long as anything you return from the task is serializable.

I already am using MSAL to do all of that...I was wondering if someone had already integrated well with Prefect with working samples that I could use as a reference...

Again thanks for your help <@U03SXGWL1K4>

Again, Microsoft has a plethora of libraries and toolkits and that is another risk factor before integrating with Prefect...

If anyone is interested in sending Prefect logs to Azure Application Insights, I just posted a short tutorial on how to do it: <https://discourse.prefect.io/t/how-to-send-prefect-logs-to-azure-application-insights/2202>