Adding Azure AI inference

[yanivvak]

What feature would you like to be added?

Adding Azure AI Model Inference is an API that exposes a common set of capabilities for foundational models and that can be used by developers to consume predictions from a diverse set of models in a uniform and consistent way
https://learn.microsoft.com/en-us/azure/ai-studio/reference/reference-model-inference-api?tabs=python

Why is this needed?

It will improve the integration of Autogen with leading model in Azure ecosystem with 20 foundation models
https://learn.microsoft.com/en-us/azure/ai-studio/reference/reference-model-inference-api?tabs=python

[ekzhu]

@rohanthacker has been working on #3902 which is the same task as this issue.

@rohanthacker are you still working on it? It has been awhile and we need this for 0.4 release. @yanivvak could you help out here?

[rohanthacker]

I have this close to completion. I will submit a draft PR in a few hours.

[ekzhu]

I have this close to completion. I will submit a draft PR in a few hours.

@rohanthacker please let us know by tomorrow as we would like to proceed without being blocked thanks.

[rohanthacker]

@ekzhu and @yanivvak I've opened a draft PR for the same. Do let me know your feedback.