Azure OpenAI Architecture Patterns and implementation steps

calendarNov 13, 2023 · 1 min read · AI  ·
Share on: linkedincopy

Microsoft has announced a great functionality "Azure AI Content Safety". This information can be found at Microsoft Azure AI Blog.

On this page, the most frequently used and discussed architecture patterns among our customers in various domains:

  1. AOAI with Azure Frontdoor for loadbalancing;
  2. AOAI with APIM; a) Round Robin load balancing with Retry logic; b) AAD authentication from APIM to Azure OpenAI c) Policy to extract callerID (Subject from APIM) d) Logging and Monitoring using APIM: e) For advanced logging, more than 8192 bytes f) For Budgets and cost management using APIM refer this blog
  3. AOAI with Frontdoor and APIM multi-region deployment for a full-fledged multi-region availability

Click here to learn more.