---
# System prepended metadata

title: 20240207 Production App with scalable azure speech service

---

# 20240207 Production App with scalable azure speech service 

## 背景

迪威智能已上線產品[Meeting-ink](https://ink.dwave.cc/zh-TW)
- 基於微軟服務
    - 透過azure speech service提供會議逐字稿/語者分段標記
    - 基於azure translatorw提供文字翻譯
    - 透過azure openai 提供會議紀錄摘要

為因應單一speech service資源concurrent limit限制，請求可否提升單一資源的concurrent limit。

- ref: https://learn.microsoft.com/en-us/azure/ai-services/speech-service/speech-services-quotas-and-limits
![image](https://hackmd.io/_uploads/ByWWoixia.png =70%x)

Azure Support Team建議可基於區域設置多個resources

- ref: https://learn.microsoft.com/en-us/azure/azure-resource-manager/management/azure-subscription-service-limits#azure-ai-services-limits
![image](https://hackmd.io/_uploads/ry4Onsgj6.png =70%x)



示意圖
![image](https://hackmd.io/_uploads/SJyXQnxoT.png)



## Related Sources

https://github.com/andredewes/apim-aoai-smart-loadbalancing

![image](https://hackmd.io/_uploads/rk3X-hxip.png =70%x)


https://www.raffertyuy.com/raztype/azure-openai-load-balancing/
![image](https://hackmd.io/_uploads/HJnK-2xoa.png =70%x)
