๐๐ฆ๐ฉ๐ฅ๐๐ฆ๐๐ง๐ญ ๐ฅ๐จ๐ ๐ ๐ข๐ง๐ ๐๐ง๐ ๐ฆ๐จ๐ง๐ข๐ญ๐จ๐ซ๐ข๐ง๐ ๐๐จ๐ซ ๐๐ณ๐ฎ๐ซ๐ ๐๐ฉ๐๐ง๐๐ ๐ฆ๐จ๐๐๐ฅ๐ฌ
Azure OpenAI offers built-in logging and monitoring capabilities.
However, it's important to note that the default cognitive service logging doesn't capture or store details such as prompts, tokens, and models used as inputs and outputs of the service.
These metrics are particularly crucial for compliance and ensuring the service functions as intended. ๐
The following solution provides comprehensive logging and monitoring, as well as enhanced security for enterprise deployments of the Azure OpenAI Service API.
Take a look: https://learn.microsoft.com/en-us/azure/architecture/ai-ml/openai/architecture/log-monitor-azure-openai
#openai #azureopenai #monitoring #logging #sentinel #siem #log #loganalytics #azuread #API #AppGateway #azure #architecture #cybersecurity #ai #llm #aisecurity #microsoft #cloud #cloudnative