Azure Content Understanding: Custom Usage Tracking with APIM
Read OriginalThis article details a solution for tracking LLM and Content Understanding token usage in a multi-tenant application for customer billing, using Azure API Management (APIM) custom policies. It describes exposing AI endpoints via APIM, intercepting responses to capture token metadata (prompt, completion, total tokens), and emitting usage events to Event Hub or Service Bus for downstream processing. The approach avoids reliance on Application Insights and provides a custom tracking mechanism for billing datastores.
Comments
No comments yet
Be the first to share your thoughts!
Browser Extension
Get instant access to AllDevBlogs from your browser
Top of the Week
No top articles yet