Diving into using APIM with generative AI models.
🔎 Looking for content on a particular topic? Search the channel. If I have something it will be there!
🤔 Due to the channel growth and number of people wanting help I no longer can answer or even read questions and they will just stay in the moderation queue never to be seen so please post questions to other sites like Reddit, Microsoft Community Hub etc.
▬▬▬▬▬▬ C H A P T E R S ⏰ ▬▬▬▬▬▬
00:00 – Introduction
00:27 – Adding APIM into the mix
03:16 – LLM supported
05:24 – Authentication to the LLM
06:21 – Adding LLM to APIM
06:47 – Azure Portal onboarding experience
08:30 – Some key GenAI capabilities in APIM
08:46 – Token limits
12:37 – Emit token metrics
14:20 – Load balancing and switching between instances
21:25 – Logging prompts
23:17 – Semantic caching
25:31 – Requirements
27:40 – How it works
29:58 – Demo
35:01 – Chaining?
35:38 – Great example scenario repo
36:48 – Summary
38:57 – Close
▬▬▬▬▬▬ K E Y L I N K S 🔗 ▬▬▬▬▬▬
► Whiteboard:
🔗 https://github.com/johnthebrit/RandomStuff/raw/master/Whiteboards/APIMandGenAI.png
► Git Repo of APIM and GenAI scenarios:
🔗 https://github.com/Azure-Samples/AI-Gateway/tree/main
► Token limit policy:
🔗 https://learn.microsoft.com/azure/api-management/azure-openai-token-limit-policy
► Emit metrics policy:
🔗 https://learn.microsoft.com/azure/api-management/azure-openai-emit-token-metric-policy
▬▬▬▬▬▬ Want to learn more? 🚀 ▬▬▬▬▬▬
📖 Recommended Learning Path for Azure
🔗 https://learn.onboardtoazure.com
🥇 Certification Content Repository
🔗 https://github.com/johnthebrit/CertificationMaterials
📅 Weekly Azure Update
🔗 https://youtube.com/playlist?list=PLlVtbbG169nEv7jSfOVmQGRp9wAoAM0Ks
☁ Azure Master Class
🔗 https://youtube.com/playlist?list=PLlVtbbG169nGccbp8VSpAozu3w9xSQJoY
⚙ DevOps Master Class
🔗 https://youtube.com/playlist?list=PLlVtbbG169nFr8RzQ4GIxUEznpNR53ERq
💻 PowerShell Master Class
🔗 https://youtube.com/playlist?list=PLlVtbbG169nFq_hR7FcMYg32xsSAObuq8
🎓 Certification Cram Videos
🔗 https://youtube.com/playlist?list=PLlVtbbG169nHz2qfLvPsAz9CnnXofhmcA
🧠 Mentoring Content
🔗 https://youtube.com/playlist?list=PLlVtbbG169nGHxNkSWB0PjzZHwZ0BkXZZ
❔ Questions? Maybe I answered it in my FAQ
🔗 https://savilltech.com/faq
👕 Cure Childhood Cancer Charity T-Shirt Channel Store
🔗 https://johns-t-shirts-store.creator-spring.com/
👂 Enable the subtitles and from there you can translate to your native language via the auto-translate feature in settings! https://youtu.be/v5b53-PgEmI for a demo of using this feature.
SUBSCRIBE ✅ https://www.youtube.com/channel/UCpIn7ox7j7bH_OFj7tYouOQ?sub_confirmation=1
#Azure #Cloud #johnsavillstechnicaltraining
