Using Your Own Data with Large Language Models (LLMs) aka Making JohnBot!

5K views

96%

1K 52

Using Your Own Data with Large Language Models (LLMs) aka Making JohnBot!

In this video I walkthrough how to use your own data with Large Language Models (LLMs) like GPT by leveraging Azure AI Search and along the way I create JohnBot as a little example

Useful associated videos:

Generative AI overview – https://youtu.be/Ch6KE7KxHGM
RAG, embedding and more – https://youtu.be/orLGv2LgWDE

Looking for content on a particular topic? Search the channel. If I have something it will be there!

▬▬▬▬▬▬ C H A P T E R S ▬▬▬▬▬▬
00:00 – Introduction
00:26 – Why we need to use our own data
02:14 – Your source data
05:37 – Using Azure AI Search
08:19 – Integration and reading data
11:24 – Import and index
13:38 – What interval should be used?
16:18 – Viewing the index and indexer
18:11 – Chunking
24:51 – Other types of media beyond text
25:32 – IF YOU REMEMBER ONE THING
29:43 – Keyword search is still useful so we need hybrid
32:41 – BM25 searching
34:15 – Hybrid search with RRF
41:27 – Orchestrator component
43:30 – Using the Playground and key settings such as memory
44:20 – Adding my data source
47:05 – Performing an interaction backed by my data (RAG)
50:20 – The response and references
55:12 – Summary
56:55 – Close

▬▬▬▬▬▬ K E Y L I N K S ▬▬▬▬▬▬
► Whiteboard:
https://github.com/johnthebrit/RandomStuff/raw/master/Whiteboards/JohnBot.png

▬▬▬▬▬▬ Want to learn more? ▬▬▬▬▬▬
Recommended Learning Path for Azure
https://learn.onboardtoazure.com
Certification Content Repository
https://github.com/johnthebrit/CertificationMaterials
Weekly Azure Update
https://youtube.com/playlist?list=PLlVtbbG169nEv7jSfOVmQGRp9wAoAM0Ks
Azure Master Class
https://youtube.com/playlist?list=PLlVtbbG169nGccbp8VSpAozu3w9xSQJoY
DevOps Master Class
https://youtube.com/playlist?list=PLlVtbbG169nFr8RzQ4GIxUEznpNR53ERq
PowerShell Master Class
https://youtube.com/playlist?list=PLlVtbbG169nFq_hR7FcMYg32xsSAObuq8
Certification Cram Videos
https://youtube.com/playlist?list=PLlVtbbG169nHz2qfLvPsAz9CnnXofhmcA
Mentoring Content
https://youtube.com/playlist?list=PLlVtbbG169nGHxNkSWB0PjzZHwZ0BkXZZ
Questions? Maybe I answered it in my FAQ
https://savilltech.com/faq
Cure Childhood Cancer Charity T-Shirt Channel Store
https://johns-t-shirts-store.creator-spring.com/

Enable the subtitles and from there you can translate to your native language via the auto-translate feature in settings! https://youtu.be/v5b53-PgEmI for a demo of using this feature.