Combining the Best of Two Worlds: From TF-IDF to Llama LLM – William Arias, GitLab
Learn how combining traditional NLP techniques with LLMs can solve ‘hallucination’ issues and create robust applications. This session offers practical insights into leveraging foundational NLP principles alongside advanced LLM technology. It’s based on a business problem where the need is to craft technical content that directly tackles the key challenges customers encounter. Rather than wading through hundreds of public forum posts or customer complaints manually, why not harness the combined power of traditional, explainable Natural Language Processing (NLP) techniques integrated with the advanced language generation capabilities of Large Language Models (LLMs). This session will provide architecture and lessons learned in the journey to uncover insights from our users’ feedback. Centered around a topic modeling use case, this session offers actionable insights that go beyond mere buzzwords. At the end the audience will learn how to leverage text analytics and the strengths of Open Source LLMs to tailor content that resonates with their audience’s needs and pain points. Bonus points: This use-case architecture is completely automated using CI/CD principles.
