Test AI & LLM App with DeepEval, RAGAs & more using Ollama

Roadmap to become AI QA Engineer to test LLMs and AI Application using DeepEval, RAGAs and HF Evaluate with Local LLMs

Created by Karthik KK
Udemy 10h 30m 1,615 enrolled English4.5

What you'll learn

βœ“Understand the purpose of Testing LLM and LLM based Application
βœ“Understand DeepEval and RAGAs in detail from complete ground up
βœ“Understand different metrics and evaluations to evaluate LLMs and LLM based app using DeepEval and RAGAs
βœ“Understand the advanced concepts of DeepEval and RAGAs
βœ“Testing RAG based application using DeepEval and RAGAs
βœ“Testing AI Agents using DeepEval to understand how tool callings can be tested

Requirements

  • Basics of working with LLM like using ChatGPT
  • Basics of any programing language like Java or Javascript
  • Basics of python will be a plus

About this course

Testing AI & LLM App with DeepEval, RAGAs & more using Ollama and Local Large Language Models (LLMs)

Master the essential skills for testing and evaluating AI applications, particularly Large Language Models (LLMs). This hands-on course equips QA, AI QA, Developers, data scientists, and AI practitioners with cutting-edge techniques to assess AI performance, identify biases, and ensure robust application development.

Topics Covered:

  • Section 1: Foundations of AI Application Testing (Introduction to LLM testing, AI application types, evaluation metrics, LLM evaluation libraries).
  • Section 2: Local LLM Deployment with Ollama (Local LLM deployment, AI models, running LLMs locally, Ollama implementation, GUI/CLI, setting up Ollama as API).
  • Section 3: Environment Setup (Jupyter Notebook for tests, setting up Confident AI).
  • Section 4: DeepEval Basics (Traditional LLM testing, first DeepEval code for AnswerRelevance, Context Precision, evaluating in Confident AI, testing with local LLM, understanding LLMTestCases and Goldens).
  • Section 5: Advanced LLM Evaluation (LangChain for LLMs, evaluating Answer Relevancy, Context Precision, bias detection, custom criteria with GEval, advanced bias testing).
  • Section 6: RAG Testing with DeepEval (Introduction to RAG, understanding RAG apps, demo, creating GEval for RAG, testing for conciseness & completeness).
  • Section 7: Advanced RAG Testing with DeepEval (Creating multiple test data, Goldens in Confident AI, actual output and retrieval context, LLMTestCases from dataset, running evaluation for RAG).
  • Section 8: Testing AI Agents and Tool Callings (Understanding AI Agents, working with agents, testing agents with and without actual systems, testing with multiple datasets).
  • Section 9: Evaluating LLMs using RAGAS (Introduction to RAGAS, Context Recall, Noise Sensitivity, MultiTurnSample, general purpose metrics for summaries and harmfulness).
  • Section 10: Testing RAG applications with RAGAS (Introduction and setup, creating retrievers and vector stores, MultiTurnSample dataset for RAG, evaluating RAG with RAGAS).

Related coupons

Vim Masterclass
NewBest Seller

Vim Masterclass

Development
⭐ 4.9πŸ‘₯ 38.4k
$9.99$99.9990% OFF
Updated 8 hours ago

Udemy Course Reviews

Udemy Coupon Insights for Test AI & LLM App with DeepEval, RAGAs & more using Ollama

This Udemy coupon unlocks a guided path into Test AI & LLM App with DeepEval, RAGAs & more using Ollama, so you know exactly what outcomes to expect before you even press play.

Karthik KK leads this Udemy course in IT & Software, blending real project wins with step-by-step coaching.

The modules are sequenced to unpack Artificial Intelligence (AI) step by step, blending theory with scenarios you can reuse at work while keeping the Udemy course reviews tone in mind.

Video walkthroughs sit alongside quick-reference sheets, checklists, and practice prompts that make it easy to translate the material into real projects, especially when you grab Udemy discounts like this one.

Because everything lives on Udemy, you can move at your own pace, revisit lectures from any device, and pick the payment setup that fits your budgetβ€”ideal for stacking extra Udemy coupon savings.

Karthik KK also keeps an eye on the Q&A and steps in quickly when you need clarity. You'll find fellow learners trading tips, keeping you motivated as you sharpen your IT & Software skill set with trusted Udemy discounts.

Ready to dive into Test AI & LLM App with DeepEval, RAGAs & more using Ollama? This deal keeps the momentum high and hands you the tools to apply Artificial Intelligence (AI) with confidence while your Udemy coupon is still active.

Frequently Asked Questions

Is Test AI & LLM App with DeepEval, RAGAs & more using Ollama free with coupon?
Yes, Test AI & LLM App with DeepEval, RAGAs & more using Ollama is currently available with our exclusive coupon code "EA_LEARN_OCT" for significant savings.
How do I apply the Test AI & LLM App with DeepEval, RAGAs & more using Ollama discount code?
Simply click the "Enroll Now" button on this page. The coupon code will be automatically applied at checkout.
What will I learn in Test AI & LLM App with DeepEval, RAGAs & more using Ollama?
In Test AI & LLM App with DeepEval, RAGAs & more using Ollama, you'll learn Roadmap to become AI QA Engineer to test LLMs and AI Application using DeepEval, RAGAs and HF Evaluate with Local LLMs. This Udemy course provides practical, hands-on training.
How long do I have access to Test AI & LLM App with DeepEval, RAGAs & more using Ollama?
Once enrolled, you get lifetime access to Test AI & LLM App with DeepEval, RAGAs & more using Ollama. You can complete the course at your own pace.
Is Test AI & LLM App with DeepEval, RAGAs & more using Ollama a Udemy course?
Yes, Test AI & LLM App with DeepEval, RAGAs & more using Ollama is a comprehensive Udemy course with lifetime access and certificate of completion.