Guide to Building Python and LLM-Based Multimodal Chatbots

Explore this AI chatbots course to build Python-based multimodal chatbots with Gradio, Rasa, Gemini, and Whisper v3. Learn LLM-powered techniques, RAG integration, and deploy on Hugging Face.

Beginner

15 Lessons

Certificate of Completion

Explore this AI chatbots course to build Python-based multimodal chatbots with Gradio, Rasa, Gemini, and Whisper v3. Learn LLM-powered techniques, RAG integration, and deploy on Hugging Face.

AI-POWERED

Explanations

AI-POWERED

Explanations

This course includes

38 Playgrounds

This course includes

38 Playgrounds

Course Overview

This hands-on course will transform how you build AI chatbots. Generative AI and large language models (LLMs) have revolutionized chatbot development, enabling smarter and more interactive systems. In this AI chatbots course, you’ll explore the evolution of chatbots and create your own, starting with a simple Python chatbot enhanced with Gradio for a seamless interface. Next, dive into the Rasa Open Source framework to understand pre-generative AI chatbot development. Progress to LLM-powered chatbots with...Show More

TAKEAWAY SKILLS

Generative Ai

Chatbot

Python

Gradio

Llama

What You'll Learn

Deep understanding of core concepts of chatbot development, including how chatbots work, their different types, and the essential elements of conversational design

Familiarity with the Rasa Open Source framework for building ML-powered chatbots

The ability to incorporate small language models (SLMs) into chatbots with Ollama

Hands-on experience with Groq for accessing Llama 3 for text, Gemini for image processing, and Whisper v3 for accurate speech recognition

The ability to use retrieval-augmented generation (RAG) with LlamaIndex to enhance chatbot knowledge and responses

The ability to deploy chatbots to Hugging Face for accessibility and sharing

What You'll Learn

Deep understanding of core concepts of chatbot development, including how chatbots work, their different types, and the essential elements of conversational design

Course Content

Getting Started

Get an overview of how AI chatbots have evolved and the tools used for building them, including Python and LLMs.

Why AI Chatbots Are Transforming Industries?

Foundations of AI Chatbots

Learn about the evolution, anatomy, and frameworks for developing AI chatbots, including using Rasa with Python.

What Are Chatbots—The Basics of Conversational AI

Types of Chatbots: Rule-Based, Pattern-Matching, and GenAI Anatomy of a Chatbot: How They Work Building Chatbots with Rasa and Python

Building a Generative AI-Powered Chatbot

Build AI chatbots powered by advanced generative AI, integrating multimodal capabilities for real-world applications.

Building a Chatbot Using Small Language Model (SLM)Accessing Large Language Models (LLMs) with Groq Creating a Text-Based Chatbot with Meta’s Llama Adding Image-to-Text Capabilities with Gemini Integrating Speech-to-Text with Whisper v3

Speech Recognition With Whisper

Project

Enhancing Chatbots with Advanced Capabilities

Explore retrieval-augmented generation (RAG) to improve chatbot responses and deploy your chatbots for wider accessibility.

Introduction to RAG with LlamaIndex Integrating RAG with LlamaIndex for Smarter Chatbots Deploying Our Chatbot to Hugging Face Challenge: Creating a Quiz Bot

Build an LLM-powered Chatbot with RAG using LlamaIndex

Project

Conclusion

Summarize key learnings and explore the future of building AI chatbots with multimodal and generative AI techniques.

Future of AI Chatbots

Trusted by 1.4 million developers working at companies

Anthony Walker

@_webarchitect_

Emma Bostian 🐞

@EmmaBostian

Evan Dunbar

ML Engineer

Carlos Matias La Borde

Software Developer

Souvik Kundu

Front-end Developer

Vinay Krishnaiah

Software Developer

Eric Downs

Musician/Entrepeneur

Kenan Eyvazov

DevOps Engineer

Anthony Walker

@_webarchitect_

Emma Bostian 🐞

@EmmaBostian

Hands-on Learning Powered by AI

See how Educative uses AI to make your learning more immersive than ever before.

Instant Code Feedback

Evaluate and debug your code with the click of a button. Get real-time feedback on test cases, including time and space complexity of your solutions.

AI-Powered Mock Interviews

Put your skills to the test in a simulated interview setting. Receive personalized feedback based on your performance. Available in Premium & Premium Plus plans.

Adaptive Learning

At various checkpoints throughout Educative courses, you will be prompted to take a quick assessment. Receive a condensed curriculum tailored to your strengths and skill gaps.

Explain with AI

Select any text within any Educative course, and get an instant explanation — without ever leaving your browser.

AI Code Mentor

AI Code Mentor helps you quickly identify errors in your code, learn from your mistakes, and nudge you in the right direction — just like a 1:1 tutor!