Chatbot with Llama you own this product

prerequisites
Intermediate Linux • Basic git • Basic compilers
skills learned
Quantize an open-source LLM • build and use prompts and prompt templates for a chatbot LLM • build a web UI for the chatbot
Michael Yuan and Tony Yuan
1 week · 4-6 hours per week · BEGINNER
Included with a Manning Online subscription
try now

pro $24.99 per month

  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose one free eBook per month to keep
  • exclusive 50% discount on all purchases

lite $19.99 per month

  • access to all Manning books, including MEAPs!

team

5, 10 or 20 seats+ for your team - learn more

Look inside

In this liveProject, you’ll take on the role of a full-stack developer working for a school district. Your district wants to further student learning by developing its own large language model (LLM) applications to assist students, parents, and teachers. Your goal is to develop an MVP of this by creating a chatbot that can answer questions and engage in follow-up conversations. You’ll utilize the open source Llama LLM from Meta AI to do this. Your model will need to run with very low resources—it needs to work on the school’s outdated computers—and be equipped with an intuitive user interface. Let’s get started!

This project is designed for learning purposes and is not a complete, production-ready application or solution.

prerequisites

This liveProject is for software developers and IT professionals who are interested in building LLM applications in their own domains. To begin this liveProject, you will need to know the following:


TOOLS
  • Intermediate Linux
  • Basics CMAKE and Linux dev tools
  • Basics of Git
  • Basics of Basics of Hugging Face
  • Basics of Python
TECHNIQUES
  • Command line tools
  • Basics of LLMs
  • Basics of model training and inference
  • Deploying and testing web services

features

Self-paced
You choose the schedule and decide how much time to invest as you build your project.
Project roadmap
Each project is divided into several achievable steps.
Get Help
While within the liveProject platform, get help from other participants and our expert mentors.
Compare with others
For each step, compare your deliverable to the solutions by the author and other participants.
book resources
Get full access to select books for 90 days. Permanent access to excerpts from Manning products are also included, as well as references to other resources.

related titles

choose your plan

pro

monthly
annual
$24.99
$249.99
only $20.83 per month
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Chatbot with Llama project for free

team

monthly
annual
$49.99
$399.99
only $33.33 per month
  • five seats for your team
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Chatbot with Llama project for free