Run a Real-Time ML Model you own this product

prerequisites
intermediate Python • basic machine learning • basic edge computing systems • basic TensorFlow
skills learned
set up a real-time training algorithm on an embedded board • train, evaluate, and tune hyperparameters on an embedded board • workflow of model tuning from the desktop to the embedded board
Kanishka Tyagi & Raghavendra Sriram
1 week · 8-10 hours per week · INTERMEDIATE
Included with a Manning Online subscription
try now

pro $24.99 per month

  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose one free eBook per month to keep
  • exclusive 50% discount on all purchases

lite $19.99 per month

  • access to all Manning books, including MEAPs!

team

5, 10 or 20 seats+ for your team - learn more

Look inside

EKKo Inc., the machine learning consultancy you work for, has been building an embedded system to enable deaf or hard of hearing people to participate in online meetings and events on their mobile devices. As a data scientist, your task is to complete the system by enabling it to detect American Sign Language (ASL) in real time. You’ll define a CNN model, train it using the existing ASL dataset, and evaluate the model’s accuracy. To optimize training speed and quality, you’ll fine-tune the model’s hyperparameters using the Keras Tuner. You’ll enable the model to be quantization-aware with the TensorFlow Model Optimization Toolkit (MoT), optimizing size and CPU consumption while maintaining model accuracy. To complete the project, you’ll connect the quantized model with a live video stream and train it on the embedded system. When you’re done, you’ll have a fully functional quantized CNN you can run on an embedded system that successfully detects and transcribes ASL in real time.

This project is designed for learning purposes and is not a complete, production-ready application or solution.

project authors

Kanishka Tyagi

Dr. Kanishka Tyagi received his bachelor's degree in electrical engineering in 2008 from Pantnagar, India. Later he worked as a research associate at the Department of Electrical Engineering, Indian Institute of Technology, Kanpur, with Dr. P.K.Kalra. He received his master’s and doctoral degree with Dr. Michael Manry in the Department of Electrical Engineering at The University of Texas at Arlington in 2012 and 2017. Currently, he works as a senior machine learning scientist at Aptiv advance research center, California. Prior to Aptiv, he worked at Siemens research, and interned in machine learning groups at The MathWorks and Google Research. He has worked as a visiting researcher at Ajou University and Seoul National University. He received the 2007 and 2011 IEEE CIS Outstanding Student Paper Travel Grant Award and 2013 IEEE CIS Walter Karplus Summer Research Grant award. Dr. Tyagi is an IEEE senior member and member of various IEEE-CIS committees. He currently serves as an associate editor for IEEE Transaction on Neural Network and Learning Systems. Dr. Tyagi has published over 30 papers and filed 17 U.S. patents and trade secrets.

Raghavendra Sriram

Raghavendra Sriram completed his bachelor’s degree in engineering at the Department of Electrical and Electronics Engineering at Canara Engineering College in Mangalore in 2012. Currently, he’s a senior development engineer for OBD systems working at Paccar, Inc. in Mt. Vernon, WA. His work focuses on developing innovative solutions to diagnostic capabilities for diesel engine misfire detection and calibration efforts using machine learning and optimization techniques. Previously, he developed and designed diagnostic algorithms for after-treatment systems. Before joining the industry, he worked as a researcher under the guidance of Dr. Frank L. Lewis in the electrical department at the University of Texas at Arlington, focusing mainly on developing and implementing intelligent control algorithms on various robotics platforms. He has extensive experience with multiple rapid prototyping systems and tools, has been awarded several university department scholarships for research, and contributed to several journals and research groups.

prerequisites

The liveProject is for intermediate Python programmers who know the basics of data science. To begin these liveProjects you’ll need to be familiar with the following:

TOOLS
  • Raspberry Pi/edge computer
  • Ubuntu Desktop 18.04 +
  • Intermediate Python
  • Basics of Jupyter Notebook
  • Intermediate NumPy
  • Intermediate TensorFlow
  • Conda/pip virtual environment setup skill
TECHNIQUES
  • Basics of data science
  • Understand logistic regressions and classification
  • Load data on a neural network
  • Train a neural network
  • Assess a CNN model
  • Basics of linear algebra (vectors, spaces, matrix transformations)

features

Self-paced
You choose the schedule and decide how much time to invest as you build your project.
Project roadmap
Each project is divided into several achievable steps.
Get Help
While within the liveProject platform, get help from other participants and our expert mentors.
Compare with others
For each step, compare your deliverable to the solutions by the author and other participants.
book resources
Get full access to select books for 90 days. Permanent access to excerpts from Manning products are also included, as well as references to other resources.

related titles

choose your plan

pro

monthly
annual
$24.99
$249.99
only $20.83 per month
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Run a Real-Time ML Model project for free

team

monthly
annual
$49.99
$399.99
only $33.33 per month
  • five seats for your team
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Run a Real-Time ML Model project for free