Dimensionality Reduction with PCA, t-SNE and UMAP you own this product

prerequisites
basics of Julia • intermediate familiarity with scikit-learn and dimensionality reduction algorithms
skills learned
PCA, t-SNE, and UMAP dimensionality reduction techniques • validating and analyzing output of PCA algorithm • calling Python modules from Julia
Łukasz Kraiński and Bogumił Kamiński
1 week · 4-6 hours per week · INTERMEDIATE
Included with a Manning Online subscription
try now

pro $24.99 per month

  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose one free eBook per month to keep
  • exclusive 50% discount on all purchases

lite $19.99 per month

  • access to all Manning books, including MEAPs!

team

5, 10 or 20 seats+ for your team - learn more

Look inside
In this liveProject, you’ll use the Julia programming language and dimensionality reduction techniques to visualize housing sales data on a scatter plot. This visualization will allow the marketing team to identify links and demand patterns in sales, and is also a useful tool for noise reduction or variance analysis. You’ll use the popular PCA algorithm to visualize the sales dataset with overlaid clustering assignments from k-means and DBSCAN methods, and then expand Julia’s capabilities by calling Python modules using the PyCall.jl package. This extra flexibility will allow you to explore the t-SNE and UMAP algorithms which have excellent results for high-dimensional datasets.
This project is designed for learning purposes and is not a complete, production-ready application or solution.

project authors

Bogumil Kaminski
Bogumił Kamiński is Head of the Decision Analysis and Support Unit and Chairman of the Scientific Council for the Discipline of Economics and Finance at SGH Warsaw School of Economics. He also holds a position of adjunct professor at the Data Science Laboratory at Ryerson University and is affiliated with Fields Institute (Computational Methods in Industrial Mathematics Laboratory). In the Julia community, he is the owner of the JuliaData organization and a member of JuliaStats and JuliaLang organizations on GitHub. He also contributes to the community as the top answerer for the [julia] tag on Stack Overflow.
Lukasz Krainski
Łukasz Kraiński is a research assistant at the Decision Analysis and Support Unit at SGH Warsaw School of Economics. He is a certified cloud engineer with expertise in Azure and GCP cloud platforms. You can find him at tech conferences speaking about MLOps and AI (MLinPL 2019, PositivTech 2020, Data Driven Innovation 2020). Łukasz is also an active developer and maintainer of Julia packages (CGE.jl, SmartTransitionSim.jl).

prerequisites

This liveProject is for experienced data scientists and data analysts who are interested in building their skills in Julia. To begin this liveProject, you will need to be familiar with:

TOOLS
  • Basics of Jupyter Notebook
  • Basics of Julia and intermediate experience in another high-level programming language such as Python or R
  • Intermediate knowledge of scikit-learn and umap-learn Python packages
  • Intermediate knowledge of plotting libraries
  • Basic usage of MultivariateStats.jl package
  • Basics of PyCall.jl and Conda.jl packages
  • Basics of Arrow data format
TECHNIQUES
  • Intermediate usage of dimensionality reduction algorithms
  • Intermediate analysis of PCA dimensionality reduction characteristics
  • Basic scatterplots in 2D and 3D
  • Basics of calling Python from Julia

features

Self-paced
You choose the schedule and decide how much time to invest as you build your project.
Project roadmap
Each project is divided into several achievable steps.
Get Help
While within the liveProject platform, get help from other participants and our expert mentors.
Compare with others
For each step, compare your deliverable to the solutions by the author and other participants.
book resources
Get full access to select books for 90 days. Permanent access to excerpts from Manning products are also included, as well as references to other resources.

related titles

choose your plan

pro

monthly
annual
$24.99
$249.99
only $20.83 per month
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Dimensionality Reduction with PCA, t-SNE and UMAP project for free

team

monthly
annual
$49.99
$399.99
only $33.33 per month
  • five seats for your team
  • access to all Manning books, MEAPs, liveVideos, liveProjects, and audiobooks!
  • choose another free product every time you renew
  • choose twelve free products per year
  • exclusive 50% discount on all purchases
  • Dimensionality Reduction with PCA, t-SNE and UMAP project for free