Manifold Learning, MDS, and PCA
π Manifold Learning, MDS, and PCA Unsupervised Learning β Dimensionality Reduction Lecture-style notes with full mathematical derivations β¨ π Data Manifold What is a Manifold? A manifol...
π Manifold Learning, MDS, and PCA Unsupervised Learning β Dimensionality Reduction Lecture-style notes with full mathematical derivations β¨ π Data Manifold What is a Manifold? A manifol...
π³ Hierarchical Clustering & π¦ K-Means Unsupervised Learning β Clustering Algorithms (Lecture Notes) π³ Hierarchical Clustering π Agglomerative Clustering (Bottom-Up) Level 0: S...
π§ Unsupervised Learning & Clustering Lecture-style structured notes with intuition, examples, and math π Why Unsupervised Learning? π― Goal Unsupervised learning aims to discover intere...
π Support Vector Machines β Kernels, Logistic Comparison, and MultiβClass βοΈ SVM vs Logistic Regression When classes are well separated SVM tends to perform better because it maximizes the mar...
π Margin-Based Loss Functions π― What is a Loss Function? A loss function measures how wrong a model prediction is. Given prediction $\hat{y}$ and label $y$: [\mathcal{L}(\hat{y}, y)] If $...
π Support Vector Machine (SVM) β Soft Margin with Slack Variables πͺοΈ Noisy & NonβSeparable Data Real-world data are often not perfectly separable due to noise, overlap, or outliers. The cla...
π§ β¨ Support Vector Machine (SVM) π― Goal: Find the maximum-margin hyperplane that separates two classes. π¦ 1. Problem Setup Training data: [{(x_i, y_i)}_{i=1}^n,\quad x_i \in \mathbb{R}^p,\...
π Computational Graphs & Backpropagation (with Vectors & Matrices) Goal: Understand backpropagation as systematic application of the chain rule on a computational graph β from scalars β...
π¨ Limitations of Linear Classifier & Probabilistic Interpretation From raw scores to probabilities, and why loss functions like cross-entropy naturally arise. Full derivations included, no ...
π² Bagged Trees & π³ Random Forests π― 1. Bagged Trees (Bootstrap Aggregation) Bagging = Train many decision trees on bootstrap samples and combine predictions. Procedure Sample many boot...