Skip to content
Learning Notes
Comparison of Classifiers
Initializing search
Home
Probability
Linux
Programming Languages
Time Series
Maths Miscellaneous
Large Language Models
Linear Algebra
Differential Equations
Deep Learning
Machine Learning
Learning Notes
Home
Probability
Probability
Probability Theorems
Probability Theorems
Probability Theorems
Expectation, Variance and Covariance
Jacobian
Iterated Expectation and Variance
Random number of Random Variables
Moment Generating Function
Convolutions
Probability Distributions
Probability Distributions
Continuous Uniform Random Variable
Bernoulli and Binomial Random Variable
Geometric Distribution
Negative Binomial Distribution
Bernoulli Process
Exponential Distribution
Poisson
Gamma Distribution
Beta Distribution
Dirichlet Distribution
Normal Distribution
Chi-Square Distribution
t-Distribution
F-Distribution
Logistics Distribution
Renewal Process
Counting Process
Markov Process
Markov Process
Markov Process
Recurring and Transient States
Steady State Probabilities
Birth Death Process
Absorption Probabilities
Limit Theorems
Limit Theorems
Limit Theorems
Markov Inequality
Chebychev Inequality
Weak Law of Large Numbers
Convergence in Probability
Central Limit Theorem
Strong Law of Large Numbers
Distribution of Sample Mean and Variance
Distribution of Sample Mean and Variance
Distribution of Sample Mean and Variance
Sample Mean
Sample Variance
Distributions for a Normal Population
Parameter Estimation
Parameter Estimation
Parameter Estimation
Maximum Likelihood Estimator
Method of Moments Estimate
Interval Estimates
Order Statistics
Evaluating an Estimator
Bayes Estimator
Bayesian Inference
Hypothesis Testing
Hypothesis Testing
Hypothesis Testing
Test around Mean of Normal Population
Testing Equality of Means of Two Normal Populations
Tests around Variance of Normal Population
Tests around Bernoulli Population
Linear Regression
Linear Regression
Linear Regression
Mean and Variance of Coefficients
Distribution of Residual
Inferences Concerning Coefficients
Inferences Concerning Mean Response
Inferences Concerning Future Response
Coefficient of Determination
Weighted Least Squares
Life Testing
Generating Random Numbers
Generating Random Numbers
Random Numbers
Generating Discrete Random Variables
Generating Continuous Random Variables
Exercises
Exercises
Exercises Part 1
Exercises Part 2
Exercises Part 3
Exercises Part 4
Linux
Linux
RegEx
find
grep
cURL
sed
Docker
Kubernetes
Programming Languages
Programming Languages
SQL
SQL
SQL
Exercises Part 1
Exercises Part 2
Exercises Part 3
C
C++
C++
C++
Exercises Part 1
Exercises Part 2
Exercises Part 3
Data Structures and Algorithms
Time Series
Time Series
Characteristics of Time Series
Characteristics of Time Series
Characteristics of Time Series
Time Series Formulations
Measures of Dependence
Exercises
ARIMA
ARIMA
Backward Shift Operators
Smoothing in Time Series
Autoregressive Models (AR)
Moving Average Models (MA)
ARMA(p,q) Process
ARIMA(p,d,q) Process
Walkthrough Example
Simple Exponential Smoothing - Introduction
Simple Exponential Smoothing - Introduction
Simple Exponential Smoothing - Introduction
Simple Exponential Smoothing
Exponential Smoothing with Trend
Exponential Smoothing with Trend and Seasonality
Codes
Codes
PACF Simulation
ACF Simulation
ARIMA Simulation
SARMA Simulation
SARMA Simulation - 1
Time Series Walkthrough Code
SES Example
SES Trend
SES Seasonal
Maths Miscellaneous
Maths Miscellaneous
Reversing an Exponential Base
Definite Integral
First to 50
Incremental Remainders
Large Language Models
Large Language Models
Finetuning
Inference Engineering
Inference Engineering
Motivation
LLM Models
Image Generation Models
Video Generation Models
Inference Bottlenecks
Quantization
Speculative Decoding
Caching
Model Parallelism
Disaggregation
Retrieval Augmented Generation (RAG)
Retrieval Augmented Generation (RAG)
Basics
Retrieval Optimizations
Chunking Strategies
Advanced Architectures
Scaling and Implementation Checklist
Evaluations
Linear Algebra
Linear Algebra
Complex Field
Complex Field
Complex Field
Lists
Fields
Vector Spaces
Product and Quotient of Vector Spaces
Subspace
Finite Dimensional Vector Spaces
Orthogonal and Orthonormal Vectors
Linear Maps
Linear Maps
Linear Maps
Matrix
Determinant
Special Matrices
Algebraic Properties of Matrices
Linear Equations
Linear Equations
Linear Equations
Eigenvectors and Eigenvalues
Exercises
Differential Equations
Differential Equations
Differential Equations
Special Solutions to First Order ODE
Second Order Linear ODE
Higher Order Linear ODE
System of ODEs
Series Solutions of ODEs
Laplace Transforms
Exercises
Deep Learning
Deep Learning
Gradient Descent
Gradient Descent
Gradient Descent
Matrix Calculus
Backpropagation
Gradients for Common Activation Functions
Gradients for Common Loss Functions
Gradients for Common Layers
Backpropagation Example
Optimizers
Weights Initialization
Weights Initialization
Weights Initialization
Correct Initialization
Recurrent Layers
Recurrent Layers
Recurrent Layers
Backpropagation Through Time (BPTT)
Exploding and Vanishing Gradient
Gated Recurrent Unit (GRU)
Long Short Term Memory (LSTM)
Convolutional Neural Networks
Convolutional Neural Networks
Convolutional Neural Networks
Convolution Operation
VGG-16 Architecture
Layer Visualizations
Adversarial Attacks
Deepdream
Object Detection
Convolutional Segmentation
Style Transfer
Transformers
Transformers
Transformers Motivation
Self Attention
Attention
Positional Encodings
Word Embeddings
Sequence Modelling
Decoder Transformers
Sampling Strategies
Encoder Transformers
Sequence to Sequence or Encoder Decoder Models
Fine Tuning LLMs
Vision Transformers
Working with audio data
Text to Speech
Multimodal Transformers
Generative Models
Generative Models
Generative Adversarial Networks
Autoencoders
Codes
Codes
Backprop Example
Exponentially MA Example
BPTT Example
Machine Learning
Machine Learning
Linear Regression
Linear Regression
Linear Regression
Simple Linear Regression
Multiple Linear Regression
Problems when using Linear Regression
Classification
Classification
Classification
Logistic Regression
Linear Discriminant Analysis (LDA)
Naive Bayes Classifier
Comparison of Classifiers
Classfication Metrics
Linear Model Selection and Regularization
Linear Model Selection and Regularization
Linear Model Selection and Regularization
Subset Selection
Evaluation Metrics
Shrinkage Methods and Regularization
Dimension Reduction Methods
Curse of Dimensionality
Exercises
Moving Beyond Linearity
Moving Beyond Linearity
Moving Beyond Linearity
Polynomial Regression
Step Function
Basis Function
Regression Splines (Polynomials)
Smoothing Splines
Local Regression
Generalized Additive Models
Exercises
Resampling Methods
Resampling Methods
Resampling Methods
Cross Validation
Bootstrap
Tree Based Models
Tree Based Models
Tree Based Models
Regression Trees
Classification Trees
Patient Rule Induction Method (PRIM)
Bagging
Random Forest
Boosting
Adaboost.M1
Boosting Trees
XGBoost
Support Vector Machines (SVM)
Support Vector Machines (SVM)
Support Vector Machines (SVM)
Maximum Margin Classifier
Support Vector Classifier
Support Vector Machine
Bayesian Methods
Bayesian Methods
Bayesian Methods
Maximum Likelihood Estimator (MLE)
Maximum A Priori (MAP)
Expectation Maximization
Variational Inference
Comparison of Different Inference Methods
Latent Dirichlet Allocation (LDA)
Sampling from Distributions
Gaussian Process (GP)
Bayesian Optimization
Clustering
Clustering
Clustering
Distances and Dissimilarity Measures
K-Means Clustering
K-Mediods Clustering
Hierarchical Clustering
Gaussian Mixture Models (GMM)
Key Considerations while Clustering
Appendix
Appendix
Bias-Variance Tradeoff
Matrix Calculus in Logistic Regression
Comparison of Classifiers
Comparison of Classifiers
Table of contents
Comparison of different Classifiers
Perpendicular distance in Maximum Margin Classifier
Lagrange Multiplier, Primal and Dual
Codes
Codes
Predictions using Gaussian Process
Table of contents
Comparison of different Classifiers
Comparison of Classifiers
¶
Comparison of different Classifiers
¶
Comparison of Classifiers
Back to top
