ML-AI Garden

🛡 Machine Learning

Feature engineering

★ Concepts

• Linear vs Non Linear
• Normalization & Standardization

★ Feature Selection

• Approaches to Feature Selection
• Feature Selection vs Elimination

ᯓ ✈︎ Various Approaches of "Feature Selection"

★ Pre-processing

• Feature Transformation & Scaling ★ Main ★
  • Feature Transformation & Scaling - A Step-by-Step Guide
  • Feature Transformation & Scaling - Summary

I. Transformation Techniques

II. Scaling Techniques

• StandardScaler
• RobustScaler
• MinMaxScaler
• MaxAbsScaler
• Mean Normalization

★ Statistical Plots for Data Analysis

★ Statistical Test for Normal distribution

• Skewness and Kurtosis
• Kolmogorov-Smirnov Test
• D'Agostino-Pearson Test
• Jarque-Bera Test
• Shapiro-Wilk Test
• Anderson-Darling Test

Supervised Machine Learning

★ Concepts

• Bias, Variance
  • The Bullseye Target
• Derivatives
  • Partial Derivatives
  • Gradient
• Logit
  • Maximum Likelihood Estimation
  • Cross Entropy Loss
• Sigmoid
  • Softmax
• Gini Index
• Hyperparameter Tuning
  Grid Search, Randomized Search, Successive Halving, Bayesian Optimization
• Multicollinearity
  • Multicollinearity Extended

★ Deep Learning / Neural Network

• Activation Function

★ Algorithms

Basic

• Naive Bayes
• Decision Tree
  • Decision Tree - Algo
  • Decision Tree - Balancing

Ensemble Techniques

★ Ensemble Overview ★

1. Bagging

• Random Forest
• Standard Bagging
• Feature Bagging
• Extra Trees
• Pasting
• Random Patches

2. Boosting

• AdaBoost
• Gradient Boosting
• XGBoost
• CatBoost
• LightGBM

3. Stacking

• Blended Stacking
• Stacking with CV
• Restacking
• Weighted Stacking
• Multilayer Stacking
• Hierarchical Stacking

4. Voting

★ Classification

Evaluation Matrix

• Confusion Matrix
  Type I error, Type I error, RoC AUC,
  Precision, Recall, Sensitivity, Specificity, f1_score

★ Regression

Loss evaluation

• Regression Loss Functions ★ Main ★
  • Mean Squared Error
  • Root Mean Squared Error
  • Mean Absolute Error
  • Huber Loss
  • Mean Squared Logarithmic Error
  • Mean Absolute Percentage Error
  • Mean Bias Error
  • Log-Cosh Loss

Unsupervised Machine learning

★ Concepts

• Unsupervised ML
• Dimensionality Reduction

★ Cluster Evaluation

Evaluation Introduction

• Sum of Squared Error
• Silhouette Score
• Dunn Index
• Davies-Bouldin index
• Calinski-Harabasz Index

★ Distance Measures

1. Geometric DM

• Euclidean Distance
• Manhattan Distance
• Chebyshev Distance
• Minkowski Distance
• Generalized Lp Norm

2. Angular/Similarity-Based

• Cosine Similarity

3. Sets and Sequence DM

• Jaccard Distance
• Hamming Distance
• Levenshtein Distance

★ Algorithms

• PCA
• K-means

🛡 Mathematics and Statistics

The Basics

Statistics: The Basics

• Bernoulli Distribution
• Binomial Distribution
• Poisson Distribution

Continuous Probability Distributions

• Uniform Distribution
• Exponential Distribution
• Beta Distribution
• Gaussian Distribution

Entropy

• Entropy (Shannon Entropy)
• Joint Entropy
• Conditional Entropy
• Mutual Information
• Information Gain

The Specifics

• R-Square
• Residuals
• ANOVA
• P-Value
• Entropy Math
• Covariance, Correlation

ᯓ ✈︎ About me