ML-AI Garden
🛡 Machine Learning
Feature engineering
★ Concepts
★ Feature Selection
ᯓ ✈︎ Various Approaches of "Feature Selection"
Few more will be added soon ➛ Work In Progress
| Anova F-Test | Information Gain | Dispersion Ratio |
|---|---|---|
| Mutual Information | Pearson Correlation | Variance Threshold |
| Entropy (Entropy Math) | Mean Absolute Difference | Fisher's Score |
| Chi-Square |
★ Pre-processing
| Feature Transformation & Scaling ★ Main ★ |
|---|
| Feature Transformation & Scaling - A Step-by-Step Guide |
| Feature Transformation & Scaling - Summary |
I. Transformation Techniques
| Log Transformation | Logit Transformation | |
|---|---|---|
| QuantileTransformer | PowerTransformer | Polynomial Transformation |
| Square Transformation (x²) | Reciprocal Transformation (1/x) | Square Root Transformation (√x) |
II. Scaling Techniques
★ Statistical Plots for Data Analysis
★ Statistical Test for Normal distribution
| Skewness and Kurtosis | Kolmogorov-Smirnov Test | D'Agostino-Pearson Test |
|---|---|---|
| Jarque-Bera Test | Shapiro-Wilk Test | Anderson-Darling Test |
Modeling
★ Concepts
| Multicollinearity | ||
|---|---|---|
| Bias, Variance ➛ The Bullseye Target | ||
| Derivatives ➛ Partial Derivatives ➛ Gradient | ||
| Logit ➛ Maximum Likelihood Estimation ➛ Cross Entropy Loss | ||
| Sigmoid ➛ Softmax | ||
| Hyperparameter Tuning Grid Search, Randomized Search, Successive Halving, Bayesian Optimization |
★ Algorithms
★ Classification
Evaluation Matrix
Type I error, Type I error, RoC AUC,
Precision, Recall, Sensitivity, Specificity, f1_score
Precision, Recall, Sensitivity, Specificity, f1_score
★ Regression
Loss evaluation
🛡 Mathematics and Statistics
The Basics
Mean, Median, Mode, Range, IQR, Dispersion, Standard Deviation,
Variance, Covariance, Correlation, Standard Error, Z-Score, T-Score
Probability: The Basics
Counting Principles, Permutations, Combinations,
Probability, Conditional Probablility, Law of Total Probability,
Independent Events, Mutually Exclusive Events, Bayes Theorem
Probability Distribution
Random Variables
Discrete Probability Distributions
Continuous Probability Distributions
Entropy