Dictionary of Applied Machine Learning

Supported by Forward-Looking AI Governance in Banking and Insurance (FLAIG) (Business Finland, record no. 7360/31/2023); A Mathematical Theory of Trustworthy Federated Learning (Research Council of Finland, decision no. 363624); A Mathematical Theory of Federated Learning (TRUST-FELT) (Jane and Aatos Erkko Foundation, decision no. A835).

Course edition, CC BY 4.0. Each term links a typeset PDF and a Python script that recomputes what the entry states; py marks a term whose demo runs in the browser via Colab.

Start here · Demos · How this book is built · List of symbols · For instructors · The linters · People

• accuracy py
• artificial neural network (ANN) py
• attention py
• autoencoder py
• backpropagation py
• bagging py
• baseline py
• binary classification py
• boosting py
• bootstrap py
• classification py
• clustering py
• concept activation vector (CAV) py
• confusion matrix py
• convex py
• covariance matrix py
• data py
• data augmentation py
• data imputation py
• data leakage py
• data point py
• dataset py
• decision tree py
• dimensionality reduction py
• distribution shift py
• eigenvalue py
• eigenvalue decomposition (EVD) py
• empirical risk minimization (ERM) py
• ensemble py
• expectation–maximization (EM) py
• explainability py
• explainable artificial intelligence (XAI) py
• explanation py
• feature py
• feature importance py
• feature learning py
• feature matrix py
• feature vector py
• fine-tuning py
• Gaussian mixture model (GMM) py
• Gaussian random variable (Gaussian RV) py
• generalization py
• gradient py
• gradient descent (GD) py
• Hilbert space py
• hyperparameter py
• hypothesis py
• hypothesis space py
• independent and identically distributed assumption (i.i.d. assumption) py
• independent and identically distributed (i.i.d.) py
• inner product py
• interpretability py
• interpretable machine learning (interpretable ML) py
• kernel method py
• kernel ridge regression py
• k-fold cross-validation (k-fold CV) py
• k-means py
• label py
• large language model (LLM) py
• learning rate py
• linear classifier py
• linear regression py
• logistic loss py
• logistic regression py
• loss py
• machine learning pipeline (ML pipeline) py
• matrix py
• mean py
• membership inference attack py
• model py
• model selection py
• norm py
• online learning py
• overfitting py
• policy (reinforcement learning) py
• pretraining py
• principal component analysis (PCA) py
• probability distribution py
• projection py
• random experiment py
• random forest py
• random variable (RV) py
• regularization py
• reinforcement learning (RL) py
• reward py
• robust principal component analysis (robust PCA) py
• sample size py
• self-supervised learning py
• sigmoid function py
• singular value decomposition (SVD) py
• Sobolev space py
• stochastic gradient descent (SGD) py
• supervised learning py
• support vector machine (SVM) py
• tabular data py
• test set py
• training py
• training error py
• training set py
• transfer learning py
• transformer py
• transparency py
• trusted execution environment (TEE) py
• unsupervised learning py
• validation error py
• validation set py
• variance py