**Scalar:
$𝑥 ∈ R$**
**Vector:
$𝐱 ∈ R^n$**
**Matrix:
$M ∈ R^{m\\times n}$**
Vector-Vector (dot product, inner product)
$$ x^Ty \in R\;\;\;\;\;(x,y\in R^d) $$
Vector-Vector outer product
$$ x\otimes y \;=\;xy^T \in R^{d\times d}\\(x,y\in R^d) $$
Matrix-Matrix Hadamard product
Matrix Transpose properties
Matrix Inverse properties
Orthogonal Matrix