Tensor Network Theory - Is a tensor just a matrix?

An N-dimensional data container is a tensor. The two terms are often mistakenly used interchangeably; tensors are extensions of matrices to N-dimensional space, while the matrix is actually a 2-dimensional tensor.