A matrix is a two dimensional array of data.
A vector is an array of data expanding in one dimension.
A tensor is an array of data expanding in multiple independent dimensions.