On Information Dimensionality
Humans are good at perceiving and processing only 2D and 3D information
While we humans are naturally selected to perceive the 3D reality via two eyes producing 2D images, information in general is not limited to 2D tables or 3D tensors. Neural networks operate with 1000D tensors.
This human perception dimensionality limitation has given rise to the suite of projection tools (PCA, t-SNE, UMAP, TriMap, PaCMAP) projecting high…