Sparse and Redundant Representations

A long long time ago, echoing philosophical and aesthetic principles that existed since antiquity, William of Ockham enounced the principle of parsimony, better known today as Ockhams razor: Entities should not be multiplied without neces sity. Th...