An Information Theoretic Algorithm is a learning algorithm that uses an information theory-based measure.