BookadvancedFree
Information Theory, Inference, and Learning Algorithms
by David J. C. MacKay
Unified treatment of information theory, Bayesian inference, coding theory, and machine learning with probabilistic and algorithmic perspectives.
More resources on Probability Theory
WebsiteFree
Seeing Theory
Visual introduction to probability and statistics with interactive visualizations covering basic probability, distributions, inference, and regression.
BookFree
Introduction to Probability
Undergraduate probability theory covering discrete and continuous random variables, expected value, distributions, and limit theorems.