Pranesh

“Probability theory naturally comes into play in what we shall call situation 1: When the data-point can be considered to be generated by some randomizing device, for example when throwing dice, flipping coins, or randomly allocating an individual to a medical treatment using a pseudo-random-number generator, and then recording the outcomes of their treatment. But in practice we may be faced with situation 2: When a pre-existing data-point is chosen by a randomizing device, say when selecting people to take part in a survey. And much of the time our data arises from situation 3: When there is no randomness at all, but we act as if the data-point were in fact generated by some random process, for example in interpreting the birth weight of our friend’s baby.”
― David Spiegelhalter, The Art of Statistics: Learning from Data

“For a Bayesian, in fact, there is no such thing as the truth; you have a prior distribution over hypotheses, after seeing the data it becomes the posterior distribution, as given by Bayes’ theorem, and that’s all.”
― Pedro Domingos, The Master Algorithm: How the Quest for the Ultimate Learning Machine Will Remake Our World

“It’s simple math, you know. Classic bell curve. Normal distribution. Most people are going to pile up in the middle, not going anywhere, but there’ll be a handful of outliers that go high and low, often for inexplicable reasons. Point is, even survivors don’t really understand why they survive—they just do.”
― Peter Cawdron, Losing Mars

“Our search for the Master Algorithm is complicated, but also enlivened, by the rival schools of thought that exist within machine learning. The main ones are the symbolists, connectionists, evolutionaries, Bayesians, and analogizers. Each tribe has a set of core beliefs, and a particular problem that it cares most about. It has found a solution to that problem, based on ideas from its allied fields of science, and it has a master algorithm that embodies it.”
― Pedro Domingos, The Master Algorithm: How the Quest for the Ultimate Learning Machine Will Remake Our World