
PDF
... as analyzed in Statistical Learning Theory provide a reason to accept H rather than D? One might suppose that the answer is “no”, because the kinds of analyses provided by Statistical Learning Theory concern how to minimize predictive error and these hypotheses make exactly the same predictions. Ind ...
... as analyzed in Statistical Learning Theory provide a reason to accept H rather than D? One might suppose that the answer is “no”, because the kinds of analyses provided by Statistical Learning Theory concern how to minimize predictive error and these hypotheses make exactly the same predictions. Ind ...
Occam's razor

Occam's razor (also written as Ockham's razor and in Latin lex parsimoniae, which means 'law of parsimony') is a problem-solving principle devised by William of Ockham (c. 1287–1347), who was an English Franciscan friar and scholastic philosopher and theologian.The principle states thatAmong competing hypotheses that predict equally well, the one with the fewest assumptions should be selected. Other, more complicated solutions may ultimately prove to provide better predictions, but—in the absence of differences in predictive ability—the fewer assumptions that are made, the better.The application of the principle can be used to shift the burden of proof in a discussion. However, Alan Baker, who suggests this in the online Stanford Encyclopedia of Philosophy, is careful to point out that his suggestion should not be taken generally, but only as it applies in a particular context, that is: philosophers who argue in opposition to metaphysical theories that involve an allegedly ""superfluous ontological apparatus.""Baker then notices that principles, including Occam's razor, are often expressed in a way that is unclear regarding which facet of ""simplicity""—parsimony or elegance—the principle refers to, and that in a hypothetical formulation the facets of simplicity may work in different directions: a simpler description may refer to a more complex hypothesis, and a more complex description may refer to a simpler hypothesis.Solomonoff's theory of inductive inference is a mathematically formalized Occam's razor: shorter computable theories have more weight when calculating the probability of the next observation, using all computable theories that perfectly describe previous observations.In science, Occam's razor is used as a heuristic technique (discovery tool) to guide scientists in the development of theoretical models, rather than as an arbiter between published models. In the scientific method, Occam's razor is not considered an irrefutable principle of logic or a scientific result; the preference for simplicity in the scientific method is based on the falsifiability criterion. For each accepted explanation of a phenomenon, there is always an infinite number of possible and more complex alternatives, because one can always burden failing explanations with ad hoc hypothesis to prevent them from being falsified; therefore, simpler theories are preferable to more complex ones because they are more testable.