






Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
Community
Ask the community for help and clear up your study doubts
Discover the best universities in your country according to Docsity users
Free resources
Download our free guides on studying techniques, anxiety management strategies, and thesis advice from Docsity tutors
Occam's Razor is a philosophical principle attributed to William of Ockham, a 14th-century English logician and Franciscan friar. The principle suggests that the simplest explanation is the best one, as it makes the fewest assumptions and introduces the fewest entities. This concept is often applied in various fields, including science, decision making, and problem-solving. In this document, we explore the origins and applications of Occam's Razor, as well as its relevance to decision trees and machine learning.
What you will learn
Typology: Summaries
1 / 11
This page cannot be seen from the preview
Don't miss anything!
Occam's razor (sometimes spelled Ockham's razor) is a principle attributed to the 14th- century English logician and Franciscan friar William of Ockham. The principle states that the explanation of any phenomenon should make as few assumptions as possible, eliminating those that make no difference in the observable predictions of the explanatory hypothesis or theory.
This is often paraphrased as "All other things being equal, the simplest solution is the best." In other words, when multiple competing theories are equal in other respects, the principle recommends selecting the theory that introduces the fewest assumptions and postulates the fewest entities. It is in this sense that Occam's razor is usually understood.
Decision Trees as If-then-else rule conjunction disjunction •If (Outlook = Sunny AND humidity = Normal) then PlayTennis = Yes •If (Outlook = Overcast) then PlayTennis = Yes •If (Outlook = Rain AND Wind = Weak) then PlayTennis = Yes
Outlook Temperature Humidity Wind Which attribute to select ????? Root node
ID3 Strategy for Selecting Hypothesis
Later formulations
Other Applications