Naive%20Bayes%20???

1
??????8.?????????????

• ????????????? ?? ??

2
???????

• ??????
• Naive Bayes ???
• ??????
• ???????
• ????
• http//www.jaist.ac.jp/tsuruoka/lectures/

3
?????????????

• ??????
• ???????????????????
• ?????
• ??????????????????
• ??????
• ?????????????????
• ???????
• ?????????

4
Naive Bayes ???Chapter 6.9 of Mitchell, T.,
Machine Learning (1997)

• Naive Bayes ???(classifier)
• ??????
• ????????
• ?????????????
• ???????????
• ?????????
• ?????

5
Bayes ???

• Thomas Bayes (1702 1761)
• ????????(????)?????????????????????????

6
Bayes ???(?)

• ????????????????????????????????????

7
Bayes ???(?)

• ?????????????

8
Naive Bayes ???

• ?????????????

??????
?????????? ??
?????????
9
??????
Day Outlook Temperature Humidity Wind PlayTennis
D1 Sunny Hot High Weak No
D2 Sunny Hot High Strong No
D3 Overcast Hot High Weak Yes
D4 Rain Mild High Weak Yes
D5 Rain Cool Normal Weak Yes
D6 Rain Cool Normal Strong No
D7 Overcast Cool Normal Strong Yes
D8 Sunny Mild High Weak No
D9 Sunny Cool Normal Weak Yes
D10 Rain Mild Normal Weak Yes
D11 Sunny Mild Normal Strong Yes
D12 Overcast Mild High Strong Yes
D13 Overcast Hot Normal Weak Yes
D14 Rain Mild High Strong No
10
Naive Bayes ???

• ??
• ltOutlook sunny, Temperature cool, Humidity
  high, Wind stronggt

11
????????

• ????
• ????????????

12
??????????

• ????
• ????????????

13
????????
??????
14
??????

• ????
• ????????????
• ?????????????????????
• m-estimate of probability

?????????????
equivalent sample size
15
Naive Bayes ?????????

• ??????
• ????????????????
• ??????????????
• ???????????
• ?
• ???(???)???????

16
There were doors all round the hall, but they
were all locked and when Alice had been all the
way down one side and up the other, trying every
door, she walked sadly down the middle, wondering
how she was ever to get out again.
17
???????????

• ????????????????
• ??????m-estimate ?????????

???????2????? were ???????
18
??????

• ???????????????????
• ???????
• ????????????????
• ???????????k-means, etc..
• ?????????
• ????????????????????
• Association rules, ????????, etc

19
???????

• ????????????????
• ??????????
• ???????????

20
??????????

• ???????????
• ? ???????????????????
• ??????
• ?????????????????????
• ??????????????????????????
• ???????????????? 2 ???????

21
??????????

• ?

??????? (Dendrogram)
1
3
2
5
4
1 2 3 4 5
22
???????????
?????(single link)
?????(complete link)
????(group-average)
???(centroid)
23
k-means?

• ???????
• ???
• ??????
• k?????c1,ck????????
• ?????????????????????????
• ???????????????2???????

24
k-means?

• ?????
• ???????
• ????? k ?????????????
• ????????????????
• ??????????????

25
??????

• ????????????????????

Outlook Temperature Humidity Wind PlayTennis
Sunny Hot High Weak No
Sunny Hot High Strong No
Overcast Hot High Weak Yes
Rain Mild High Weak Yes
Rain Cool Normal Weak Yes
Rain Cool Normal Strong No
Overcast Cool Normal Strong Yes
Sunny Mild High Weak No
Sunny Cool Normal Weak Yes
Rain Mild Normal Weak Yes
26
??????(??)

• ?1
• ?????????????????????????????????????????
  information gain ???????????????
• ?2
• Naive Bayes ?????????????????