Searching behavior

1
Searching behavior evaluation of IR

• ???
• anadem_chungatyahoo.com.tw

Oct. 27, 2003
This work is licensed under a Creative Commons
Attribution-NonCommercial-ShareAlike 2.5 License.
2
??

• ???????????????????????
• ????????????
• ????????????

3
???????????????????????
4
?????????????????????

• ??????
• Wilson ???????
• ????????
• Ellis ?????????
• Kuhlthau ?????????
• Marchionini ?????????
• ????????
• Saracevic ???????????
• Spink ?????????
• Choo?Detlor ? Turnbull?????????
• Navarro-Prieto?Scaife ? Rogers ???????????
• Holscher ? Strube ???????????

5
????????????????????
????
??????
??????
????Wilson (1999)
6
Wilson ???????
????Wilson (1997)
7
Ellis ?????????
??
??
??
??
??
??
??
??
????Wilson (1999)
8
Kuhlthau ?????????
????????? ??????( feelings ) ??????( thoughts ) ??????( actions ) ?????( task )
1.?? ??? ????? ?????? ??????
2.?? ?? ??????
3.?? ???????? ?????? ?????????
4.?? ?? ????? ????
5.?? ?????? ???? ????????? ?????????
6.?? ?????????? ????? ????????
????Kuhlthau (1991)
9
Marchionini ?????????
???? ?????? ??????
????Marchionini (1995)
10
Saracevic ???????????
?
???????
????Saracevic (1997)
11
Spink ?????????
????Spink (1997)
12
Choo?Detlor ? Turnbull?????????
?? ?? ?? ?? ?? ??
Ellis????????? ??????????????? ????????????????????????? ??????? ??????????,????? ??????????,?????????????? ??????????,???????????
Choo????????????? ???????????????????????? ?????????????? ?????????????,????????? ???????????????????? ??????? ??????,???? ??????????? ???????????
????Choo, Detlor, Turnbull (1999)
13
Navarro-Prieto?Scaife ? Rogers ??????????? ( I )
?????????
????Navarro-Prieto, Scaife, Rogers (1999)
14
Navarro-Prieto?Scaife ? Rogers ??????????? ( II )
??????????????????????????????
???????????????
?????????
????Navarro-Prieto, Scaife, Rogers (1999)
15
Holscher ? Strube ??????????? ( I )
????
.19 .05
.81
.31
.64
???(???)??
???????????
.59
.30
.27
.04
.01
???? ??
.39
.07
.15
????
.23
.06
.03
.10
??
??
.72
????Holscher Strube (2000)
16
Holscher ? Strube ??????????? ( II )
.43
????Holscher Strube (2000)
17
????????????
18
??????????

• ???
• ???
• ????

19
???? - ???
??? (Precision)
??? ( Recall )
??? ( Fallout )
?????????,?????
??????????????????? (???) ,??????????????????
(???)?(???,?85)
20
??????????
???????????
????????????????? ????,????,????????,????????,???
??
21
??????????

• ?? (relevance) ????????
• ???????,?????
• ???? (c) ??????????
• ???????????,??????????,??????????,???????????

???????(?89)Chowdhury (1999) p. 208
22
???? (Relevance)

• ???????????IR????????,???????????? (????),??????
  (????) ?
• ??????
• ???? (subject relevance)???????????????
• ???? (logical relevance)William Cooper 1971???
• ???? (situation relevance)???????????????
  (Patrick Wilson??)
• ???? (psychological relevance)???????????????????
  ?(contextual effect)????????? (Steven Harter 1992
  ???)

???????(?89)
23
???? - ??? (Utility)

• Cooper??,??????????? (rewards) ??? (penalties)
• ??????????????????????
• ?????????????????????????????
• ??,?????????????????,????????????????????????
• ????,??????????????????????????,???????????????

???????(?85)
24
??????

• ????????????
• ???????????????????? (???????????????????)
• ???????????????????,???????????
• ?????????,???????????????

???????(?89)???(?85)
25
??????????
???? ???? (parameters) ??
??????? ??????????
???? ??????? (queries) ???
????????? ?????????
???? ?????,???????
???? ??????????????????
????Salton McGill (1983) as cited in Chowdhury
(1999) p.204
26
????????????
27
??????????

• Cranfield ??
• SMART ??
• STAIRS ??
• ?????? (TREC)

28
Cranfield ?? - ????

• ??1950????,???1960?????
• Cranfield ?????????,??Cleverdon ???
• ?????????? Cranfield I ???????? Cranfield II ?
• ???? Cranfield ?????,?????????????
  (?????????????????)?

???????(?85),?117
29
Cranfield I

• ???? Cranfield ?????1960????
• ?? Case Western Reserve University????1,100???????
  ???,????????????????????
• ??????? (UDC) ?
• ????? (Facet Classification) ?
• ??????????? (alphabetical subject catalog) ?
• ??????? (uniterm system of coordinate indexing)
• ??????????????????????,??????????????,???????????
  ????

???????(?85),?118
30
Cranfield II ( I )

• ??????????,Cleverdon???????????
• ?????? (single term language) ?
• ???????? (simple concept index language) ?
• ?????? (controlled term index)
• ????????????????????????????? (???????????????
  ),???????????????????? Cranfield??????????????????
  ???

???????(?85),?118
31
Cranfield II ( II )

• ????,???????????????(?????????, post-coordinate
  system) ???????,???????????,?????????????????(????
  ?????, pre-coordinate system) ?
• Cleverdon ???????????????????,????????????????????
  ??????,???????????????,?????????????

???????(?85),?120
32
SMART ?? ( I )

• Salton ?1960 ??????,???????????
  (?SMART??),??Cleverdon ? Cranfield II
  ???????????????
• ??????????????????????????????,???????????????????
  ?
• ??1965?,?????????????????,??????????????????

???????(?85),?125
33
SMART ?? ( II )

• 1973?,Salton ??????????MEDLARS ?????????????,?????
  ????????????????
• 1983?,SMART ????? Cleverdon ??????,???????????????
  
• Salton???????????? (?????) ??????

???????(?85),?126
34
STAIRS (STorage And Information Retrieval
System) ??

• 1985 ??Blair ? Maron ??????? STARIS
  ??????????,?????????????
• ?????????????????????????,??????????79,???????20
  ?
• Blair ? Maron?????????????,79????????,?20???????
  ???????,?????????????????????

???????(?85),?126
35
??

• Salton ??,???????????????,??????????????,?????????
  ????????????,????????????????
• ?????,???????????????????????,????????????????,???
  ?????????????????????????????????????

???????(?85),?128
36
?????? (TREC) ??

• ?????????????????,????????????(Defense Advanced
  Research Projects Agency,??DARPA)???????????(Natio
  nal Institute of Standards and Technology,??NIST)?
  ????????????(Text REtrieval Conference,??TREC)
• ????????????,?????????????????????????????????
• TREC?1992???????,?????????????,?? (2002?11?)
  ????????

???????????(?88)
37
TREC ??? ( I )

• TREC???????????Cranfield?????????,????????????????
  ???????????
• ???(Document Set)
• TREC????????????????????,?????????????
• ??(Topics)
• TREC?????????????????????,????????????,??????????
  ????,???????????,?????(Topics)?????????????????,??
  ?????????,????????????

???????????(?88)
38
TREC ??? ( II )

• ????
• TREC?????????????Nar-rative???????????????,??????
  ????????(??????),??????????????????TREC???poolin
  g?????,????????,?????????????,??????????(???100?),
  ??????pool,???????????????????pool?????????,??????
  ????????????

???????????(?88)
39
TREC?????????

• ??????TREC????TREC-6?5GB????,??350??????????,????
  ????????????????????????TREC???,????????????????
• ???????TREC??????????????????,???????????????????
  ?????,????????????????????????????????????
• ????????TREC?????????????????????????,???????????
  ?,???????????

???????????(?88)
40
???? ( I )

• ???(?89)??????????(???)?
• ???????(?88)?TREC??????????????????????,29?,?36-59
  ?Also available at http//www.lib.nccu.edu.tw/mag/
  admin/29/p36.html
• ???(?85)????????????????????????
• Chowdhury, G.G. (1999). Introduction to Modern
  Information Retrieval. London Library
  Association Publishing.

41
???? ( II )

• Choo, C. W., Detlor, B., Turnbull, D. (1999).
  Information seeking on the web - an integrated
  model of browsing and searching. Proceedings of
  the 62nd ASIS Annual Meeting, 36, 3-16.
• Holscher, C. Strube, G. (2000). Web search
  behavior of Internet experts and newbies. In
  Proceedings of the Ninth International World Wide
  Web Conference, p. 337-346. Retrieved Sept. 1,
  2002 from http//www9.org/w9cdrom/81/81.html
• Kuhlthau, C. C. (1991). Inside the search
  process information seeking form the users
  perspective. Journal of the American Society for
  Information Science, 42(5), 361-371.

42
???? ( III )

• Marchionini, G. (1995). Information seeking in
  electronic environments. New York Cambridge
  University Press.
• Navarro-Prieto, R., Scaife, M., Rogers, Y.
  (1999). Cognitive Strategies in Web Searching.
  Retrieved Sept. 2, 2002 from http//zing.ncsl.nist
  .gov/hfweb/proceedings/navarro-prieto/index.html
• Salton, G., McGill, M.J.(1983). Introduction to
  Modern Information Retrieval. Auckland
  McGraw-Hill as cited in Chowdhury, G.G.(1999).
  Introduction to Modern Information Retrieval.
  London Library Association Publishing.

43
???? ( IV )

• Saracevic, T. (1997).The Stratified Model of
  Information Retrieval Interaction Extension and
  Applications. Retrieved Oct. 19, 2002 from
  http//www.scils.rutgers.edu/tefko/ProcASIS1997.d
  oc
• Spink, A. (1997). Study of interactive feedback
  during mediated information retrieval. Journal of
  the American Society for Information Science,
  48(5), 382-394.
• Wilson, T. D. (1997). Information behaviour a
  interdisciplinary perspective. Information
  Processing and Management, 33(4), 551-572.
• Wilson, T. D. (1999). Models in information
  behaviour research. Journal of Documentation,
  55(3), 249-270

44
P.S.

• ?????????????????????????????
• ??????,???????
• my email anadem_chungatyahoo.com.tw

Thank you