????t?s? ?????f???a? (Information Retrieval

1
????t?s? ?????f???a?
???d?as? S?et???t?ta? (Relevance Feedback ? RF)
2
?e??e??µe?a

• ????t??
• ??p?? a??d?as??
• ?e?????? a??d?as??
• d?a??sµat??? µ??t???
• p??a????at??? µ??t???
• ?pe?t?se??
• ?e???? ap?te??sµata

3
????t??

• ?? ?a p??pe? ?a ???e? a? ? ???st?? de? e??a?
  ??a??p???µ???? ap? t?? ap??t?s? p?? ??aße se µ?a
  p????f???a?? a?????
• ???a??? ??se??
• ??at?p?s? t?? e??t?µat?? µe d?af??et??? t??p?.
• ???sa?µ??? t?? e??t?µat?? ap? t? s?st?µa.

4
???sµ??

• ?e t?? ??? a??d?as? (feedback) e?????µe e?e??e?
  t?? te?????? p?? ????? ?? st??? ?a ße?t??s??? µ?a
  e??t?s? ???st? ?a? ?a d?e????????? t?? a???t?s?
  p????f???a? s?et???? µe a?t? p?? ??t? ? ???st??.
• St???? t?? ße?t??s?? a?t?? e??a? ?a a????e? ?
  ap?te?esµat???t?ta ?a? ? ???st?? ?a ??ße?
  ?a??te?e? apa?t?se?? se s??s? µe t?? p??????µe??
  e?t??es?.

5
?a??de??µa ???d?as??
6
?a??de??µa ???d?as??

• ? p??t? ap??t?s?

7
?a??de??µa ???d?as??

• ???d?as? (ep??????µe t?? e????e? µe p??s???
  pe????aµµa)

8
?a??de??µa ???d?as??

• ?p?te??sµata µet? t?? a??d?as?

9
? ??ad??as?a t?? ???d?as??
? d?ad??as?a t?? a??d?as?? µp??e? ?a epa?a??f?e?
pe??ss?te?e? f????.
10
??p?? ???d?as??

• ??????a µe t?? t??p? p?? ?aµß??eta? ? a??d?as?
  t?? ???st? d?a??????µe t??? e??? t?p???
  a??d?as??
• ?µes? a??d?as? ? ???st?? ep????e? ta s?et???
  ????afa µe ?µes? t??p? (ep?????)
• ?µµes? a??d?as? t? s?st?µa p??sd?????e? ta
  s?et??? ??a t? ???st? ????afa ap? t?? t??p?
  e??tas?? t?? ap?te?esµ?t?? ap? t? ???s?
  (browising)
• ?e?d?a??d?as? t? s?st?µa a?ap??sa?µ??e? µ??? t??
  t? e??t?µa µe ß?s? ta p??ta ????afa t??
  ap?te??sµat?? ????? t?? pa??µßas? t?? ???st?.

11
??p?? ???d?as??

• ? µ???d?? a??d?as?? ep??e??eta? ?a? ap? t?
  µ??t??? a???t?s?? p?? ???s?µ?p??e?ta?. Ta
  e?et?s??µe t?? a??d?as? ??a ta p?? ???st? µ??t??a
  a???t?s??
• Boolean
• ??a??sµat???
• ???a?a????at???

12
???d?as? st? Boolean ???t???

• Ge???? p??te????ta? d?? µ???d?? ??a ???p???s? RF
  se Boolean s?st?µata
• ?a???s?as? µ?a? ??sta? ap? ????? p??a???? ?????
  e??t?µat?? (a?t??? p?? eµfa?????ta? p?? s???? sta
  s?et??? ????afa) ?a? ?a ?ta? ?a?? ?a
  s?µpe????f???? se ??? e??t?µa
• ?? s?st?µa t??p?p??e? a?t?µata t??? ????? ?a?
  t??? ???????? te?est?? µe ß?s? ta ????afa p??
  ??e? ep????e? ?? s?et??? ? ???st??.

13
???d?as? st? ??a??sµat??? ???t???

• ? p?? ???st? µ???d?? a??d?as?? st? ??a??sµat???
  µ??t??? e??a? ? µ???d?? t?? Rocchio.
• T????µe ?a µe??st?p???s??µe t?? p?s?t?ta
• Sim(Q, R) Sim(Q, C-R)
• ?? ß??t?st? e??t?µa p?? p??pe? ?a d?at?p?s??µe
  ?ste ?a d?a????st??? ta s?et??? ????afa ap? ta µ?
  s?et??? e??a? (?ta? ???s?µ?p??e?ta? ?µ???t?ta
  s???µ?t????)

C s?????? e????f??, R s????? s?et????, NR
s????? µ? s?et????
14
???d?as? st? ??a??sµat??? ???t???

• ?st? ?t? ????µe ??a µ??? s?et??? ????af? (?st? r)
  ?a? ??a µ??? µ? s?et??? ????af? (?st? nr). G?a ?a
  µp???s??µe ?a d?a????s??µe t? ??a ap? t? ????, t?
  d????sµa t?? ß??t?st?? e??t?µat?? Qopt ?a e??a?
  (??a s???µ?t???)
• vec(Qopt ) vec(r) vec(nr)

15
???d?as? st? ??a??sµat??? ???t???
16
???d?as? st? ??a??sµat??? ???t???
x
x
x
x
o
x
x
x
x
x
x
x
x
o
x
x
o
x
o
x
o
o
x
x
x µ? s?et??? ????afa o s?et??? ????afa
ß??t?st? e??t?µa (Qopt)
17
???d?as? st? ??a??sµat??? ???t???

• ???ß??µa t? ß??t?st? e??t?µa de? µp??e? ?a
  ß?e?e? st?? p????.
• G?at??

???t? de ????????µe e? t?? p??t???? t? s????? t??
s?et???? e????f??. ?? ta ??????aµe p???? ? ?????
?a e?te??s??µe t? e??t?µa?
18
???d?as? st? ??a??sµat??? ???t???
St?? p???? ???s?µ?p??e?ta? ? a???????? t?p?? ??a
t? µetaß??? ??? d?a??sµat?? t?? a??????
e??t?µat??.
qm µetas??µat?sµ??? e??t?µa q0 a?????
e??t?µa a,ß,? ß??? R s????? s?et????
e????f?? NR s????? µ? s?et???? e????f??
?? ??? e??t?µa ?a e??a? p?? ???t? sta s?et???
????afa (ap? a?t? p?? ep??e?e ? ???st??) ?a? p??
µa???? ap? ta µ? s?et??? ????afa.
19
???d?as? st? ??a??sµat??? ???t???
a????? e??t?µa
x
x
x
o
x
x
x
x
x
x
x
o
x
o
x
o
x
x
o
o
x
x
x
x
x µ? s?et??? ????afa o s?et??? ????afa
a?a?e???µ??? e??t?µa
20
???d?as? st? ??a??sµat??? ???t???
S??????, ? lt ?
0
4
0
8
0
0
0
4
0
8
0
0
a????? e??t?µa
()
1
2
4
0
0
1
2
4
8
0
0
2
?et??? a??d?as?
(-)
2
0
1
1
0
4
8
0
4
4
0
16
a???t??? a??d?as?
-1
6
3
7
0
-3
??? e??t?µa
21
???d?as? st? ???a????at??? ???t???
? s????t?s? ?µ???t?ta? t?? ???a????at????
µ??t???? e??a? ?p?? ? ?????s? af??? st???
????? p?? ß??s???ta? ?a? sto e??t?µa ?a? st?
????af?.
22
???d?as? st? ???a????at??? ???t???
?????? ??t??µe t?µ?? st?? p??a??t?te? pi
P(xi R) c ri P(xi R) ni / N ?p??
c e??a? µ?a t??a?a sta?e?? (p.?., 0.5) ni
e??a? t? p????? t?? e????f?? p?? pe??????? t??
i- ?st? ??? N p????? e????f?? s???????
23
???d?as? st? ???a????at??? ???t???
???a? p??fa??? ?t? ? a??a??et? a???es? t?µ?? de?
µp??e? ?a ?d??e? p??ta se ??a??p???t???
ap?te??sµata. G?a t? ße?t??s? t?? p???t?ta? t??
ap?te?esµ?t?? ?? p??te? efa?µ???? t??
???a????at???? µ??t???? ??e?a??ta? t?? pa??µßas?
t?? ???st? ??a t?? a?ap??sa?µ??? t??
t?µ??. ??a??a?t??? µp??e? ?a ???s?µ?p????e? ?a?
a?t?µat?p???-µ???? t??p??. ?????? e?te?e?ta? t?
e??t?µa µe t?? a?????? e?t?µ?se??. ?p??????ta? ta
k ?a??te?a ????afa. ?st? ki ? a???µ?? t??
e????f?? p?? pe??????? t?? i-?st? ???.
T?t??µe pi P(xi R) ki / k ri P(xi R)
(ni - ki) / (N - k)
24
????t?s? ????

• ?a vector space ?a? probabilistic µ??t??a
  ?p???t??? ?t? ?? ???? e??a? a?e???t?t?? µeta??
  t???.
• ??t? s?µa??e? ?t? ? pa???s?a e??? ???? se ??a
  ????af? de? ep??e??e? t?? p??a??t?ta pa???s?a?
  e??? ????? st? ?d?? ????af?.
• St?? p?a?µat???t?ta de? ?s??e? ??t? t?t??? ?a? ?
  e?s?µ?t?s? t?? p????f???a? s?s??t?s?? ??p????
  ???? ?a µp????se ?a ße?t??se? t??
  ap?te?esµat???t?ta t?? a???t?s??.
• ???a? d?s???? ? ep?t???? ???s? a?t?? t??
  p????f???a? µe ap?de?t? ?p?????st??? t??p?.

25
???aµ??? ??a??t?s?

• ?at? ??a µe???? µ???? st? d???e?? p?? ???eta? ??a
  t? RF ?p???e? ? pa?ad??? ?t? ? p????f???a p??
  a?a??te? ? ???st?? de µetaß???eta? ?at? t?
  d????e?a t?? a?a??t?s??.
• ?? a?t? de? s?µßa??e?, t?te ta ????afa p??
  ?a?a?t???st??a? s?et??? st?? a??? t?? a?a??t?s??
  µp??e? ?a µ?? e??a? ?a?? pa?ade??µata ??a t? t?
  ?e??e? ? ???st?? s?et??? µet?.
• ?e ???s? ageing component µp??e? ?a µe???eta? t?
  ß???? e??? ???? ?s? pe???e? ? ?????? ?ste ?a ??e?
  µ????te?? ep?d?as? st?? e??es? e????f??.

26
????t??? ???d?as?

• ? a???t??? a??d?as? e??a? µ?a µ??f? a??d?as?? p??
  ???s?µ?p??e? p????f???a ap? ????afa p?? ?????
  ?a?a?t???ste? ?? µ?-s?et??? ap? t? ???st?.
• ? a???t??? a??d?as? ?e??e?ta? p??ß??µat??? ??a
  t?e?? ??????
• ??te ??a? ???st?? ?a p??pe? ?a ?a?a?t????e? ??a
  ????af? ?? µ?-s?et??? ???a? p?? d?s???? ap? t?
  ?a?a?t???sµ? ?? s?et???.
• ?? ?a pe??µ??e? ?a?e?? ap? t??? ???ste? ?a
  ep??????? ????afa ?? µ?-s?et??? st?? a?a??t?s?
  µp??e? ?a e??a? d?s???? st?? ???p???s? p?a?t???.

27
S?et??? µe t?? ?e?d?a??d?as?

• ??a e?a??a?t??? p??s????s? p?? e??a? ???st? ??
  pseudo, blind ? ad-hoc RF, ???s?µ?p??e? te??????
  RF ??a ?a ße?t??se? a?t?µata t?? ?at?ta?? p???
  pa???s?ast??? ta ????afa st? ???st?.
• ?? s?st?µa ?atat?sse? ta ????afa ap? t? a?????
  e??t?µa, ep????e? ???a ap? a?t? p?? e??a? p??ta
  st? ?at?ta?? ?a? e?te?e? µ?a epa?????? RF,
  ?e????ta? ?? s?et??? ta ????afa p?? ep??e?e. ?e
  t? ??? e??t?µa p?? pa???eta? eµfa???eta? st?
  ???st? µ?a ??a ?at?ta?? e????f?? p?? e??a?
  ße?t??µ??? se s??s? µe t?? a?????.
• ? pseudo RF te????? ?e?t????e? ??a??p???t??? ??a
  ?a?? a????? e??t?µata a??? e??a?
  a?ap?te?esµat??? ??a ?a?? a????? e??t?µata.

28
??ad?ast??? ?pa???s? ???t?µat??

• ?? µ???d?? ??a t??p?p???s? e??t?µat?? p?? ?????
  pe????afe? ?? t??a ep??????? a?t?µata ????? ap?
  ????afa ?a? p??s??t??? ??p????? st? e??t?µa.
• ??a? e?a??a?t???? t??p?? e??a? ?? ???ste? ?a
  ep??????? t??? ????? p?? ?a p??ste???? st?
  e??t?µa (IQE - interactive query expansion).
• ??a??t?se?? ??a t?? ?p??e? ? ???st?? µp??e? ?a
  e?t?p?se? e????a s?et??? p????f???a ?fe????ta?
  pe??ss?te?? ap? IQE.
• ??a??t?se?? se pe??pt?se?? p?? ??e? a?a?t??e?
  ???? s?et??? p????f???a ?fe????ta? ap? IQE.
• ???a? p?? p??a?? ?? ???ste? ?a ???s?µ?p???s???
  IQE se µ?a p???p???? ? d?s???? a?a??t?s?.

29
?e??aµat??? ?p?te??sµata
Ta e?et?s??µe µe???? ap?te??sµata ap? t?? e??as?a
Jürgen Koenemann and Nicholas J. Belkin. (1996) A
Case For Interaction A Study of Interactive
Information Retrieval Behavior and Effectiveness.
Proceedings of SIGCHI 1996 Conference on Human
Factors in Computing Systems (CHI 1996).
30
?e??aµat??? ?p?te??sµata

• Opaque (black box)
• ? ???st?? de? µp??e? ?a de? t? d?ad??as?a
  a??d?as??.
• Transparent
• ? ???st?? µp??e? ?a de? t??? ????? p??
  d?µ?????????a? ap? t?? a??d?as? a??? de? µp??e?
  ?a µetaß??e? t? e??t?µa.
• Penetrable
• ? ???st?? µp??e? ?a µetaß??e? t? e??t?µa.

31
?e??aµat??? ?p?te??sµata

• ?a???s?as? t?? e?????? st??? s?µµet????te?
• 64 a??????? ???ste?
• ? st???? e??a? ? s??e??? µetaß??? t?? e??t?µat??
  ??? ? a???ße?a ?a e??a? se ??a??p???t??? ep?peda.
• ???s?µ?p??????e t? s?st?µa INQUERY
• ?a ded?µ??a p?? ???s?µ?p??????a? e??a? ap? t?
  s?????? TREC ????afa ap? t? Wall Street Journal.
• ??? a?t??e?µe?a a?a??t?s??
• Automobile Recalls
• Tobacco Advertising and the Young
• ? s?et???t?ta t?? e????f?? ??e? ?a????ste? ap? t?
  TREC ?a? t?? ???a??t? t?? pe??aµat???? µe??t??.

32
?e??aµat??? ?p?te??sµata
33
??e??e?t?µata

• S??????, a????e? t?? a???ße?a sta ap?te??sµata.
• ???e? t? d??at?t?ta ?a ß?e?e? ??a ?a??te??
  e??t?µa ????? ?a apa?te?ta? ap? t? ???st? ?a
  d?at?p?se? ??a ??? e??t?µa ap? t?? a???.
• ?????? ???p???s? ?a? efa?µ??? sta p?? d?µ?f???
  µ??t??a a???t?s?? (boolean, vector, probabilistic)

34
?e???e?t?µata

• ?????? f???? ?? ???ste? d?st????? ?a
  ???s?µ?p???s??? a??d?as?.
• ? ?????? epe?e??as?a? t?? e??t?µ?t?? p??fa??? ?a?
  a????eta?.
• ?e????? f???? de? e??a? p??fa??? ??a p?? ????
  ??e? ep?st?afe? ??a ????af?.

35
???s?µ?? S??desµ??

• S?st?µa a???t?s?? e?????? µe d??at?t?ta a??d?as??
• http//amazon.ece.utexas.edu/qasim/cires.htm

36
S?????

• ???s? t?? a??d?as?? ??a t?? a???s? t??
  ap?te?esµat???t?ta?.
• St?? ?µesa a??d?as? apa?te?ta? ? pa??µßas? t??
  ???st?.
• ??daµe t? ???s? t?? a??d?as?? sta p?? d?µ?f???
  µ??t??a ?a? d????e ?µfas? st? ??a??sµat???.