?????%20?.%20????????%20?%20College%20of%20Staten%20Island%20?%20CUNY - PowerPoint PPT Presentation

About This Presentation
Title:

?????%20?.%20????????%20?%20College%20of%20Staten%20Island%20?%20CUNY

Description:

Title: Bilingual and Monolingual Prosody in English and Spanish: Motivations and Procedures for a Research Program Author: efernand Last modified by – PowerPoint PPT presentation

Number of Views:174
Avg rating:3.0/5.0
Slides: 70
Provided by: efer3
Category:

less

Transcript and Presenter's Notes

Title: ?????%20?.%20????????%20?%20College%20of%20Staten%20Island%20?%20CUNY


1
????????????????? ?????? ? ????????????????
  • ????? ?. ???????? ? College of Staten Island ?
    CUNY
  • Sekerina_at_mail.csi.cuny.edu
  • ?????????? ??????? ?? ??????????? ?????
  • 28 ?????? 2005

2
????
  • ??????????? ????? ? ????????????????
  • ?????????? ? ???????????
  • ??????????? ? ????????????????
  • ????????? ??? ??????? ??????????? ?
    ????????????????
  • ????????????????? ??????
  • ?????????????? ? ???????????????? ??????
  • ?????? ???????? ????
  • ???????????? ? ????? ??????

3
????
  • ????? ????? ?????? ???????? ???? (?????????????)
    Visual world paradigm
  • ??????? ??? ?????? ???????? ???? (ISCAN ETL-500)
  • ???????????????? ????
  • 1. ?????? ??????????? ? ???????? ?????????
    (?????????? ? ???????)
  • 2. ???????? ? ???????? (???????)

4
??????????? ????? ? ????????????????
?????????? ???????????????? ???????????
?????????????? ??????????? ???????????? ?????
???????????????? ??????????? ??????????
??????????? ?????
5
???????????????? ? ??????? ??????
  • ???????????????? ??? ????????????????? ?????,
    ??????? ?????? ????? ??????? ?????? ?????????
  • ??? ???? (? ????????) ????????? ????
  • ??? ??? ?????????? ?????? ????????? ?
    ????????????
  • ?????? ????????????? ??????????? ????? (???? ?
    ????).

6
???????????????? ? ??????? ??????
  • (1) ????????? ? ???????????? ???? ?????????
    ?????????? ?????
  • ???? ???? ? ?????? ?????
  • ???????? ??? ?????????? ? ???????? ????????
  • (2) ???????? ?????
  • ???????? ??????? ????? ??????
  • ???????? ??????? ????? ????????? (? ??????)
  • (3) (1) ? (2) ? ?????????????? ???????
    ??????????? ??????????
  • (4) ???????????? ????
  • ?????? ? ???????? ? ????????????? ???? (?????,
    ????????)
  • ?????????? ???????????? ????

7
???????????????? ? ????? ??????
  • ???????????????? ? ????? ??????
  • ?????????? ????????? ????, ??? ??????????
    ???????? ?????????? ? ???????? ???? (? ????),
    ????????? ??? ????? ????????????????? ??????,
    ???????????????? ?? ??????????? ??????????.

8
??????????? ? ????????????????
???????????
????????????????
Psycholinguistics
?????????
????????????
????????
?????????
?????????? ????
??????? ??????
?????????? ????. ?????????
?????????? ????????
?????? ???????????
?????????/ ??????????
?????????
?????????
9
?????????? ? ???????????
  • (1) ???????????? ??????????? ???????
  • ?????????? ???????????
  • ????????? ?????????? ????????? ?????
  • ?????? ??????? ?????
  • ???????? ???????? ?????
  • ???? ?????????????

10
?????????? ? ???????????
  • (2) ?????????? ???????? ??? ?????????? ??????
  • (3) ???? ?????? ? ????? ???????? ??????? ???
    ??????
  • (4) ????????????? ?????????? ???????????

11
?????????
  • ????? ??????? ??? ??????? ?????? ???????? ????,
    ??????? ?? ??????, ??? ???????????, ??????? ??
    ???????
  • ??? ?? ????????? ?? ????????????? ?????, ?????
    ?????????? ??????? ????????? ???????
    ?????????????
  • ???????? ????????? ??????? ?????? ?????????
    ???????????????, ?????? ?????????????.

12
????????? ????
  • ?????????????/????????????? ????
  • ??????????? ?????? ? ????????? ?????? ?
    ?????????? ?????????
  • ?????????????? ?????? ??????????? ? ????????
    ?????????.

13
????????????????? ??????
  • 1. ?????????????? ?????? (off-line)
  • ????????? ??????? ????????? ????? ????, ??? ??
    ??? ??????????
  • ?? ??????? ? ??????? ??????? ???????, ???????
    ?????? ?? ??????? ????????? (???????????? ??????
    ???????????)
  • ?????? ???????? ???????? ?? ??????? ?????????.

14
2. ????????????????? ??????
  • 2. ???????????????? ??????, ??? ????????????
    ?????? (on-line)
  • ????????? ??????? ????????? ?? ???? ????, ??? ??
    ??????????
  • ???????????? ????? ??????? (??????? ???????
    ?????? ? ??????????? ?? ??????)
  • ????? ???????? ???????? ?? ??????? ?????????.

15
?????????????? ??????
  • ?????? ???? ?????????? ????
  • ??????????? ?????? ????????? ? ??????
  • (click detection)
  • ????? ?????????? ?????? ???????????
  • (gating)
  • ???????????? ??????????

16
???????????????? ??????
  • ?????? ???? ?????????? ????
  • ??????????
  • -- ?????? ?????? ? ??????????????
  • -- ????? ????????
  • -- ????? ??????????? ???????
  • ?????????? ?????? ???????? ????
  • ???? (???????????? ???????)
  • ?????-????????? ????????
  • ?????? ???????? ????

17
??? ??????? ??????
  • ??????? ????????????????
  • ??????????? ????????
  • ???????????? ??????? ????????
  • ???????????? ???????????

18
??????????? ? ????????????????
???????????
????????????????
Psycholinguistics
?????????
????????????
????????
?????????
?????????? ????
??????? ??????
?????????? ????. ?????????
?????????? ????????
?????? ???????????
?????????/ ??????????
?????????
?????????
19
?????? ???????? ????
  • ???????????? ?????
  • ???????????? ? 1970-? ??.
  • ???????????? ??? ??????
  • ?????????? ????????? ????????????? ??????
    ???????????
  • ????? ?????
  • ???????????? ? 1995 ????
  • ???????????? ? ?????? ?????
  • ????????????? ???????? ?????? ?? ??????????

20
??? ???????????
  • ?????????????? ???????? ????
  • ??????? ???????? ???? (30-50 ????)
  • ????? ????????? ????? ??????????????? ????????
    (200-300 ????)
  • ????????? ??????????
  • ????? ??????
  • ???????????? ????????
  • ???????????? ???? ????????
  • ???????????? ???????

21
???????????? ?????
  • Rayner, K. (1998). Eye Movements in Reading and
    Information Processing 20 Years of Research.
    Psychological Bulletin, 124(3), 372-422.

22
????? ????? ISCAN ETL-500
  • Tanenhaus, M. K., Spivey-Knowlton, M. J.
    (1996). Eye-Tracking. Language and Cognitive
    Processes, 11(6), 583-588.

23
?????-??????????
Borg Technologies, Inc.
24
ISCAN ETL-500
  • ???????????? ?????? ? ??????? ??????? ????????

25
??????? ?????????????? ??????
  • ????????????? ????? ?????? ???????? ???? ????
    ??????? ?????????????? ? ???????????????? ? 1995
    ?.
  • ?????? ???????????? ???????????? ??????? ??????
    ?????????? ? ??? ????????? (??????????? ?.
    ?????????, ???? ???-????).

26
???????????
  • Rochester University (M. Tanenhaus)
  • University of Pennsylvania (J. Trueswell)
  • University of York (G. Altmann)
  • Brown University (J. Sedivy)
  • Cornell University (M. Spivey)
  • Michigan State University (F. Ferreira)
  • Harvard University (J. Snedeker)

27
???????????????? ???? (1)
  1. ?????? ??????????? ? ???????? ?????????
    ????????????? ?????????? ??????
  2. ????????? ? ????????????? ??????????????
  3. ???????? ? ???????? (?????)
  4. ????????????? ????? ? ?????? ????
  5. ?????????? ? ????????? ??????????? ????
  6. ????????? ? ?????????? ????????

28
1. ?????? ???????????
  • Tanenhaus, M. K., Spivey-Knowlton, M. J.,
    Eberhard, K. M., Sedivy, J. C. (1995).
    Integration of Visual and Linguistic Information
    in Spoken Language Comprehension. Science,
    268(5217), 1632-1634.
  • ?????????????? ?????????????? ????????? ?
    ??????????? ????????? ? ???????? ???????
    ????????? (????????) ???????????? ???????????

29
??????? ??????? ??? ?????????
  • ? ???????? ????????/?????? ???? ?? ???? ?????
    ???????????, ????? ?????? ??? ????????
  • ????????????? ??????????? ??????????????
    ????????, ?? ????? ??????
  • ??? ???? ?? ????????? ???????? ??????? ????????
    ????? ?? ????? ?? ???????.

30
??????????? ??????????????
  • ??????????
  • ???? ????? ????.
  • ?????? ??????????? ???????????? ?? ???????.
  • ???? ???????? ??????.
  • ? ??????????? ?????? ???? ?????? ???????????.
  • ???? ?????????? ??? ????????? ?? ?????
    ??????????.

31
??????????? ??????????????
  • ?????????

???? ????? ??????? ? ... ...
?????. ... ??????. ?????
???????????... ... ???? ????????????.
...???????? ??????? ?????????.
32
??????????? ???????????
  • Garden-Path (to lead down the garden path)

???? ????? ??????? ? ... ....?????. ...????
??. (??????????? ???????????)
????? ???????????... ...????
????????????. ....???????? ???????
?????????. (???????????
???????????)
33
????????????? ?????????? ??????
  • ???????? ??????? ?? ?????????.
  • ???????? ??????? ?? ????????? ? ?????.
  • ????????????? ??1 ?? ????????? ????????
    ???????????
  • ??? ???????? ????? ??? ??????? ????????
  • ??? ??????????? ???????????????? ???????

34
????????????? ?????????? ??????
  • ???????? ??????? ?? ?????????...
  • -- ???????????? ???????? ???????? ?????.
  • ???????? ??????? ?? ????????? ? ?????.
  • -- ????????? ?????????????? ?????????, ?
    ?????????? ??????? ?? ????????????? ????? ?
    ????????????? ???????????.

35
??????
36
?????????????? ??????? (1)
?????????? ???????? 1 ???????? 2 ?????????
37
??????????
  • ????????????????? ?????? (2)
  • ???????? ???????????? ?????????
  • ???????? ??????? ?? ????????? ? ?????.
  • ?????????????? ?????????
  • ???????? ???????,??????? ?? ?????????, ? ?????.
  • ????????? ??????????
  • ???????? ???????????? ?????????? ()
  • ???????? ????
  • ?????, ? ??????? ???? ???????? ???? ?? ??????
    ????????? ()
  • ????????? ?????????? ???????? ????, ????

38
???????? 1-????????
4
1
2
3
39
???????? 2-????????
2
1
40
???????? ? ?????
41
2-????????, ??????????????
42
2-????????, ????????????
43
1-????????, ??????????????
44
1-????????, ????????????
45
??????? ???????
46
3 ?????? ?????????
  • ???????????????
  • ???????? ???????? ??????? ??? (?????? 2003 ?.),
    ??????? ??????? 20.7 ???
  • ???? 4-6 ???, ?.????????? (???? 2003 ?.)
  • ?????????? ???????? ???????? ??????????
    ???????????? ???-?????

47
3 ?????? ?????????
  • ?????, ??????????????
  • ???????? ??????? ?? ????????? ? ? ???????.
  • ???????? ??????? ?? ??????? ? ? ???????.
  • ?????, ????????????
  • ???????? ??????? ?? ????????? ? ???????.
  • ???????? ??????? ?? ??????? ? ???????.

48
??????
  • ???????? ?????????? ???????? ???????? ?? ????????
    (??????????).
  • ????? ????? ?????????????? ??????????????
    ????????? ? ??????????? ????????? ? ????????
    ????????? (????????) ???????????? ???????????.
    ????? ???????? ????????????? ??????? ???????????
    ???????????.
  • ?????? ???????? ???????? ??????? ???????????.

49
??????????????? ??????????????
SEDIVY ET AL. (1999)
Touch the pink comb
????????? ????? ??????? Now touch the yellow
bowl. ??????? ????? ??????? Now touch the
yellow comb.
?? SEDIVY (2003) ?? ??????? ????????? ??????????.
????????????? ?????????? ????????? ????????? ???
???????? ?????????????? ?? ???????? ????????????.
?????????????? ?????????? ????? ??????? ???????
????????? ???????? ??????????????, ???? ???????
???????? ??????? ? ???????? ??????????????? ????
?????? ????? ? ?????????? ?????.
50
??????????????? ? ????????
????? ?? ??????? (??? ???????) ??????? ?????????
??? ?????? ??????????? ??????????????? ???????,
????????, ?????????
?? SEDIVY ET AL. (1999)
??????????? ???????? ?? ????? ?????? Now touch
the YELLOW comb Now touch the yellow comb.
51
??????? ???? ? ??????? ?????
  • ????? ??????? ?????????????? ??????? ?????????
    ??? ???????? ??????????????, ????? ??????????
    ????????? ???????????? ?????????????? ???????????
    ? ????????? ? ????????????? ?????????.
  • ?????? ??????? ????
  • ???????? ??????? ?????????
  • SPLIT WORD ORDER
  • ??????? ???????? ?????????
  • ?????????? ??????????? ?????????.
  • ??????????? ??????? ???????????? ???????? ??
    ????? ?? 2?? ??????????? ?? ?? ??? ??
    ??????????????.

52
??????? ???????????
  • ??????????
  • 24 ???????? ??????? ?????
  • ???????
  • ?????????? ? ????????? ?????????? ?? ???????????
    ???????? ?? ?????
  • ??????
  • ?????????? ???????? ? ????????

53
?????????? ????????
1-???????? 2-???????? ???????????
????????? ????????????? ???? ????????????? ????
54
??????
1-???????? 2-????????
???????? ??????? ???????? ????????? ? ??????? 4.
?????? ??????? ???????? ????????? ? ???????
4. ???????
55
??????????? ??????????????
??????????????? ????????? ? ?????? ???????
??????????? ??????????????, ????????? ??? ???
???????? ????? ? ???????? ????.
???????
?????????
??????
56
???? ??????? ????????
  • ?????????? ?????? ??????? ??????? ??????????
    ???????? ? ...
  • ?????????? ????????? ? 1 ??????????, ??? ? 2
    ???????????
  • ??????? ?????? ???????? ?? ?????????????? ??????
    ??????? ???? ??????.

57
????????? ? ??????
?????????? ?????????? ?? ?????. ???????
???????? ????????? ? ??????? 4. ?????? ????????
??????? ??????? ? ??????? 3. 3 ???? ???
??????? ???????? ????
????????. ?????? ?????????. ???????
???????? ?????????
58
???????? ???? ???????? - ??????
2-????????, ??? ???? ????????
1 2
1 2
????? ????? ????????????????
???????? ?????????????? ? ?????????
??????? ???????? ?????????
59
???????? ???? ???????? - ??????
1-????????, ??? ???? ????????
1 2
1 2
???????????? ????????? ?????????????? ?
????????? ? ??????. 2
??????? ???????? ?????????
60
1-????????, ?????? ????????
1 2
1 2
???????????? ?????????
??????? ???????? ?????????
61
1-????????, ??????? ????????
1 2
1 2
???????????? ????????? ???
??????? ???????? ?????????
62
Discussion
How do pragmatic and prosodic constraints
interact in resolving referential ambiguity
during on-line processing of contrastive
constituents in RUSSIAN? Both pragmatic
properties of the visual context and prosodic
characteristics of spoken instructions rapidly
affect referential ambiguity resolution.
63
Contrastive Prosody
  • ENGLISH vs. RUSSIAN
  • The effect of contrastive prosody is not
    consistent in English it was found in some
    studies but not others.
  • Our Russian experiment demonstrated a strong
    effect of contrastive prosody that emerged much
    earlier than in those English studies that did
    find contrastive color effects (Sedivy, 2003).
  • In English, identification of the target referent
    was shown to happen at 300 ms AFTER the onset of
    the NOUN.
  • In Russian, the target could be identified 500 ms
    BEFORE the NOUN.

64
The Power of Russian
Why did some of English experiments fail to find
the effect of contrastive prosody in referential
ambiguity resolution compared to the Russian
experiment? The critical difference must lie in
linguistic instantiation of contrastiveness
between the two languages Contrast can be marked
grammatically in Russian, adding to effects of
context and prosody.
65
Contrastiveness in English and Russian
CONTRASTIVENESS was instantiated by the following
means
ENGLISH
RUSSIAN
  • Pragmatics Visual context
  • Prosody Contrastive stress
  • Pragmatics Visual context
  • Prosody Contrastive stress
  • Grammar Split word order construction

66
Referential Functions of Structure
IMPORTANT POINT Our rapid effects of reference
and interpretation occur in a non-canonical
structure Split Word Order A complex structure
is much easier to process when the context
supports its referential function. Similar
conclusions were drawn regarding non-canonical
structures in Finnish, where word-order conveys
informational status (Kaiser Trueswell, in
press) SO Non-canonical word orders serve
specific pragmatic and referential functions that
can be deployed in real-time.
67
???????????????? ???? (1)
  1. ?????? ??????????? ? ???????? ?????????
    ????????????? ?????????? ??????
  2. ????????? ? ????????????? ?????????????? ?
    ???????????
  3. ???????? ? ???????? (?????)
  4. ????????????? ????? ? ?????? ????
  5. ?????????? ? ????????? ??????????? ????
  6. ????????? ? ?????????? ????????

68
???????????????? ???? (2)
  • ??????????? ?????? ??????????
  • ???? (The kindergarten-path effect Studying
    on-line sentence processing in young
    children. Trueswell, J. C. Sekerina, I. ?.
    Hill, N. M. Cognition, 73(2), 1999. pp. 89-134.)
  • ??????? (Visual fixation patterns during viewing
    of naturalistic social situations as predictors
    of social competence in individuals with autism.
    Klin, A., Jones, W., Schultz, R., Volkmar, F.,
    Cohen, D. Archives of General Psychiatry, 59,
    2002. pp. 809-816.)
  • ?????????? ???????? ? ????????, ???????????
    ?????? ????.

69
  • ??????? ?? ????????!
  • ?????????? ??????????? ?????
  • sekerina_at_mail.csi.cuny.edu
Write a Comment
User Comments (0)
About PowerShow.com