Title: On the Analysis of Crossover Designs
1On the Analysis of Crossover Designs Dallas E.
Johnson Professor Emeritus Kansas State University
2dejohnsn_at_ksu.edu 785-532-0510 (Office) 785-539-013
7 (Home) Dallas E. Johnson 1812 Denholm
Dr. Manhattan, KS 66503-2210
3(No Transcript)
4(No Transcript)
5(No Transcript)
6(No Transcript)
7(No Transcript)
8(No Transcript)
9(No Transcript)
10(No Transcript)
11(No Transcript)
12(No Transcript)
13(No Transcript)
14(No Transcript)
15Note that
and
16(No Transcript)
17(No Transcript)
18To answer these kinds of questions, Shanga
simulated two period/two treatment crossover
experiments satisfying four different
conditions (1) no carryover and equal variances
(C0V0), (2) no carryover and unequal
variances(C0V1), (3) carryover and equal
variances (C1V0), and (4) carryover and unequal
variances (C1V1).
19Each of 1000 sets of data under each of these
conditions was analyzed four different ways
assuming (1) no carryover and equal variances
(C0V0), (2) no carryover and unequal
variances(C0V1), (3) carryover and equal
variances (C1V0), and (4) carryover and unequal
variances (C1V1).
20PROC MIXED TITLE2 'EQUAL VARIANCES' CLASSES
SEQ PERIOD TRT PERSON MODEL PEFSEQ TRT
PERIOD/DDFMSATTERTH REPEATED
TRT/SUBJECTPERSON(SEQ) TYPECS LSMEANS TRT
/PDIFF RUN PROC MIXED TITLE2 'UNEQUAL
VARIANCES' CLASSES SEQ PERIOD TRT PERSON
MODEL PEFSEQ TRT PERIOD/DDFMSATTERTH REPEATED
TRT/SUBJECTPERSON(SEQ) TYPECSH LSMEANS TRT
/PDIFF RUN
21Tests for equal treatment effects.
N 6, ?.5, ?B2 Analysis Assumptions Analysis Assumptions Analysis Assumptions Analysis Assumptions
Simulation C0V0 C0V1 C1V0 C1V1
C0V0 ?.040 ?(1) .87 ?.040 ?(1) .87 ? .050 ?(1) .38 ?.050 ?(1).38
C0V1 ?.045 ?(1) .43 ?.045 ?(1) .43 ? .050 ?(1) .18 ?.046 ?(1).17
C1V0 ?.124 ?(1) .66 ?.124 ?(1) .66 ? .050 ?(1) .38 ?.050 ?(1).38
C1V1 ?.066 ?(1) .26 ?.066 ?(1) .26 ? .050 ?(1) .18 ?.046 ?(1).17
N 12, ?.5, ?B2
C0V0 ?.048 ?(1) 1.0 ?.048 ?(1) 1.0 ? .055 ?(1) .68 ?.055 ?(1).66
C0V1 ?.055 ?(1) .79 ?.055 ?(1) .80 ? .055 ?(1) .32 ?.054 ?(1).31
C1V0 ?.214 ?(1) .95 ?.214 ?(1) .95 ? .055 ?(1) .67 ?.055 ?(1).66
C1V1 ?.102 ?(1) .54 ?.102 ?(1) .54 ? .055 ?(1) .32 ?.054 ?(1).31
22Tests for equal treatment effects.
N 18, ?.5, ?B2 Analysis Assumptions Analysis Assumptions Analysis Assumptions Analysis Assumptions
Simulation C0V0 C0V1 C1V0 C1V1
C0V0 ?.046 ?(1) 1.0 ?.046 ?(1) 1.0 ? .045 ?(1) .83 ?.045 ?(1).83
C0V1 ?.040 ?(1) .92 ?.040 ?(1) .92 ? .034 ?(1) .47 ?.034 ?(1).46
C1V0 ?.297 ?(1) .99 ?.297 ?(1) .99 ? .045 ?(1) .83 ?.045 ?(1).83
C1V1 ?.117 ?(1) .69 ?.117 ?(1) .69 ? .034 ?(1) .47 ?.034 ?(1).46
N 30, ?.5, ?B2
C0V0 ?.051 ?(1) 1.0 ?.051 ?(1) 1.0 ? .061 ?(1) .96 ?.061 ?(1).96
C0V1 ?.055 ?(1) .99 ?.055 ?(1) .99 ? .057 ?(1) .67 ?.055 ?(1).67
C1V0 ?.507 ?(1) 1.0 ?.508 ?(1) 1.0 ? .061 ?(1) .96 ?.061 ?(1).96
C1V1 ?.230 ?(1) .92 ?.230 ?(1) .92 ? .054 ?(1) .67 ?.054 ?(1).67
23NOTE Failing to assume carryover when
carryover exists invalidates the tests for equal
treatment effects and the invalidation
generally gets worse as the
24(No Transcript)
25(No Transcript)
26(No Transcript)
27(No Transcript)
28(No Transcript)
29(No Transcript)
30(No Transcript)
31(No Transcript)
32Goad and Johnson (2000) showed (1) If ?
satisfies the H-F conditions, then the
traditional tests for treatment and period
effects are valid for all crossover experiments
both with and without carryover.
33(2) There are cases where the ANOVA tests are
valid even when ? does not satisfy the H-F
conditions. (a) In the no carryover case,
tests for equal treatment effects are
valid for the six sequence three
period/three treatment crossover design when
there are an equal number of subjects
assigned to each sequence.
(b) In the no carryover case, tests for
equal period effects are valid only when the
H-F conditions be satisfied
34(b) The traditional tests for equal treatment
effects and equal period effects are valid for a
crossover design generated by t-1 mutually
orthogonal t?t Latin squares when there are
equal numbers of subjects assigned to each
sequence. (c) The traditional tests for equal
treatment effects, equal period effects, and
equal carryover effects are likely to be invalid
in the four period/four treatment design
regardless of whether carryover exists or not.
35Cases where the validity of ANOVA tests are still
in doubt. (4) When carryover exists, the tests
for equal carryover effects are not valid
unless ? satisfies the H-F conditions. (5) Wh
en there are unequal numbers of subjects
assigned to each sequence, the ANOVA tests are
unlikely to be valid unless ? satisfies the H-F
conditions.
36 Goad and Johnson (2000) provide some alternative
analyses for crossover experiments.
Consider again, the three period/three treatment
crossover design in six sequences.
37Question Suppose the variance of a response
depends on the treatment, but that the
correlation is the same between all pairs of
sequence cells. That is, for Sequence 1, the
covariance matrix is
38Shanga simulated three period/three treatment
crossover experiments satisfying four different
conditions (1) no carryover and equal variances
(C0V0), (2) no carryover and unequal
variances(C0V1), (3) carryover and equal
variances (C1V0), and (4) carryover and unequal
variances (C1V1).
39Each of 1000 sets of data under each of these
conditions was analyzed four different ways
assuming (1) no carryover and equal variances
(C0V0), (2) no carryover and unequal
variances(C0V1), (3) carryover and equal
variances (C1V0), and (4) carryover and unequal
variances (C1V1).
40TITLE1 'CRSOVR EXAMPLE - A THREE PERIOD/THREE TRT
DESIGN' TITLE2 'ASSUMES CARRYOVER AND UNEQUAL
VARIANCES' PROC MIXED CLASSES SEQ PER TRT
PRIORTRT SUBJ MODEL Y SEQ TRT PER
PRIORTRT/DDFMKR LSMEANS TRT PER
PRIORTRT/PDIFF REPEATED TRT/SUBJECTSUBJ
TYPECSH RUN
41Tests for equal treatment effects.
N 6 ?.5 ?B2 ?C4 Analysis Assumptions Analysis Assumptions Analysis Assumptions Analysis Assumptions
Simulation C0V0 C0V1 C1V0 C1V1
C0V0 ?.053 ?(1) 1.0 ?.057 ?(1) 1.0 ? .057 ?(1) 1.0 ?.051 ?(1)1.0
C0V1 ?.066 ?(1) .50 ?.057 ?(1) .88 ? .049 ?(1) .42 ?.049 ?(1).67
C1V0 ?.138 ?(1) 1.0 ?.149 ?(1) 1.0 ? .057 ?(1) 1.0 ?.051 ?(1)1.0
C1V1 ?.070 ?(1) .32 ?.069 ?(1) .73 ? .049 ?(1) .42 ?.049 ?(1).67
42Tests for equal treatment effects.
N 12 ?.5 ?B2 ?C4 Analysis Assumptions Analysis Assumptions Analysis Assumptions Analysis Assumptions
Simulation C0V0 C0V1 C1V0 C1V1
C0V0 ?.049 ?(1) 1.0 ?.052 ?(1) 1.0 ? .054 ?(1) 1.0 ?.055 ?(1)1.0
C0V1 ?.070 ?(1) .89 ?.053 ?(1) .99 ? .055 ?(1) .77 ?.046 ?(1).94
C1V0 ?.227 ?(1) 1.0 ?.232 ?(1) 1.0 ? .054 ?(1) 1.0 ?.055 ?(1)1.0
C1V1 ?.081 ?(1) .70 ?.100 ?(1) .97 ? .055 ?(1) .77 ?.046 ?(1).94
43Tests for equal treatment effects.
N 18 ?.5 ?B2 ?C4 Analysis Assumptions Analysis Assumptions Analysis Assumptions Analysis Assumptions
Simulation C0V0 C0V1 C1V0 C1V1
C0V0 ?.054 ?(1) 1.0 ?.056 ?(1) 1.0 ? .048 ?(1) 1.0 ?.053 ?(1)1.0
C0V1 ?.071 ?(1) .99 ?.051 ?(1) 1.0 ? .054 ?(1) .91 ?.051 ?(1).99
C1V0 ?.370 ?(1) 1.0 ?.378 ?(1) 1.0 ? .048 ?(1) 1.0 ?.053 ?(1)1.0
C1V1 ?.094 ?(1) .90 ?.125 ?(1) 1.0 ? .054 ?(1) .91 ?.051 ?(1).99
44Tests for Carryover
Simulation C1V0 C1V1
N 6 ?A1 ?B1 ?C1 ? .043 ?(.5) .52 ?(1) .99 ?.040 ?(.5).53 ?(1) .99
N 6 ?A1 ?B.5 ?C.25 ? .054 ?(.5) .86 ?(1) 1.0 ?.044 ?(.5).99 ?(1) 1.0
N 6 ?A1 ?B2 ?C4 ? .048 ?(.5) .10 ?(1) .25 ?.044 ?(.5).13 ?(1) .35
45Tests for Carryover
Simulation C1V0 C1V1
N 12 ?A1 ?B1 ?C1 ? .040 ?(.5) .85 ?(1) 1.0 ?.042 ?(.5).85 ?(1) 1.0
N 12 ?A1 ?B.5 ?C.25 ? .047 ?(.5) 1.0 ?(1) 1.0 ?.046 ?(.5)1.0 ?(1) 1.0
N 12 ?A1 ?B2 ?C4 ? .064 ?(.5) .15 ?(1) .45 ?.056 ?(.5).20 ?(1) .62
46In the three treatment/three period/six sequence
crossover design, Shanga also considered testing
Shanga claimed that his tests were LRTs, but Jung
(2008) has shown that they are not LRTs.
Nevertheless, Shanga's tests had good power for
detecting unequal variances.
47Thats All For Now!