Title: SPATIOTEMPORAL LIMITS OF fMRI
1SPATIOTEMPORAL LIMITS OF fMRI
2fMRI in the Big Picture
3SPATIAL LIMITS OF fMRI
4What Limits Spatial Resolution
- noise
- smaller voxels have lower SNR
- head motion
- the smaller your voxels, the more contamination
head motion induces - temporal resolution
- the smaller your voxels, the longer it takes to
acquire the same volume - 4 mm x 4 mm at 16 slices/sec
- OR 1 mm x 1 mm at 1 slice/sec
- vasculature
- depends on pulse sequences
- e.g., spin echo sequences reduce contributions
from large vessels - some preprocessing techniques may reduce
contribution of large vessels (Menon, 2002, MRM)
5Ocular Dominance Columns
- Columns on the order of 0.5 mm have been
observed with fMRI
6Voxel Size
non-isotropic
non-isotropic
isotropic
3 x 3 x 6 54 mm3 e.g., SNR 100
3 x 3 x 3 27 mm3 e.g., SNR 71
2.1 x 2.1 x 6 27 mm3 e.g., SNR 71
In general, larger voxels buy you more SNR.
7Partial Voluming
Partial volume effects The combination, within a
single voxel, of signal contributions from two or
more distinct tissue types or functional regions
(Huettel, Song McCarthy, 2004)
This voxel contains mostly gray matter
This voxel contains mostly white matter
This voxel contains both gray and white matter.
Even if neurons within the voxel are strongly
activated, the signal may be washed out by the
absence of activation in white matter.
Partial voluming becomes more of a problem with
larger voxel sizes Worst case scenario A 22 cm
x 22 cm x 22 cm voxel would contain the whole
brain
8TEMPORAL LIMITSOF fMRIANDEVENT-RELATED
AVERAGING
9Sampling Rate
10BOLD Time Course
11Evolution of BOLD Response
Hu et al., 1997, MRM
12Event-Related Averaging
In this example an event is the start of a block
13Event-Related Averaging
14Event-Related Averaging
15Event-Related Averaging
Zero average signal intensity in first volume
of all 8 events
16Event-Related Averaging
EPOCH-BASED
Zero starting point of each curve at specified
volume(s) Sometimes useful if well-justified May
look very different than GLM stats
17Event-related Averaging
- File-based
- zero is based on average starting point of all
curves - works best when low frequencies have been
filtered out of your data
- Epoch-based
- each curve starts at zero
- can be risky with noisy data
- only use it if you are fairly certain your
pre-stim baselines are valid (e.g., you have a
long ITI or your trial orders are
counterbalanced)
18Convolution of Single Trials
Neuronal Activity
BOLD Signal
Haemodynamic Function
Time
Time
Slide from Matt Brown
19BOLD Summates
Neuronal Activity
BOLD Signal
Slide from Matt Brown
20BOLD Overlap and Jittering
- Closely-spaced haemodynamic impulses summate.
- Constant ITI causes tetanus.
Burock et al. 1998.
21Design Types
null trial (nothing happens)
trial of one type (e.g., face image)
trial of another type (e.g., place image)
Block Design
Slow ER Design
Rapid Counterbalanced ER Design
Rapid Jittered ER Design
Mixed Design
22 Block Designs
trial of one type (e.g., face image)
trial of another type (e.g., place image)
Block Design
- Early Assumption Because the hemodynamic
response delays and blurs the response to
activation, the temporal resolution of fMRI is
limited.
WRONG!!!!!
23Detection vs. Estimation
- detection determination of whether activity of a
given voxel (or region) changes in response to
the experimental manipulation
1
- estimation measurement of the time course within
an active voxel in response to the experimental
manipulation
Signal Change
0
0
4
8
12
Time (sec)
Definitions modified from Huettel, Song
McCarthy, 2004, Functional Magnetic Resonance
Imaging
24Block Designs Poor Estimation
Huettel, Song McCarthy, 2004, Functional
Magnetic Resonance Imaging
25Pros Cons of Block Designs
- Pros
- high detection power
- has been the most widely used approach for fMRI
studies - accurate estimation of hemodynamic response
function is not as critical as with event-related
designs - Cons
- poor estimation power
- subjects get into a mental set for a block
- very predictable for subject
- cant look at effects of single events (e.g.,
correct vs. incorrect trials, remembered vs.
forgotten items) - becomes unmanagable with too many conditions (4
conditions baseline is about the max I will use
in one run)
26 What are the temporal limits?
What is the briefest stimulus that fMRI can
detect? Blamire et al. (1992) 2 sec Bandettini
(1993) 0.5 sec Savoy et al (1995) 34 msec
2 s stimuli single events
Data Blamire et al., 1992, PNAS Figure Huettel,
Song McCarthy, 2004
Data Robert Savoy Kathy OCraven Figure Rosen
et al., 1998, PNAS
Although the shape of the HRF delayed and
blurred, it is predictable. Event-related
potentials (ERPs) are based on averaging small
responses over many trials. Can we do the same
thing with fMRI?
27Slow Event-Related Designs
Slow ER Design
28Spaced Mixed Trial Constant ITI
Bandettini et al. (2000) What is the optimal
trial spacing (duration intertrial interval,
ITI) for a Spaced Mixed Trial design with
constant stimulus duration?
2 s stim vary ISI
Block
Source Bandettini et al., 2000
29Optimal Constant ITI
Source Bandettini et al., 2000
Brief (lt 2 sec) stimuli optimal trial spacing
12 sec For longer stimuli optimal trial spacing
8 2stimulus duration Effective loss in
power of event related design -35 i.e., for 6
minutes of block design, run 9 min ER design
30Trial to Trial Variability
Huettel, Song McCarthy, 2004, Functional
Magnetic Resonance Imaging
31How Many Trials Do You Need?
Huettel, Song McCarthy, 2004, Functional
Magnetic Resonance Imaging
- standard error of the mean varies with square
root of number of trials - Number of trials needed will vary with effect
size - Function begins to asymptote around 15 trials
32Effect of Adding Trials
Huettel, Song McCarthy, 2004, Functional
Magnetic Resonance Imaging
33Pros Cons of Slow ER Designs
- Pros
- good estimation power
- allows accurate estimate of baseline activation
and deviations from it - useful for studies with delay periods
- very useful for designs with motion artifacts
(grasping, swallowing, speech) because you can
tease out artifacts - analysis is straightforward
- Cons
- poor detection power because you get very few
trials per condition by spending most of your
sampling power on estimating the baseline - subjects can get VERY bored and sleepy with long
inter-trial intervals
34Can we go faster?!
- Yes, but we have to test assumptions regarding
linearity of BOLD signal first
Rapid Counterbalanced ER Design
Rapid Jittered ER Design
Mixed Design
35 Linearity of BOLD response
Linearity Do things add up?
Not quite linear but good enough!
Source Dale Buckner, 1997
36Optimal Rapid ITI
Source Dale Buckner, 1997
Rapid Mixed Trial Designs Short ITIs (2 sec) are
best for detection power Do you know why?
37Design Types
trial of one type (e.g., face image)
trial of another type (e.g., place image)
Rapid Counterbalanced ER Design
38Detection with Rapid ER Designs
Figure Huettel, Song McCarthy, 2004
- To detect activation differences between
conditions in a rapid ER design, you can create
HRF-convolved reference time courses - You can perform contrasts between beta weights as
usual
39Variability of HRF Between Subjects
- Aguirre, Zarahn DEsposito, 1998
- HRF shows considerable variability between
subjects
different subjects
- Within subjects, responses are more consistent,
although there is still some variability between
sessions
same subject, same session
same subject, different session
40Variability of HRF Between Areas
- Possible caveat HRF may also vary between areas,
not just subjects - Buckner et al., 1996
- noted a delay of .5-1 sec between visual and
prefrontal regions - vasculature difference?
- processing latency?
- Bug or feature?
- Menon Kim mental chronometry
Buckner et al., 1996
41Variability Between Subjects/Areas
- greater variability between subjects than between
regions - deviations from canonical HRF cause false
negatives (Type II errors) - Consider including a run to establish
subject-specific HRFs from robust area like M1
Handwerker et al., 2004, Neuroimage
42The Problem of Trial History
Activation
Activation
Time
Time
Event-related average is wonky because trial
types differ in the history of preceding trials
- Estimation does not work well if trial history
differs between trial types - Two options
- Control trial history by making it the same for
all trial types - Model the trial history by deconvolving the
signal (requires jittered timing)
43One Approach to Estimation Counterbalanced Trial
Orders
- Each condition must have the same history for
preceding trials so that trial history subtracts
out in comparisons - For example if you have a sequence of Face, Place
and Object trials (e.g., FPFOPPOF), with 30
trials for each condition, you could make sure
that the breakdown of trials (yellow) with
respect to the preceding trial (blue) was as
follows - Face ? Face x 10
- Place ? Face x 10
- Object ? Face x 10
- Face ? Place x 10
- Place ? Place x 10
- Object ? Place x 10
- Face ? Object x 10
- Place ? Object x 10
- Object ? Object x 10
- Most counterbalancing algorithms do not control
for trial history beyond the preceding one or two
items
44Analysis of Single Trials with Counterbalanced
Orders
- Approach used by Kourtzi Kanwisher (2001,
Science) for pre-defined ROIs - for each trial type, compute averaged time
courses synced to trial onset then subtract
differences
45Pros Cons of Counterbalanced Rapid ER Designs
- Pros
- high detection power with advantages of ER
designs (e.g., can have many trial types in an
unpredictable order) - Cons and Caveats
- reduced detection compared to block designs
- estimation power is better than block designs but
not great - accurate detection requires accurate HRF
modelling - counterbalancing only considers one or two trials
preceding each stimulus have to assume that
higher-order history is random enough not to
matter - what do you do with the trials at the beginning
of the run just throw them out? - you cant exclude error trials and keep
counterbalanced trial history - you cant use this approach when you cant
control trial status (e.g., items that are later
remembered vs. forgotten)
46Design Types
trial of one type (e.g., face image)
trial of another type (e.g., place image)
Rapid Jittered ER Design
47BOLD Overlap With Regular Trial Spacing
Neuronal activity from TWO event types with
constant ITI
Partial tetanus BOLD activity from two event types
Slide from Matt Brown
48BOLD Overlap with Jittering
Neuronal activity from closely-spaced, jittered
events
BOLD activity from closely-spaced, jittered events
Slide from Matt Brown
49Fast fMRI Detection
Slide from Matt Brown
50Post Hoc Trial Sorting Example
Wagner et al., 1998, Science
51Fast fMRI Detection
- Pros
- Incorporates prior knowledge of BOLD signal form
- affords some protection against noise
- Easy to implement
- Can do post hoc sorting of trial type
- Cons
- Vulnerable to inaccurate hemodyamic model
- No time course produced independent of assumed
haemodynamic shape
52Linear Deconvolution
Miezen et al. 2000
- Jittering ITI also preserves linear independence
among the hemodynamic components comprising the
BOLD signal.
53Exponential Distribution of ITIs
Exponential Distribution
Flat Distribution
Frequency
Frequency
2
3
4
5
6
7
2
3
4
5
6
7
Intertrial Interval
Intertrial Interval
- An exponential distribution of ITIs is recommended
54Fast fMRI Estimation
- Pros
- Produces time course
- Does not assume specific shape for hemodynamic
function - Can use narrow jitter window (rec. exponential
distribution) - Can separate correct vs. errors
- Robust against sequencing bias (though not immune
to it) - Compound trial types possible
- Cons
- Complicated
- Unrealistic assumptions about maintenance
activity - BOLD is non-linear with inter-event intervals lt 6
sec. - Nonlinearity becomes severe under 2 sec.
- Seems to be sensitive to noise
55Design Types
trial of one type (e.g., face image)
trial of another type (e.g., place image)
Mixed Design
56Example of Mixed Design
- Otten, Henson, Rugg, 2002, Nature Neuroscience
- used short task blocks in which subjects encoded
words into memory - In some areas, mean level of activity for a block
predicted retrieval success
57Pros and Cons of Mixed Designs
- Pros
- allow researchers to distinguish between
state-related and item-related activation - Cons
- sensitive to errors in HRF modelling
58A Variant of Mixed Designs Semirandom Designs
- a type of event-related design in which the
probability of an event will occur within a given
time interval changes systematically over the
course of an experiment
First period P of event 25
Middle period P of event 75
Last period P of event 25
- probability as a function of time can be
sinusoidal rather than square wave
59Pros and Cons of Semirandom Designs
- Pros
- good tradeoff between detection and estimation
- simulations by Liu et al. (2001) suggest that
semirandom designs have slightly less detection
power than block designs but much better
estimation power - Cons
- relies on assumptions of linearity
- complex analysis
- However, if the process of interest differs
across ISIs, then the basic assumption of the
semirandom design is violated. Known causes of
ISI-related differences include hemodynamic
refractory effects, especially at very short
intervals, and changes in cognitive processes
based on rate of presentation (i.e., a task may
be simpler at slow rates than at fast rates). - -- Huettel, Song McCarthy, 2004