Title: A Seminar On Qualitative Research:
1A Seminar On Qualitative Research
- Barbara J. Risman
- Professor and Head
- Dept. of Sociology, University of Illinois at
Chicago - President of the Board of Directors, Council on
Contemporary Families - Vice-President Elect, American Sociological
Association - President-Elect, Southern Sociological Society
- Co-Editor Gender Lens Series, Rowman
Littlefied - Past Editor, Contemporary Sociology
- Nov 2014
- University of Trento
2Outline for the Workshop
- Data Collection
- Monday
- Tuesday
- Data Analysis
- Wednesday
- Thursday
- Writing
- Friday
3Day One Data Collection
- Introductions
- Defining Method
- Versus Design, Epistemology, Methodology
- Types of Qualitative Research
- Constructing Interview Schedules
- Interview Techniques
- Theory
- Practice Exercise
4Introductions
- Something about me
- Something about you
- Why do you want to do research?
- Your current Project
5Defining our Terms
- Epistemology
- Theory of Knowledge
- Method
- Data Collection
- Methodology
- Application of Epistemology to Method
- Research Design requires
- Theory/Question
- Sampling Strategy
- Method
- Methodology
- Epistemology
6This Seminar
- Methodology
- Data Collection
- Data Management
- Data Analysis
- Writing Results
- Beyond our Scope
- Epistemology
- Research Design
- Theory/Question
- Sampling
7Qualitative Data collection
Techniques
- Interviews
- Open ended
- Structured
- Ethnography
- Participant Observation
- Observation
- Archival Research- another course!
- Historical documents
- Literary Documents
- Websites
- Others?
8Qualitative Interviews
- Constructing an Interview Guide
- Two hours maximum
- Topical lt----------------gt Structured
- From General to Specific/difficult/personal
- Pilot Interviews- 4 or 5
- Questions make sense
- Interesting data?
- Key Point Not a Survey
- Interview guide is a GUIDE
- Focus on Respondents Story
- Let it wander if necessary
- Team Projects Vs. Individual Research
9Interview Process Issues
- Establish good partnership
- Record
- Verbatim vivid speech
- Nuances and complexities of speech
- Relax and focus on interviewee
- Drawbacks transcription time
- Pay Attention to body cues
- Withhold judgment
- Avoid Leading Questions
- Probe, Probe, Probe, Probe Details, concrete
- Fieldnotes necessary TOO
10Interview Data Management
- Transcriptions
- Verbatim or Selective
- Interviewer or Paid Help
- Fieldnotes
- Body language notes inserted into text
- Reflexivity statement for each interview intervie
w emotions and thoughts -
11(No Transcript)
12Interview Technique Practice
- Role Playing Volunteers
- Interviewer/Interviewee
- Dyadic Practice
- Role Playing Volunteers
13Life History Narrative Interview Schedule
- Tell me a little bit about your family how many
family members you have, and their relationship
to you. You may include anyone whom you consider
to be a family member, whether related by blood
or marriage or not related. - Did your family change over time, that is, who
you lived with? If so, how? - Where were your parents born? What country or
countries are they citizens of? - Were you raised in a religion? If so, what one?
- (If self and/or parents born outside the US) When
did you/your parents move to the United States?
What were the circumstances that brought you
here? - (Ask for each parent/guardian) What is the
highest level of education your (mom/dad/other)
completed? - Is your (mom/dad/other) working now? (If so) What
does s/he do? - What other jobs have they had in the past?
14Personal Consultations
15 See you Tomorrow
16Outline for the Workshop
- Data Collection
- Monday
- Tuesday
- Data Analysis
- Wednesday
- Thursday
- Writing
- Friday
17Day Two Data Collection (cont.)
- Ethics of Research
-
- Fieldnotes
- How and Why
- Practice Exercise
18Ethics of Research
- Covert/Overt Status
- When to disclose project?
- Is deception ever ethical?
- Considerations
- Likelihood of Harm
- Prospect of Benefit
- Theoretical Important
- Legal Requirements
- Confidentiality
- Guarantee anonymity
- Confidentiality unnecessary when public behavior
19 Fieldnotes From Theory to Action
- Ethnography
- Insider vs. outsider
- Are researchers ever really insiders?
- Immersion
- Participant Observation
- Grasp what others experience as meaningful
- Key informants and/or participants
- Time in field over when saturation occurs
- Adopt a Learner Role- help me understand
- Analysis goes beyond beliefs of participants
- Go beyond giving voice
20Writing Fieldnotes
- Use body as video-recorder
- Perception and Interpretation Involved
- Transform events into words
- Involves choosing what to write about
- How to frame
- Inseparability of Methods and Findings
- What ethnographer finds inherently connected with
how - Jot notes to help memory (if unobtrusive)
- Record as close to occurrence as possible
21Writing fieldnotes Cont.
- Jotting notes
- Pro Can prod memory
- Con Can distract from staying in the moment
- Notes must document own activities
- Record as close to Occurrence as possible
- Memories fade fast
- To produce vivid fieldnotes
- Avoid generalizations- give details
- Jot down sensory details
- Maintain detached observational attitude
22Time Out for Epistemology Ethnography Versus
Participatory Action Research
- Ethnography
- Withhold judgement
- Stay detached emotionally
- Provide analysis
- Participatory Action Research
- Working with community
- Change-oriented
- Research is secondary
- Interviews/observations targeted
- Fieldnotes have different function activism
- Must Choose Epistemology /Stay the Course
23Fieldnote Experience
- 4 person teams
- Go to sites that I have identified
- Spend 15 minutes observing social world
24Write Those Fieldnotes
25Comparing Notes
26Personal Consultations
27 See you Tomorrow
28Outline for the Workshop
- Data Collection
- Monday
- Tuesday
- Data Analysis
- Wednesday
- Thursday
- Writing
- Friday
29Day 3 Data Analysis-Atlas TI
- Coding Techniques
- Definitions
- Cycles
- Atlas Ti- getting started
- Open it up- Exercises
- Open Coding
30Personal Characteristics necessary in a Coder
- Organization
- Perseverance
- Deal well with ambiguity
- Flexibility
- Creativity
- Rigorously Ethical
- Extensive Vocabulary
- Differences from a Quantitative Research?
31Issues to Consider Coding
- Definition of a code
- Word/short phrase summarizes attribute of data
- Heuristic to discover
- Method matters
- Grounded Theory - Open coding
- Theoretically Driven - Use code sheet
- Cycles of coding
- Iterative from specific to categorical
- Theory to discovery to theory again...
- Individual Versus Collaborative Projects
32Grounded Theory Coding
What do you take into account when choosing a
doctor?
Raw Data
Focused Coding
Theoretical Coding
Someone I really trust
Internal Validation
Pleasant disposition and friendly
Search Process for health care provider involves
internal and external validation. Involves
subjective and objective aspects
Usually I ask my friends if they have anyone
doctor that they like and if they could recommend
External Validation - subjective
The doctor better have a legit degree!
External Validation - objective
Board certification is impt, esp if Im looking
for a specialist
33Theoretical Coding
34Types of Coding
- First Cycle Coding
- Attribute
- Exploratory
- Descriptive
- Second Cycle Coding
- Conceptual focus
- From specific to general categories
- Emotive/Values
- Hypothesis /Theoretical Coding
- Iterative
- and start all over again..
- Theming the Data
35Atlas TI Getting Started
- Download free version www.atlasti.com/download or
open it on your classroom computer. - Hermeneutic Units (HU) Main Atlas work file
acts like a basket - Objects items you put in the basket, such as
- Primary Documents (P-Docs or PDs)
- Text, image, audio, or video
- Quotations
- Codes ( Code Families)
- Memos
36Atlas Ti Bringing the Data IN
- Download the transcript files (exercise 1) to
your desktop. Put them all in one folder. - Creating an HU
- Open Atlas, select Project?New Hermeneutic Unit
- Importing P-Docs
- Many ways, but easiest is Project?Add
Document(s)?Add Documents - Find them on desktop, select all, and hit OPEN
- Will get message files successfully converted
- Hit OK
- Double check by hitting Pdoc manager button
37Atlas ti Data Retrieval Screen Shot
38Atlas TI Managing Coding
- Applying Existing Codes
- Highlight selection in P-Doc
- Select third code button on left toolbar and
choose from existing code list - Managing Codes
- Open Code Manager by double-clicking the word
codes next to drop-down code list - Codes are listed with two numbers - that
represent their groundedness and density - Groundedness How frequently a code occurs in
data - Density How interconnected a code is with other
codes no. of codes a chosen code is linked to
think network - These measures gain importance when revising
codes/doing focused coding
39Atlas ti Starting to Code
- Codes are denoted by yellow diamond symbol
- Creating New Codes
- Your own label
- Highlight selection in P-Doc
- Select the first code button on left toolbar
(looks like yellow diamond in middle of text) - Type in the code label(s) you want to apply to
selection - In Vivo codes (name comes from quote itself)
- Highlight selection in P-Doc
- Select second code button on left toolbar
- Coded selections become quotations
- Codes appear to the immediate right of the
quotation
40Atlas ti Moving Beyond Open Coding
- Writing Memos
- Use memos to jot analytical ideas and/or to
document decision-making process - Select Memos? Create Free Memo from toolbar
atop HU screen - Name the Memo something intuitive and include the
date somewhere - Generating Output
- Output documents can organize quotes in readable
and intuitive format for use in revising or
writing-up - We will explain this more as we go along
41Atlas Ti EXERCISE 1
- Download the 5 transcript files (exercise 1) to
your desktop. Put them all in one folder. - Creating an HU
- Open Atlas, select Project?New Hermeneutic Unit
- Importing P-Docs
- Many ways, but easiest is Project?Add
Document(s)?Add Documents - Left hand column, hit desktop, select exercise 1
folder, select all, and hit OPEN - Will get message files successfully converted
- Hit OK
- Double check by hitting Pdoc manager button
42Atlas ti Exercise 1
- Looking at the Cindy Lauper transcript, use the
Edit?Search function to search for the word
gender (line 348) - Highlight this paragraph, then use the create a
new code icon to apply the following codes
gender, friendship, school - Be sure to hit add another code so they stay
distinct codes - Then click ok
43Atlas ti Exercise 1
- Use the P-Doc drop-down menu to select the Eugene
Martin transcript - Repeat the Edit?search for the word gender
- Find the THIRD occurrence, then highlight the
paragraph and code it as gender, patriarchy,
religion (HINT You will have to add the new
codes with one icon but use the apply existing
codes icon for gender)
44Atlas ti Exercise 1
- Use the P-Doc drop-down menu to select the Ramona
Connell transcript - Repeat the Edit?search for the word gender
- Find the first occurrence, then highlight the
paragraph and code it as gender, career,
kids (HINT You will have to add the new codes
with one icon but use the apply existing codes
icon for gender)
45Atlas ti Exercise 1
- Open the Codes on the top tool bar, then open
code manager window - You should see that the code gender has the
values 3-0 beside it, meaning it has a
frequency of 3 and therefore the highest
groundedness of our codes so far - Highlight the gender code and select
Output?Quotations for Selected Code(s) from
the toolbar above click Okay - Reviewing the quotes associated with gender, we
see that we might be conflating different aspects
of gender. Lets recode those items to be more
specific you may close the code manager
46Atlas ti Exercise 1
- First, lets note our thoughts in a memo. Select
Memos?Create Free Memo from the toolbar at
the top of the HU interface. - Name the Memo Gender Coding (date) with todays
date. We may use it later. - In the memo editor, type after reviewing the
gender quotes, I have decided to recode these to
reflect more specific operations close memo
manager window
47Atlas ti Exercise 1
- Go to code manager again (codes -gt code manager).
In the code manager, double click on the gender
code. A small window should pop up with the
applicable quotations. - Click on the first quote. The P-Doc viewer should
now show the quote in context (should be from the
Cindy Lauper doc). - In code manager, click the create new item icon
in the upper left of toolbar (looks like card
with spark behind it) and name a new code Gender
vs. Sex - Click on the Gender vs. Sex code in the code
list and drag it to where the gender code
appears to the right of the quote in the P-Doc
viewer. The new code should have replaced the old
one.
48Atlas ti Exercise 1
- Create 2 more new codes the same way
- Gender Ideology Gender Identities
- Find the next quote already associated with
gender (from Eugene Martin) and drag and drop
the Gender Ideology code to replace gender - Find the final quote associated with gender (by
double clicking on the gender code) and drag
and drop the Gender Identities code to replace
Gender - We have now recoded the gender quotes to be more
specific, and weve retained the gender code in
case new gender-related quotations arise - WELL DONE!
49(No Transcript)
50Exercise 2 Emergent Coding
- Open the file for Salem Bee
- Read the transcript and create codes that
emerge from the data
51Emergent Coding Schemes
52See You tomorrow!
53Outline for the Workshop
- Data Collection
- Monday
- Tuesday
- Data Analysis
- Wednesday
- Thursday
- Writing
- Friday
54Day 4 Data Analysis-Atlas TI
- Review of Data Collection
- Theoretically Driven Coding
- From Coding to Analysis
- Analytic memos
55Hands on Experience
- Theoretical Coding
- Attribute Coding
- Sex
- Race
- Immigrant Status
- Creating Families
- Intersectionality (if time permits)
56Hands on exercise 3
- Download all 10 transcripts under exercise 3
onto desktop. Keep them in 1 folder - Repeat the same steps in exercise 1
- Creating an HU
- Open Atlas, select Project?New Hermeneutic Unit
- Importing P-Docs
- Project?Add Document(s)?Add Documents
- Find them on desktop, select all, and hit OPEN
- Will get message files successfully converted
- Hit OK
- Double check by hitting Pdoc manager button
57Theoretical CodING
- Structured Coding Exercise
- Gendered Beliefs
- liberal
- Conservative
- Unclear/Neutral
- Code all 10 interviews
- Create these 3 new codes
- Use them over and over again
58Family Coding with attributes
- These are the attributes for demographic data on
the sample you have downloaded - You will use these attributes to create
Families for Analysis
Respondent Names Race Sex Immigrant Status
Benny Goodman asian man 2nd gen
Jonathan Poem asian man 2nd gen
Bill Cornell asian man 2nd gen
Nancy Anderson asian woman 1st gen
Amy Lahey asian woman 2nd gen
Mark Rose white man Native-born
Peter Steele white man Native-born
Martha Brodowski white woman 1st gen
Brook Mullen white woman Native-born
Ramona Connell white woman 2nd gen
59Creating Families
- Family Codes
- Think of it as grouping your p-docs into
meaningful categories - Just follow me here
- Click p-docs button
- Go to Documents
- Go to Families
- Click Open Families
- Manager
60Creating families
- Just follow me here
- Click icon (spark card) to create new family
- Name new family women
- In the field primary documents not in family,
choose pdocs that are women and click the left
arrow
61Hands on exercise 4
- Step 1
- Click p-docs button
- Go to Documents
- Go to Families
- Click Open Families
- Manager
62Hands on exercise 4
- Step 2
- Click icon (spark card) to create new family
- Name new family white
- In the field primary documents not in family,
choose pdocs that are white and click the left
arrow
63Hands on exercise 4
- Step 3
- Double check by clicking once on white family
in pdoc manager - The right column will show you all the pdocs
associated with being white
64Hands on exercise 4
- Now you try
- Create an asian family
- Create a male family
- Create a female family
- If you have time, create the families for
immigrant status
65Using output for Analysis
- Now we will use families to help with our
analysis - women vs. men
- Step 1
- On your main HU, click Analysis, followed by
query tools
66Using output for Analysis
67Using output for Analysis
- Step 3
- Under primary doc families, click male
- In candidate quotations in query, you are able
to preview of the quotations and primary
documents and codes - Then ok
68Using output for Analysis
- Step 4
- Choose the codes that you are interested in
- In this example, I choose beliefs_liberal
- Click beliefs_liberal
- Click the printer icon and click full content
- And choose editor and click ok
69Using output for Analysis
- Now you will see an output with all the
quotations by men about their liberal gender
beliefs - Now youll try to generate an output with all the
quotations by women about their liberal gender
beliefs - Discussion compare and contrast how men and
women differ about their liberal gender beliefs
70(No Transcript)
71How to do Intersectional analysis?
- Super Families Code
- E.g. Race Gender
- Think of it as families code that are
intersecting - Are there racial differences between and among
the sexes? - Step 1
- P-Doc Manager
- Click Documents
- Click Families then click
- Open Family Manager
- Click Families then click
- Open Super Family Tool
72Intersectionality
- Step 2
- Choose Asian and Men to create your superfamily
- Double Click on each category and they will
appear in Query Field - Note The manual cautions against using more than
2 families to create super families
73intersectionality
- Step 3
- There are 4 symbols (they are called operators)
on the left (hovering your mouse cursor over them
will reveal what they are) click the 3rd
operator - In your query, you will see that you have you
have asked Atlas Ti to combine both Asian and Men
families - Click Create Super Family and name Asian Men
74Intersectionality
- You will see a new super family called Asian Men
created and it will be in red - In the field below create super family button,
you can double check if there are 3 asian men
pdocs - Close all the windows
- You will use super families as filters next
75Doing Intersectional Analysis
- On your main HU, click Analysis, followed by
query tools
76Doing intersectional analysis
- Click scope on the bottom of the query tool page
77Doing intersectional analysis
- By selecting Asian Men, you are asking Atlas Ti
to limit the subsequent analysis to only this
superfamily - You can even double-check your work here
- Click ok ? brings you back to query tool page
78Doing intersectional analysis
- Now, I want to see all the quotations by Asian
Men about their liberal gender beliefs - Under codes, I clicked beliefs_liberal and then
click the printer icon - Choose full content and select editor
79Intersectional Analysis
- Compare across identity groups
- White men versus asian men
- Black women versus white women
- Or Dutch women versus American women
- Or Indonesian college educated versus Dutch
college educated - Etc...allow complicated intersectional analyses
- On to more discussion of analysis
80Analytic Summary
- Researchers journal entry
- Conversation with yourself (and advisor?)
- Any time idea strikes, write a memo
- From Coding to Analysis
- Document/reflect on codes
- Emergent themes
- Testing or formulating theory
- Reflexivity important
- Draw diagrams if useful
- Reiterative - invent new codes
81Reiterative Process Analysis to Writing and back
again
- Talk shop regularly with other experts
- Join a Writing Group
- As you do the analysis....
82The Analysis Begins
- From concrete to conceptual
- The Touch Test
- Codes to Themes
- Excavate the Top Three Themes
- Excavate top Three (or four) themes
- Write about ONE at a time
- Create an outline of major points/evidence
- If hard to start- begin with the conclusion
- Talk shop regularly - with other experts
- Join a writing group
83Personal Research Consultations
84See You tomorrow!
85Outline for the Workshop
- Data Collection
- Monday
- Tuesday
- Data Analysis
- Wednesday
- Thursday
- Writing
- Friday
86Day Three OutlineAbout WritingDay Three
OutlineAbout WritingDay Three OutlineAbout
WritingDaY five Writing
- Getting Started
- Ritual and Magic
- (What are you afraid of?)
- To Accountability and Routine
- The Spew Draft
- For your eyes only
- From Spew to Manuscript
- Content to Structure
- Infrastructure Plan and Execute
- Writing Matters
87The Process of Writing
- Sharing our Rituals
- Magic or Function?
- Procrastination?
- Fear?
- Satisfaction?
- CREATE ROUTINE
- Accountability
- To Self
- To Others- Writing Groups
88Framing the Paper
- Whats Your Question
- Why Worth Studying
- Major Contribution
- The analysis/findings
- Answer the What and Why questions (write
for 5 min)
89Sharing Our Frames
90Writing Exercise
- Spew Draft
- Ideas for your current research
- (5 min)
91Sharing The Topics you have spewed
92 Break
93The Architecture or Infrastructure
- I. Introduction/Frame
- Roadmap
- II. Signficance
- Literature Review/Theory
- Transition to YOUR work
- III. Methodology/Epistemology
- Standpoint Reflexivity
- Findings- Evidence
- Discussion
- Limitations
- Conclusions
94Develop an Outline
- The architecture of your paper
- The roadmap
95Making the Case for Theoretical Significance
- Literature Review Impose an Organizational
Schema - Intellectual Debate
- Development Over Time
- Inconsistency in Findings
- Include literature from country where journal is
published - International comparative review often useful
- Theoretical/Conceptual Frame of the Article
- Transition Smoothly from Literature Review
- Provide Justification for Analysis to Follow
96Methodology/Epistemology
- Sample/Data
- Measurement and epistemology
- Standpoint Issues
- Analytic Technique
- Reflexivity
- Hypotheses ( unusual for qualitative)
97Your Own Standpoint?
98 Findings Section
- Present Evidence
- Technical Presentation
- Qualitative Data
- show dont tell
- Provide evidence- quotes but also counts
- Dont be afraid to give percentages
- Acknowledge, analyze outliers
- Interpret that Evidence
- What Does it Mean
- Relate Back to Literature Review
- Focus on One Major story line
99Discussion Section
- Key Findings Summary
- Theoretical/Conceptual Contribution
- Admit Weaknesses in your project
- Do not stress them
- Never end with them
100ConcLusionS
- Summary
- Implications
- Why important?
- Policy?
- Future Work Necessary
101 Break
102The Writing PROCESS Time-ordered Levels of
Attention
- Substance
- Know your argument
- Infra-structure
- Roadmap Reader must be able to follow you
- Evidence
- NOW Elegance or WRITING matters...
- Paragraph structure
- Word choice
- Grammar
103 The Paragraph
- WHAT/HOW/WHY PARAGRAPH STRATEGY
- Every sentence has a function
- Whats the Main Point?
- How Do you support it?
- Why is it Important?
104 Writing matters (or revisions to the Paper)
- Be passionate about your topic
- Prefer simple words
- Restrict usage of complicated terminology and
jargon. - Use words to express ideas, not to impress
- Sentences
- Every word should be justifiable
- Avoid long and complicated sentences!
- Always provide concrete examples.
- Abstract concepts difficult to understand
without examples. - Avoid the Passive Voice
- Papers can not do anything. People can.
105Practicing Good Writing
- Active/Passive Voice
- The entrance exam was failed by over one-third of
the applicants - Over one-third of the applicants failed the
entrance exam - OR
- The brakes were slammed on by her as the car sped
downhill. - She slammed on the brakes as the car sped
downhill. - Sexist or Biased Language
- Mankind ? Humanity, people, human beings
- The common man ? Ordinary people
- Recast in the plural
- Use one, your or (sparingly) he or she
- Concise words and phrases to avoid
106Happy Research and Writing!