Critique and Utilization of Research

1
Critique and Utilization of Research

• Presentation and Discussion of Study Findings

2

• Findings
• Discussion of findings
• Conclusions
• Implications
• Recommendations

3
Findings

• Facts or empirical data objectively reported
  (results of the data analysis)
• No opinions or reactions
• Descriptive statistics
• Inferential statistics for hypothesis testing

4
Presentation of findings

• Narrative and in tables
• Tables should be explained in text (not in great
  detail or table)
• Equal attention to findings which do not support
  hypothesis
• test used
• degrees of freedom
• probability value

5
Discussion of findings

• More subjective
• Researcher gives her interpretation
• Interpretation must be within context of ROL (no
  new literature presented here)
• Discuss findings which agree and which do not
  agree with Hypothesis and previous findings
• limitations and problems discussed

6
Statistical vs. Clinical Significance

• Statistical significance means that the Null
  Hypothesis is rejected
• Clinical Significance means the findings may be
  useful with patients
• Remember with larger samples a smaller difference
  between groups may be statistically significant
  but not clinically significant

7
Conclusions

• The researchers attempt to show what knowledge
  has been gained by the study and its
  generalizability
• conservatism is the best approach
• somewhat abstract and more general (go beyond the
  findings)

8
Implications

• This is the creative section of the research
  report
• Based on the conclusions of the study, what
  changes could be suggested
• Contains the shoulds of the study
• Suggestions for further research
• logical extensions of the study
• replication

9
Explanation of Research Findings to clients

• Beer Therapy
• Newspaper report of JAMA study concluded that
• Drinking three beers a day is about as good as
  jogging when it comes to producing an effect that
  may decrease the risk of coronary heart disease
  The researchers found that joggers registered the
  same HDL levels as did sedentary men who drank 3
  beers/day for three weeks. Moderate drinking
  causes the liver to produce the same enzymes as
  exercise.
• Explain this to your patient who asks you if he
  can now substitute three beers a day for the
  walking that he had been encouraged to do.

10
Critique of published research

• What is a critique?
• A critical estimate of a piece of research which
  has been carefully and systematically studied by
  a reader who has used specific criteria to
  appraise the general features of a research
  report.
• Constructive Criticism

11
A critique

• Provides a descriptive report of the study
• judges scientific merit
• judges ultimate worth and applicability
• always precedes utilization

12
Purposes of critique

• Helps researcher refine, and improve the research
• Helps future researchers on the topic
• Helps consumers use findings while understanding
  limitations and constraints

13
Features of a good critique

• Objective
• Comprehensive
• Correct
• Respectful
• Humane
• Constructive

14
Dos for sensitive critiques

• Try to convey a sincere interest and
  understanding of the article
• Be sure to emphasize the points of excellence
• Choose clear concise statements to communicate
  your observations (avoid ambiguity)
• When pointing out a studys weaknesses include
  explanations that justify your comments
• Be aware of your own negative attitudes toward
  the subject matter or the task
• Include practical suggestions for improvement of
  the next study on the same topic

15
Donts for a good critique

• Avoid excessive nitpicking and faultfinding on
  trivial details
• Never ridicule or demean the project or
  researcher
• Dont use flattery merely to boost researchers
  self esteem
• Dont base your summary and recommendations about
  the study on some loose and biased attitude
  toward science, the discipline or the topic
• Dont use patronizing or condemning language
• Dont forget your purpose in critiquing

16
Criteria for Good Research

• Clarity and relevance of the problem
• Researchability of the problem
• Adequacy and relevance of the literature review
• Match between the purpose, design and method
• Suitability of the sampling procedure and the
  sample
• Correctness of the Analytical procedures
• Clarity of the findings

17
Errors to look for in research reports

• Problem too large or complex
• Author not qualified
• Scholarly format not used, too discursive
• Objectives/purpose not clearly identified
• Adjusting the purpose to meet the results
• Different terms to define the same variable
• Too much pathophysiology in review of literature
• Too many quotations in review of literature
• Paraphrasing author after author without
  synthesis
• Tables which have no explanation in the text
• No tables, charts or graphs
• Incomplete description of methodology
• No discussion of informed consent
• Sample too small or inappropriate for study
• Instruments not described
• Overgeneralization

18
Clarity and Relevance of Studys Purpose

• Will the study solve a problem relevant to
  nursing?
• Will the facts collected be useful to nursing?
• Will the study contribute to nursing knowledge?

19
Researchability of Problem

• Can the research question be answered through
  measuring empirical evidence or data?
• Is the problem stated as a relationship between
  at least two variables?

20
Researchability of the problem

• Is the problem presented early in report?
• Is the problem presented in context of ROL?
• Are the hypotheses explicitly stated?
• Are the concepts operationally defined?
• Are the limitations and assumptions stated?
• Are they justifiable?
• Do the problem statement and title match?
• Are the hypotheses testable and consistent with
  existing knowledge?

21
Adequacy and relevance of ROL

• Are references logical to subject and method?
• Synthesized?
• Organized?
• Classics included?
• Non-supportive work included?
• Justifies operational definitions?
• Supports choice of data collection tools?

22
Agreement of Purpose, Design and Method

• Study design named and described?
• Design answers questions and maximizes control?
• Evidence from literature that design is
  appropriate?
• Data gathering instrument included?
• Validity and reliability reported?
• Checks against data collection errors?
• Consistency of research conditions for all
  subjects?
• Blind or double blind possible?, desirable?

23
Suitability of sampling and sample

• Probability or non-probability? Why?
• Biased sample avoided?
• Representative?
• Large enough for test? To reduce error?
• Too large?
• Demographics of sample reported? Match target
  pop?
• Sampling criteria stated and appropriate?
• Informed consent and rights of subjects?
• Attrition? Why?

24
Correctness of Analysis

• Statistical tests named, p level?
• Explanation and analysis of qual. Data?
• Tests appropriate to level of measurement?
• Distinction between clinical and statistical
  significance?
• Right statistical tests?

25
Clarity of findings

• Interpretations based on data?
• Reasons for ways data presented?
• Error in computations?
• Discrepancies between tables and text?
• Tables and graphs titled?
• Actual findings and interpretations distinguished
  from each other?
• Interpretations and implications justified?(N?)
• Secondary findings overemphasized?
• Clearly and logically organized?
• Impartial and unbiased?
• Generalizations appropriate?
• Negative outcomes and limitations?