Inaccessible Terminology A Little Knowledge Can Be Dangerous

1
Inaccessible Terminology?A Little KnowledgeCan
Be Dangerous
6th Annual Career Cluster Institute Atlanta,
GA June 17, 2007 Session F5

• Presenter
• Ms. Brenda Hattaway
• Assistant Executive Director
• VTECS Atlanta, Georgia

2
SESSION FOCUS Critical Components of Career
Cluster Implementation
9 Multi-Measure Assessment 15 Student
Centered Learning
3
Since 1973 . . .
A Consortium for Innovative Career and
Workforce Development Resources
4
VTECS develops resources . . .
. . . for CTE.
Tools
5
Procedures (Steps)
Item Banks
Duty/Task Lists
Academic Skills
Instructional Tools
Objectives
6
(No Transcript)
7
Does the pilot test process we use really tell us
anything about how well our instruction works?
What types of tasks characterize the typical day
of a submarine officer?
Personality inventories indicate that our
programmers tend to have higher extroversion
scores that introversion.
List the steps in the accounting cycle.
8
Test Interpretations
Norm-Referenced defines the performance of a
test-taker in relation to other test-takers.
9
Test Interpretations
Criterion-Referenced defines the performance of
each test-taker without regard to the performance
of others.
10
Test Interpretations
Summative or Formative? Its all about purpose!
11
SUMMATIVE ASSESSMENT Assessment OF Learning
Assessments used to determine how much students
have learned at a particular point in time in
order to report achievement status.
12
FORMATIVE ASSESSMENT Assessment FOR Learning
All activities undertaken by teachers and their
students that provide information to be used as
feedback to . . .

• adjust instruction in support of additional
  learning,
• guide and support student learning,
• support the closing of gaps in learning.

13
NOTE Grading is a summative activity.
14
Types of Test Scores

• Raw Score number of questions answered
  correctly.
• Percent Correct total points earned divided by
  the total possible points.

15
Types of Test Scores

• Percentile percent of students in a norm group
  that score below any particular raw score.
• Stanine divides scores into 9 broad categories
  based on percentiles.

16
Types of Test Scores

• Grade Equivalent compares performance on the
  test to that of various other grade levels.
• Competency Level level of mastery of content.

17
Test Statistics
Reliability consistency of test scores. It is
a property of a set of scores, not of the
assessment that produced the scores.
18
Reliability

• Equivalence reliability consistency of test
  scores between or among forms.
• Test-retest reliability consistency of test
  scores over time.
• Inter-rater reliability measure of consistency
  among judges ratings of a performance.

19
Test Statistics
Validity has to do with whether a test measures
what it is supposed to measure.
An invalid test is not worth anything, to
anybody, at any time, for any purpose!
20
Validity

• Face validity a test appears to test-takers to
  measure what it is supposed to measure.
• Content validity a test is content valid when a
  group of recognized subject matter experts
  verifies that the test measures what it is
  supposed to measure.

21
Validity

• Concurrent validity refers to the ability of a
  test to correctly classify masters and
  nonmasters.
• Predictive validity a test can accurately
  predict future competence.

22
A test cannot be valid if it is not reliable.
23
Secure Test

• Secure Test
• Account for all test materials before testing
• Account for all test materials after testing
• Ensure that test materials are secured

24
ITEM TYPES Written Performance Scenario
25
Multiple Choice
Stem
Which of the following is the inch equivalent of
a 16d nail? a. 1 ¼" b. 2" c. 2 ½" d. 3 ½"
Options
Distractors
Correct Answer
26
Scenarios

• Performance . . .
• . . . with Rubrics
• . . . with Checklists
• Multiple Choice

27

• Standardized
• assessment and scoring procedures are uniform
• results can be compared across test-takers.

28

• Standards-Based
• Questions on the test are selected to match state
  or local content standards
• Student performance is compared to a desired
  level of performance on the content.

29
VTECS WEBSITE
www.vtecs.org
30
Inaccessible Terminology?A Little KnowledgeCan
Be Dangerous
Presenter Brenda Hattaway hattaway_at_vtecs.org