End of Program Skill Testing for Career and Technical Students

1
End of Program Skill Testing for Career and
Technical Students

• David Lapinsky Assistant Director Career
  Technical Programs
• Dean Ritter CEC CCE AAC
• Culinary Arts Instructor

2
Overview of Presentation

• Who are we?
• Pennsylvania Dept. of Ed. (PDE) Requirements
• PA Occupational Competency Assessments
• Test Administration
• Culinary Arts Testing
• Use of Test Results
• Discussion

3
Lehigh Career Technical Institute

• Largest CT school in Pennsylvania
• Near Allentown, PA
• 2300 students
• 10 high schools
• 40 program areas
• Shared time environment
• Alternative Education Program

4
HSTW 2002 Assessment

• Took a performance test containing industry
  standards that had to be met
• High Scoring Sites
• 38 yes
• 62 no
• LCTI Site Score
• 66 yes
• 34 no

5
HSTW Key Practices

• High Expectations
• Students Actively Engaged
• Keeping Score

6
Pennsylvania Department of Education Requirements

• All program completers must be tested
• Senior
• On schedule to graduate
• Complete program requirements
• Adults Secondary students to be tested
• Accountability
• Carl Perkins Grant
• No Child Left Behind
• School Report Card
• PA State Board of Education
• Return on Investment of Public Fun

7
Pennsylvania Department of Education Requirements

• Incentive Awards
• School Performance Funding Initiative
• Achievement Component
• Formula-Driven Financial Award
• Based on Individual School Improvement
• Determined by number of scores at or above
  National norm
• Current year compared to previous years scores

8
Pennsylvania Department of Education Requirements

• PA Skills Certificate
• Awarded to students who score at or above
  National norm for NOCTI tests
• Awarded to students who pass other PDE Approved
  tests
• Recognizes student success in Occupational Field

9
Pennsylvania Skills Certificate
10
Pennsylvania Department of Education Requirements

• Types of Assessments
• Criterion Referenced
• Schools Performance
• Current year vs. Previous year
• Determines School Achievement
• Norm Referenced
• Individual Performance
• Standardized Assessments
• PA Cut Score is NOCTI National norm from previous
  year

11
PA Occupational Competency Assessments

• NOCTI testingNational Occupational Competency
  Testing Institutewww.nocti.org
• ICE testingAir-conditioning Refrigeration
  Institutewww.ari.org
• ACF testingAmerican Culinary Federation
  Testwww.acfchefs.org
• AWSAmerican Welding Societywww.amweld.org

12
PA Occupational Competency Assessments

• NATEFNational Automotive Technicians Education
  Foundationwww.natef.org
• NIMS-Level 1National Institute for Metalworking
  Skillswww.nims-skills.org
• Nurse Aid Training Competency Eval
• PA Cosmetology State Board

13
PA Occupational Competency Assessments

• AHLAAmerican Hotel Lodging Association
  Educational Institutewww.patravel.org
• CEAConsumer Electronics Associationwww.cea.org
• Licensed Practical Nurse
• A Certification (Comp TIA)Computer Technology
  Industry Associationwww.comptia.org
• Workplace Readiness test is given to all
  completers where no test exists

14
PA Occupational Competency Assessments

• Who pays?
• PDE Reimbursement
• All costs of NOCTI tests
• Other PDE-Approved tests - 20.00
• Lehigh Career Technical Institute
• Performance test materials and supplies
• Students responsible for any additional test fees
• Example NIMS Test - 28.00
• PDE 20.00
• Student 8.00

15
Occupational Competency Test Administration

• Site Coordinator Responsibilities
• Test Evaluator
• Written Test Proctor
• Performance Test Evaluator
• Special Population

16
Site Coordinator

• Coordinator is responsible for approving
  performance test sites and labs
• Equipment
• All students must have an equal opportunity to
  demonstrate skills knowledge
• Environment
• Provide the proper test environment
• Security
• Do not jeopardize the integrity of test

17
Preparation for Site Coordinator

• Identification of completers (students to be
  tested)
• Choose dates of the exam
• 2 week window
• Written on Co-op day
• Choose evaluators proctors
• Letter to parents
• Letter to sending schools
• Meeting with the students
• Order the tests

18
Written Test Proctors

• Proctors are used for written test portion
• May be a member of staff but not the teacher. PDE
  recommends outside person.
• IEPs have to be addressed
• All scratch paper must be turned in
• Calculators (non-programmable) are permitted
• Sign in sheets required

19
Performance Test Evaluators

• Evaluators are used for Performance tests
• Cannot be anyone from school
• Must be someone from the industry
• NOCTI recommends a ratio of 1 evaluator per 5
  students
• Teacher is not be in area where testing is
  occurring
• Non-involved students may not observe

20
Performance Test EvaluatorsResponsibilities

• Evaluate and record student performance
• Maintain objectivity during testing
• Refrain from bias
• Enforce safety
• Adhere to test guidelines

21
Training Offered

• Proctors Training Written Test
• Overview of tests
• Review Proctor Evaluator Guide
• Accommodations
• Test Security
• Evaluator Training Performance Test
• 2 events Evening Saturday
• Overview of the test
• Review Proctor Evaluator Guide
• Test Security
• Choice of third party evaluator is critical

22
Evaluators We Rejected
A lady with many talents . . . . . .
but not exactly the ones we were looking
for!!!!
23
Evaluators We Rejected
Even though he has talents . . . . . .
again not exactly the ones we were
looking for!!!!
24
Evaluators We Rejected
Beautiful . . . . . .
but not what we were looking for!!!!
25
Evaluators We Rejected
Entertaining . . . . but not known for his
accuracy!!!
26
Evaluators We Rejected
Mumbles too much!!
27
Evaluators We Rejected
He wouldnt remove the glove . . . . .
28
Evaluators We Rejected
Qualified evaluator, but we felt he was a bit of
a STUFFED shirt!!!!!
29
Evaluators We Rejected
No explanation necessary !!!! Yadda,
Yadda, Yadda
30
Test Administration Special Population

• Students with disabilities are tested
• Individualized Education Plan (IEP)
• Student participates in the PA System of School
  Assessment (PSSA) statewide testing
• Accommodations based on IEP
• Increase test time
• Use enlarged answer sheet
• Read directions to student
• Provide physical assistance

31
What does the teacher do?

• Dean Ritter
• Chef Educator
• Certified Executive Chef
• Culinary Program
• ACF Certified
• 02/03 National Explemplary Program
• SkillsUSA VICA
• FCCLA

32
Culinary Arts Testing

• Retail Commercial Baking
• Food Production, Management, Services
• ACF Culinary Arts

33
Success of NOCTI

• Strong Curriculum structure
• Self paced
• Theory several times a week
• Production schedule
• Curriculum includes skill testing and competition
• Iron chef
• With recipes without recipes
• Regular Competition rotation included in program

34
Career Technical Organizations

• FCCLA
• 10th grade team added
• SkillsUSA VICA
• Local competitions
• Area chefs judge competitions
• Advisory members
• Past graduates
• 50 of students participate

35
Motivation of students

• Certifications received
• ACCESS certification
• Pennsylvania Skill Certificate
• NOCTI Participation Certificate
• Review sessions are held
• Follow up of previous year questions
• Seniors share expectations
• SkillsUSA VICA Professional Development Program
• Resumes

36
Motivation of the students

• Serve Safe Certification
• Dual enrollment with Community College
• Part of NOCTI contains these components

37
Production Lab

• Restaurant
• Production self-evaluation
• Cafeteria
• Production self-evaluation

38
Room set up

• Portable burners to provide separate workstations
• Pantry for testing purposes only
• Refrigeration for testing ingredients only
• Individual equipment for each student
• Shared area for pots pans

39
Evaluators

• Occupational Advisory Council members
• Local Chefs Association
• Past students
• Successful in own business or trade
• Evaluators write remarks for feedback

40
After the testing?
41
Test security

• All tests must be returned--100,000 fine
• No photocopying of test
• Teachers cannot see test prior to testing
• Tests cannot leave the school

42
Site Coordinator Work

• Inventory the returned booklets
• Pack up books
• Ship to NOCTI
• NOCTI promises a 2-week turn-a-round

43
What to do with results

• Share with administrators
• Share with teachers
• Analyze the data
• of classroom instructional time on content
  skills
• of Laboratory time spent
• Currency quality of instruction, curriculum,
  instructional resources, assessments
• Determine strategies for change
• Share with Advisory councils

44
Lehigh Career Technical Institute
School Performance Incentive Report
End of Program Test Results
1999 2000 119/347
34.3 2000 2001 109/313
34.82 2001 2002
201/403 49.9
15.4 Increase (Need 5 increase to qualify)
Award Formula 45.50 x 1990 students
90,545.00
45
NOCTI Certificate
46
NOCTI Website

• www.nocti.org
• Catalog of Assessments
• List of Materials, Supplies Equipment needed
  for each test
• Guidelines for testing
• Sample written questions
• Critical competencies that will be covered

47
NOCTI Testing Photos
48
NOCTI Testing Photos
49
NOCTI Testing Photos
50
NOCTI Testing Photos
51
NOCTI Testing Photos
52
NOCTI Testing Photos
53
NOCTI Testing Photos
54
Questions?
55
High Schools That WorkNOCTI Presentation