Georgia

1
Metro RESA Metro Area Instructional Leaders
Job Alike September 13, 2006
2

• Georgias AYP Determination Steps
• Participation at 95 in reading/English language
  arts and math based on students continuously
  enrolled during state testing window
• Academic performance in reading/English language
  arts and math based on Full Academic Year (FAY)
  students
• Annual Measurable Objectives (AMO) Absolute Bar
• Confidence Interval
• Multi-year Average
• Safe Harbor
• Federal Flexibility for schools and districts not
  making AYP based solely on SWD group scores
  (approved for 2006 AYP)
• Second Indicator
• Menu of Indicators for Elementary Middle
  Schools
• Graduation Rate for High Schools

3
2005-2006 Amendment Approved Hurricane Subgroup

• For the 2005-2006 school year, each school and
  school district has been using a series of 900
  codes to identify students displaced by
  Hurricanes Katrina and Rita.
• Data from these displaced students will be
  included in a newly created displaced Hurricane
  subgroup. Only this subgroups Test Participation
  Rate will be included in the school, system, and
  state AYP determinations.
• Georgias minimum subgroup size of 40 for
  participation rate calculations also applies to
  Hurricane subgroups.
• Georgia will report achievement for the displaced
  students subgroup at the state and system levels
  just like other subgroups on its 2006 State
  Report Card.

4

• 2005-2006 Amendment Approved
• Federal Flexibility for SWD Group
• A mathematical adjustment to the Students with
  Disabilities (SWD) proficiency/advanced rates
  applied only for schools and LEAs that did not
  make AYP based solely on the SWD group scores.
• (See the next slide for the federal formula used
  to calculate the mathematical adjustment or proxy
  percent.)

5

• Federal Calculation Steps for Determining the SWD
  Proxy Percent
• Determine the percent of SWD assessed within the
  State.
  (138,954 SWD
  divided by 1,106,615 12.5)
• Divide 2 by the percentage of SWD assessed.
• (2 divided by 12.5 15.9 rounded to 16)
• Add the proxy percent (16) to the original
  percent proficient/advanced for SWD for any
  subject reading/English language arts and/or math
  that falls below the state AMO.
• Determine if the proxy percent is equal to or
  greater than the State AMO.
• http//www.ed.gov/news/pressreleases/2005/04/04072
  005.html

6
QCC-based Assessments to GPS-based Assessments

• In order for Georgia to preserve continuity by
  keeping the same methodology for computing AYP
  that has been used for each of the past three
  years, US ED required GA to equate the QCC-based
  assessments to the GPS based assessments.

7
Equipercentile Amendment

• Equipercentile is a statistical application
  Georgia is using to compare QCC based assessment
  data to GPS based assessment data for use in the
  calculation of multi-year averaging, safe harbor,
  and progress on the second indicator for AYP
  purposes.
• Without the equipercentile, Georgia would not be
  able to use assessment data from previous years
  needed for determining if a school or system made
  AYP based on multi-year averaging, safe harbor,
  and/or progress on a second indicator.

8

• Minimum Number Amendment Began with 2004-2005
  AYP Determinations
• On June 14, 2005, US ED approved Georgias
  request to adjust the minimum group size. The
  minimum number adjustment allows AYP groups to be
  more proportional to the overall student
  population in AYP grades.
• Group N size 40 or 10 of students enrolled in
  AYP grades, whichever is greater (with a 75
  student cap) for AMO and Second Indicator
  calculations only.
• Note The minimum number for Participation Rate
  remains at 40 or more students.

9
Graduation Rate Amendment

• Beginning last school year (2004-2005) Schools
  and systems included summer graduates after 12th
  grade.
• Beginning 2005-2006 school year Schools and
  systems can, on a case by case basis (with
  documentation), count LEP/ELL students in their
  high school graduation rate if these students
  graduate with a regular diploma within 5 years
  and a summer.

10
(No Transcript)
11
(No Transcript)
12
(No Transcript)
13
Enhanced GHSGT Performance Levels for AYP
Purposes

• Mathematics
• Basic Scale scores 400 to 515
• Proficient Scale scores 516 to 524
• Advanced Scale scores 525 to 600
• Language Arts
• Basic Scale scores 400 to 510
• Proficient Scale scores 511 to 537
• Advanced Scale scores 538 to 600

14
(No Transcript)
15
(No Transcript)
16

• Menu of Second Indicators for Elementary/Middle
  Schools
• Meet or exceed standard or show progress from the
  preceding year
• Selection in effect for 2004-2005, 2005-2006, and
  2006-2007
• Attendance
• 15 or less of students absent more than 15 days
  or show progress
• Percent Meeting/Exceeding
• CRCT Science 80 or show progress
• CRCT Social Studies 80 or show progress
• Percent Exceeding
• CRCT Reading 35 or show progress
• CRCT English Language Arts 15 or show progress
  
• CRCT Mathematics 15 or show progress
• CRCT Science 15 or show progress
• CRCT Social Studies 15 or show progress
• (Standards subject to revision as a result of
  data analysis from assessments aligned with GPS.)

17
For Elementary and Middle Schools Selecting
Attendance as a Second Indicator

• Attendance Rate Criteria
• Schools or systems with 15 or less of students
  absent more than 15 days or show progress over
  the previous year will meet the Second Indicator.
  To show progress for attendance a school or LEA
  must reduce the percentage of students absent
  more than 15 days from the previous year.
• Attendance Rate Explanation
• Students in AYP grade levels who miss more than
  15 days while enrolled
• at any time in school A will be included in
  school A's Attendance Rate formula.
• The days a student misses in another school is
  not added to school As rate.
• Attendance Rate Calculation
• Attendance rate is calculated by dividing the
  number of students in AYP grade levels who were
  absent more than 15 days by the total number of
  students in AYP grade levels.

18
Georgias Graduation Rate

• Georgias Graduation Rate Standard Schools and
  districts must be at or above a
• 60 Graduation Rate or show progress from the
  preceding year.
• Current Graduation Rate Calculation (worksheet
  available on www.gaosa.org)
• Numerator of students who graduate with
  regular diplomas
• Denominator of dropouts in 9th, 10th, 11th,
  12th from appropriate years graduates
  other completers
• Georgias Graduation Rate 2002 61.8
  2005 69.4
• 2003 63.3 2006 69.5 (as of 7/14)
• 2004 65.4

19
Fast Facts

• Students with Disabilities (SWD) SWD who receive
  Special Education Services at any time during the
  school year are included in the SWD group for AYP
  purposes.
• Science and AYP NCLB requires that states
  develop academic content standards in science by
  2005-06 and aligned assessments based on those
  standards by 2007-08. The science assessments
  must be administered at least once in each of
  three grade spans 3-5, 6-9, and 10-12. We are
  required to have Science assessments for the
  07-08 school year but it is unclear whether they
  will become part of AYP or not.
• (NCLB Act section 1111 (K)

20
Fast Facts

• Confidence Interval A statistical calculation
  used to provide more confidence in the data. (The
  critical z is 1.645 for a population proportion,
  which means the programs are running a one-tail
  test at the 95 level of significance.)
• This application allows one to establish a
  measure of certainty regarding whether a
  calculation/percentage is characteristic of a
  school/system. A table is created to indicate an
  adjusted Annual Measurable Objective (AMO) based
  on group size. The smaller the group, the larger
  the adjustment. In comparison, if you were
  conducting a survey, the confidence you have in
  the conclusions you might draw from the results
  depends on the number of participants in the
  survey.
• The following is a link to the 2006 Confidence
  Interval worksheet http//www.gaosa.org/document
  s/2006ConfidenceIntervalUpdated.xls

21

• Fast Facts
• ACCESS First Year in US ELL students who take
  the ACCESS may receive a deferment from the
  Reading/ELA portions of the state test (CRCT or
  GHSGT). Their participation in ACCESS will serve
  as a proxy participation for those subjects, and
  the score is not used for AMO.
• Regarding math, the students must take that
  portion of the exam and participation is awarded
  accordingly, but because they are First Year in
  US school students, the math score is not used
  for AMO.

22

• School-Level Consequences
• Needs Improvement (NI) status shall be determined
  by AYP.
• Not making AYP for two consecutive years in
  the same subject
• Math 95 Participation or AMO
• Reading/ELA 95 Participation or AMO
• Second Indicator
• A school shall be removed from the list by making
  AYP for two consecutive years.

23
School Needs Improvement (NI) Status School Consequences/Interventions
Did Not Make AYP - Year 1 No Consequences
NI 1 Choice Develop School Improvement Plan
NI 2 School Choice Supplemental Services Implement School Improvement Plan
NI 3 School Choice Supplemental Services Continue School Improvement Plan Develop/Implement School Corrective Action Plan
NI 4 School Choice Supplemental Services Implement School Corrective Action Plan Plan for Restructuring
NI 5 School Choice Supplemental Services Continue School Corrective Action Plan Implement Restructuring Plan

24
School Needs Improvement (NI) Status School Consequences/Interventions
NI 6 School Choice Supplemental Services Implement Restructuring Plan GDOE School Performance Review Needs Assessment Develop Improvement Contract
NI 7 School Choice Supplemental Services Implement Improvement Contract Contract-Monitored School Year 1
NI 8 School Choice Supplemental Services Contract-Monitored School Year 2 Improvement Contract GDOE System Performance Review Needs Assessment Develop Management Contract
NI 9 School Choice Supplemental Services Implement Management Contract Contract-Managed School Year 1
NI 10 School Choice Supplemental Services Contract-Managed School Year 2 Update Management Contract

25

• School District Consequences
• NI status shall be determined by AYP status.
• Not making AYP for two consecutive years in
  the same subject at both Elem./Middle and High
  School levels
• Math 95 Participation or AMO
• Reading/ELA 95 Participation or AMO
• Second Indicator
• Districts are removed from the list by making AYP
  for two consecutive years.

26
Table of Consequences/Interventions for School
Districts
Needs Improvement (NI) Status District Consequences/Interventions
Did Not Make AYP Year 1 No Consequences
NI 1 Develop District Improvement Plan
NI 2 Implement District Improvement Plan
NI 3 Develop and Implement District Corrective Action Plan
NI 4 (Guidance is under development for Districts Beyond NI 3.) Continue District Corrective Action Plan Additions To Be Determined

27

• Data Sources
• Student Data
• Demographic and Enrollment
• Assessment Processing (Matching)
• Links assessment data (test scores) with student
  data.

28
Student data/Assessment Processing/AYP Data Flow
One-time load of Assessment Data (GHSGT, GAA,
CRCT)
District Uploads/Enters student data
Information is fed into Assessment Processing
Application
Information is loaded into AYP Reports during the
nightly refresh
District matches records that were not
automatically matched on System ID, School ID and
Student ID and enters LAB/Medical Emergency data
DOE Activities
On-going until student data/Assessment Data is
signed-off
29

• Assessment Processing
• The Assessment Processing (formerly the No Child
  Left Behind - NCLB) application allows users to
  match and enter assessment data to student data.
• Components of the Assessment Processing
  application include the ability to
• Match Criterion Referenced Competency Test
  (CRCT), Georgia High School Graduation Test
  (GHSGT), Middle Grades Writing Assessment (MGWA),
  ACCESS and Georgia Alternative Assessment (GAA)
  records to student data.
• Code a student as having a medical emergency.
• Code a student as a First Year in U.S. School
  student.
• Review summary and detailed reports on a district
  and school level.

30

• Assessment Processing Tips and Tricks
• Assessment Matching
• Goal is to match assessment records to student
  data.
• If there is no data available on the assessment
  record for matching, e.g. first name and last
  names are swapped or invalid, test ID is
  incorrect or birth date is null or incorrect, the
  record can still be matched by creating an upload
  file. File layouts are available in the
  Documents section of the MyGaDOE Portal.
• Only match an assessment record to an Unable to
  Match Reason when the student who took the exam
  is not reported in student data, e.g. students
  who returned to complete graduation requirements.
• If an assessment record is matched to an Unable
  to Match Reason in error, it can be unmatched
  by selecting the Reset Unable to Match option
  from the main menu.

31

• Assessment Processing Tips and Tricks
• Assessment Matching
• Please do not sign off on student data until all
  assessment data is available, i.e. GAA or ACCESS
  data, which is usually the last to become
  available to GaDOE.
• If student data are different on the assessment
  record than what is reported in the student data,
  e.g. grade level, then the student data will
  override what is on the assessment record.
• Tip Assessment records are auto-matched to
  student data based on System ID, School ID and
  Student ID matches. Verify that the records were
  correctly matched through the auto-match process
  by reviewing the matched students report.
• Tip Sometimes when a student cannot be found
  for an assessment record, it is determined that
  the student data is incorrectly matched to
  another assessment record. To correct, un-match
  the incorrect match and then the student data
  will be available for matching. The un-match
  option is located under the Un-match option on
  the main menu.

32

• Assessment Processing Tips and Tricks
• Coding a Student as a Medical Emergency
• Should only be used for students who experienced
  a significant Medical Emergency and could not
  participate in testing. Contact your GOSA Case
  Manager with any questions.
• A student who is coded as having a Medical
  Emergency will be removed from the number of
  students enrolled during the state test window,
  i.e. the denominator in the test participation
  calculation.
• Districts and schools must keep documentation of
  the Medical Emergency.

33

• Assessment Processing Tips and Tricks
• Available Reports
• Matched Assessments Provides a list of
  Assessment Records that have been matched to
  student data.
• Un-Matched Assessments Provides a list of
  Assessment Records that have not been matched to
  student data.
• Un-Matched Students Provides a list of student
  data that have not been matched to Assessment
  Records.
• Unable to Match Provides a list of Assessment
  Records that were matched to an Unable to Match
  Reason.
• Errors and Warnings Provides a list of Errors
  and Warnings generated by the data.
• Percentage Matched Report Provides information
  regarding how many Assessment Records have been
  matched to student data and the percentage
  remaining to be matched.
• Summary Provides summary information regarding
  all assessments. Previously was the Sign-off
  report.

34

• Adequate Yearly Progress Reports
• The Adequate Yearly Progress (AYP) Report
  application will assist Districts and Schools
  with understanding their AYP status prior to the
  finalization of student data, so that data can be
  verified and corrected, if needed. The reports
  contain
• Three years of Test Participation results
• Current years Academic Performance results
• Two years of Second Indicator results
• Districts can drill through the reports to
  review the student level data that is included in
  each of the measurements to determine if data
  correction is required. Excel downloads of
  assessment and graduation class data are also
  available. Note These elements are only
  available within the MyGaDOE portal they are
  not included in the public release.

35

• Adequate Yearly Progress Data Tips and Tricks
• Data Verification
• The following student demographic elements should
  be reviewed for all students
• Student Grade Level
• Gender
• Race
• Economically Disadvantaged (ED) Status
• Student With Disability (SWD) Status
• English Language Learners Status (ELL/LEP)
• Migrant
• Days Absent (excused unexcused)
• Days Present
• Latest Withdrawal Date
• Latest Withdrawal Reason Code

Students who are eligible for Free or Reduced
Priced Meal. Students who are coded as
receiving special education services at anytime
during the school year. Students who are
identified as either English Language Learners
(ELL) Proficient or have exited the program and
are being monitored for two years.
36

• Adequate Yearly Progress Data Tips and Tricks

Column Description
Student in AYP Grade Level Y Students enrolled in AYP Grade Levels (Grades 3 through 8 and 11, and Grades 1 and 2 in K-2 schools).
Test Window Enrollee Y Students who were continuously enrolled at the school during the state testing window for that assessment. State Testing Windows GHSGT March 19, 2007 through March 30, 2007 CRCT April 2, 2007 through May 2, 2007
Medical Emergency Y Students who were coded as having a Medical Emergency.
37

• Adequate Yearly Progress Data Tips and Tricks

Column Description
Student on Test Grade N Students who were tested off grade. For example, a 5 grader was given a 4 grade test.
Test Score N Students for whom there is no test score.
Present Test Not Attempted Y Students whose assessment record had the PTNA bubble bubbled. Verify that this is the complete list of students that should have their assessments coded as PTNA.
Blank Test or DNA or TNA Y Students whose assessment record had the DNA or TNA bubble bubbled. Verify that this is the complete list of students that should be have their assessments coded as DNA or TNA.
38

• Adequate Yearly Progress Data Tips and Tricks

Column Description
Test Participant N Students who are not being counted as test participants, i.e. students who do not have test scores. Verify that this list of students is correct.
FAY Enrollee Y Students who were continuously enrolled at the school from the October FTE Count Day until the end of the state testing window.
GAA Score Y Students who took the GAA in lieu of the CRCT or GHSGT.
GAA Score Accepted Y Students whose GAA Score is Accepted to be used in the AYP Reports.
39

• Adequate Yearly Progress Data Tips and Tricks

Column Description
SWD and Part Time Y Students who were reported in FTE Count 3 with one or two special education segments and all other segments as O.
First Year in US Y Students who are coded as First Year in US students.
Passed on Prior Administration Y (GHSGT only) Students who passed the GHSGT on a prior administration. These students are not counted for participation or academic performance.
Failed on Prior Administration Y Students who failed the GHSGT on a prior administration. (Must be tested.)
40

• Support Resources
• On the web
• Georgia Dept of Education - www.gadoe.org
• My GaDOE Portal Documents
• AYP User Guide
• AYP Quick Reference
• Assessment Processing User Guide
• Summer Graduates User Guide
• Governors Office of Student Achievement -
  www.gaosa.org
• Case Manager List (Joanne Leonard, Nancy Haight
  and Cowen Harter)
• U.S. Dept of Education www.ed.gov
• Consolidated State Accountability Application
  Workbook

41

• Annual State Report Card
• Prepared and distributed by the Governors
  Office of Student Achievement in collaboration
  with the Georgia Department of Education.

42
Annual State Report Card (K-12 Report)
Consists of 7 Major
Sections 1. Accountability
(SSAS) 2. Georgia Tests 3.
National Tests 4. School Performance
Indicators 5. Student and School
Demographics 6. Personnel and Fiscal
7. Comparability Section
43

44
Update

• Case managers from the Governors Office of
  Student Achievement have been assigned to all
  school systems to address questions and provide
  support.
• The Annual Report Cards at the school, system,
  and state levels are anticipated to open during
  the month of September.
• Georgias Single Statewide Accountability System
  of Awards are projected to be announced in
  October.

45
It is not of importance where we stand, but in
what direction we are moving.- Oliver Wendell
Holmes -
46
Governors Office of Student Achievement205
Jesse Hill Jr. Drive, 1966 Twin Towers
EastAtlanta, GA 30334Phone [phone]
Fax [phone] GOSA Website www.gaosa.org
Martha Reichrath, Ph.D. - Executive Director
(404) 463. 1152 Nancy Haight - Accountability
Projects [phone]Cowen Harter, Ed.S. -
Accountability Projects (404) 463. 1168Joanne
Leonard, Ed.S. Director Accountability Projects
[phone]Marylou Mandell, M.S. - Education
Research and Accountability Specialist (404)
463.1179 Debbie Moss - Office Manager (404)
463.1158Laura Peace - Administrative Assistant
[phone]Pam Smith, Ed.S. Director
Standards, Research, and Policy (404)
463.1175 Joanna Vahlsing Education Research and
Accountability Specialist [phone]