Assessing Technology Literacy

1
Assessing Technology Literacy

• Equity and Technology Literacy Meeting the
  Technology Goals of No Child Left Behind
• Sponsored by MARTEC at Temple University
• Dr. Jan Van Dam, ISTE Board President
• jvandam_at_comcast.net

2
AGENDA

• Introduction and Overview
• NCLB and Technology Literacy
• Why Technology Literacy
• Assessing Technology Literacy
• Issues and Opportunities
• Tools and Resources

3
A Little About ISTEThe International
Societyfor Technology in Educationwww.iste.org
4
International Society for Technology in Education
The Premier International Organization for
Technology in K-12 Schools

• Worldwide Network of Leaders in Education and
  Technology
• 74 Geographic Affiliates
• Direct Individual Members
• State Affiliate Organizations
• Corporate Partners
• Special Interest Groups
• Array of Strategic Allies
• Advocates of Improved Schooling through Technology

5
International Society for Technology in Education
The Premier International Organization for
Technology in K-12 Schools

• ISTEs NETS - National Educational Technology
  Standards
• ISTEs C.A.R.E.T - Research-Based Answers
• ISTEs NECC - International Conference and Show
• ISTEs Publications
• ISTEs NCPT3 in the PT3 Program Focus on new
  teachers
• ISTEs Professional Development Opportunities
• ISTEs Role in Policy and Advocacy National Ed
  Tech Plan
• ISTEs Renewed International Focus

6
Technology and NCLB
7
NCLB and Technology

• Know the Language
• Challenging Standards
• Student Achievement
• Annual Yearly Progress
• Accountability

8
Title II D - Enhancing Education Through
Technology Act of 2001

• Legislation requires by 2006
• Technology Literacy by Grade 8
• Teachers Capable of Improving Student
  Learning with Technology
• Teachers Integrating Technology Across the
  Curriculum

9
Title II D - Enhancing Education Through
Technology Act of 2001

• Goals for the Educational Technology Program
• Improve Student Achievement
• Every Student Technologically Literate by End of
  Grade 8
• Integration of Technology with Teacher Training
  and Curriculum

10
Ed Tech Accountability in Planning

• How will states be held accountable for the
  Educational Technology Program?
• Strategies for improving achievement
• Strategies for improving teacher abilities
• Goals aligned with State Standards for use of
  technology to improve achievement
• Achievement includes technology literacy

11
Ed Tech Accountability in Performance

• How will states be held accountable for the
  Educational Technology Program?
• Process and accountability measures for
  integrating technology
• Measures to evaluate the impact of technology
• Department intends to examine progress
  integrating and improving achievement
• No specific inclusion or exclusion of achievement
  of technology literacy

12
Why Technology Literacy?
13
Students bring different experiences and
expectations
14
The cheese of Federal funding for technology
has moved
15
A Report on Childrens Internet Use FromThe
Corporation for Public Broadcasting
A Study by the Corporation for Public
Broadcasting

• CONNECTED TO THE FUTURE (Ages 2 - 17 in the U.S.)
• v Internet use exceeds television watching
• v Childrens internet use is up 59 in 2 years
• v Usage among 2-5 year olds is growing fastest
• Grunwald Associates
• www.cpb.org/ed/resources/connected

16
Why Technology Literacy?

• NCLB
• Learning
• Working
• Citizenship
• Accountability

17
New environments enable more effective
strategies
18
Resources for Evidence

• Web sites that provide evidence for integration
  of technology include
• ISTEs Center for Applied Research
  http//caret.iste.org/
• The Metiri Group http//www.metiri.com/Solutions/
  Research.htm

19
What is involved in Assessing Technology
Literacy?
20
Assessing Technology Literacy

• What is required to assess technology literacy
• Define Technology Literacy
• Establish Benchmarks for Achievement
• Acquire an Aligned and Valid Measurement System
• Capture and Measure Results
• Organize and Interpret Results
• Report Results to Inform Learning and
  Accountability

21
Definitions of Technology Literacy

• Several perspectives arise in defining tech
  literacy ultimately, it is the states
  responsibility.
• ISTEs NETS
• Partnership for 21st Century Skills
• ETSs ICT Literacy
• OEDCs PISA Study
• Other?

22
ISSUES

• Several issues arise in considering assessing
  technology literacy.
• Purpose (Formative, Summative, Accountability)
• Self-Report/Observation
• Performance-based
• Sophistication in Levels of Use
• Embeddedness
• Other?

23
Tools and Resources

• Sources to Watch for Assessment
• ISTE - Resources for Assessment
• Certiports IC3 Certification
• ETS and ICT Literacy Assessments
• Hawaii, North Carolina SDEs and SETDA
• HPRTEC - ProfilerPro, Rubistar
• ICDL - USs Computer Drivers License
• Learning.com - Seriously Embedded Assessment
• Microsoft/ISTE Online Formative Assessment
• NCREL (Learning Point) ISTE NETSS Assessment
• OEDCs PISA ICT Assessment
• PBS - Capstones for ISTE NETST
• U of MN Educational Leaderships NETSA
  Assessment

24
Assessment in the 21st CenturyISTE/Microsoft
Online Assessment
25
The Digital Learning Decision
Traditional vs. 21st Century
26
Five Key Elements of 21st Century Learning

• Emphasize core subjects
• Emphasize learning skills
• Use 21st Century tools to develop learning skills
• Teach and learn in a 21st century context
• Teach and learn 21st century content
• Use 21st century assessments that measure 21st
  century skills

27
ISTE/Microsoft Online Assessment

• Helps teachers monitor student progress to meet
  NCLB legislation requirements
• Provides formative feedback to teachers about
  students technology skills
• Adheres to ISTE National Educational Technology
  Standards (NETSS)
• Based on Microsoft platform
• Students demonstrate skills by completing tasks
  in different applications (Microsoft Office XP
  and Internet Explorer)

28

• Exploring High Stakes Technology Assessments

ICDL, ISTE and Vantage Learning
29
Goals

• New partnership recently announced
• Meet the needs of NCLB/middle school technology
  assessment requests
• Involve ISTE as a development partner
• Create unique tool with widespread application
• Avoid force fit of existing product
• Make it affordable

30
Under Development

• 3 part test
• Knowledge-based Key IT concepts
• Performance-based Key application skills
• Open-ended questions Integrate ICT skills in
  context
• 3 partner roles
• ISTE Anchored in NETS, gain wide input
• ICDL Draw from international syllabus elements
• Vantage Learning Develop fully-automated online
  tests
• Utilize automated essay-scoring for open-ended
  responses

31
(No Transcript)
32
(No Transcript)
33
(No Transcript)
34
Timeline/Cost

• For pilot 2004/05 national use 2005/06
• Under 10/student
• Actively seeking pilot participants
• States
• Major regions
• Contact Mila Thomas at ISTE for info
• mthomas_at_iste.org

35
Quality Tools and Resources

• ISTE http//iste.org
• CARET http//caret.iste.org
• Portical http//portical.org
• ALI http//ali.apple.com
• GLEF http//glef.org
• Profiler Pro http//profiler.pt3.org

36
ISTEs Center for Applied Research in
Educational Technology
C.A.R.E.T. http//caret.iste.org

37
www.iste.org
Jan Van Dam, ISTE Board President jvandam_at_comcast.
net