Maintaining Program Integrity

1

• Maintaining Program Integrity

2
The Role of Product Testing

• Goal Protect the integrity of the label
• Require the submission of appropriate test data
  on a product specific basis
• Enhancing ESTAR Test Methods by referencing
  industry test procedures, developing test
  facility manuals, and requiring third-party
  documentation, where necessary
• Implementing Testing Initiative to identify
  potential compliance problems
• Set in motion a review process to ensure
  manufacturers take corrective measures

3
Referencing Industry Test Procedures

• Dehumidifiers Test Criteria Tests shall be
  conducted in accordance with Clauses 4, 5, and 7
  of ANSI/AHAM Standard DH-1, except that a
  watt-hour meter shall be used to measure
  dehumidifier energy consumption during the
  capacity rating test. The watt-hour meter shall
  be accurate within 0.5 percent of the indicated
  value and have a scale with graduations of 1
  watt-hour or less. Energy Factor is to be
  calculated according to Section 4.2 of
  CAN/CSA-C749-94.

4
Quality Assurance Improved Test Methods

• EX ESTAR Ceiling Fan Test Facility
  Guidance Manual
• Provides procedures and specifications for
  building and setting up an air delivery room,
  specifies equipment, test method reporting
  procedures
• Requires laboratories to calibrate to ensure
  consistent, repeatable results
• All laboratories are required to calibrate, using
  the same reference fan, once a year and produce
  results within /-3 of each other.

5
Quality Assurance Improved Test Methods (cont.)

• EX ESTAR Monitor Test Method Committee
• More than 30 industry representatives
  collaborating with EPA on the draft monitor test
  method
• References published specifications from VESA and
  IEC
• supplement guidelines where necessary with
  methods developed in cooperation with industry
• Process will ensure On Mode testing consistency
  among manufacturers

6
Compliance Testing Initiative

• Selecting products with greatest market share
• Using existing ESTAR testing guidelines
• Independent testing lab
• Stakeholder communication protocol with defined
  steps for non-compliance
• Test results and recommendations
• July/August -- Televisions
• Nov. -- DVDs
• Dec./Jan. -- Monitors
• Future efforts under consideration potential
  on-site test method evaluations

7
TV Results
8
DVD Results
9
Lighting Fixtures and Bulbs

• Routine/ongoing testing initiative
• PEARL -- creation and funding of certified lab to
  test product quality and performance
• Two rounds of testing to date
• Products failing are removed from ENERGY STAR

10
Retail PartnerStore Level Assessment

• Background and Summary
• Rounds 1 2

11
Retail Store Level Assessment

• Designed to evaluate the consumer shopping
  experience with ENERGY STAR in retail channel
• Programmatic changes to increase product
  purchases
• Three part assessment
• Salesperson knowledge and extent ENERGY STAR
  messaging is used in sales process
• Visibility/presence of ENERGY STAR in store
  displays by department
• Availability/visibility of ENERGY STAR qualified
  and labeled products in stores

12
Basic Approach

• Approx. 7 qualified product categories for each
  trial (e.g., DVDs, TVs) some variability
• Approx. 5 national retailers including Best Buy,
  Home Depot, Lowes, Sears, WalMart
• Approx. 7 cities across the country from MA to CA

13
Cities/Products Fall Summer

• Atlanta, GA
• Baltimore, MD
• Boston, MA
• Dallas, TX
• Milwaukee, WI
• Portland, OR
• San Diego, CA

• TVs (fall 01)
• DVDs (summer 02)

14
Evaluation Process

• Sales Staff Evaluation
• Shoppers Evaluate
• 3 top considerations identified during sale
• Mention of ENERGY STAR and understanding of
  program goals, elements, or features during the
  sales process
• Combine to one score and scale to 100
• To reach 100
• Present ENERGY STAR, energy efficiency, and
  environment as top considerations
• Demonstrate thorough knowledge of ENERGY STAR
  program during the sale

15
Evaluation Process

• Display Check
• Display material (POS/POP) present beyond labeled
  products
• Who generates/applies and relative size
• Product Shelf Inventory
• Measure proportion ENERGY STAR-qualified products
  on shelves
• Check visibility/presence of ENERGY STAR label on
  products and packaging

16
Summary Findings 2 rounds

• Salesperson knowledge
• Scores by product 25-50
• Highest CFLs, appliances
• Lowest electronics
• Store display visibility
• Little difference in presence of ENERGY STAR
  focused materials in the two rounds
• High opportunity in lighting and CE departments
  to coordinate materials with ENERGY STAR product
  promotions

17
Summary Findings 2 rounds

• Product inventory
• Shelf area devoted to qualified products
  consistent with market penetration data
• Ideal see increase, over time, in inventory of
  ENERGY STAR qualified products
• Product labeling
• 26 of qualified DVD models not labeled at all
  26 models mixed
• Small number of products mis-labeled

18
Our Action Steps

• Retail partner strategies
• Best Buy, Costco, Nationwide, RadioShack, Sears,
  WalMart
• Training/Product stocking
• Promotion matchmaking
• Contact with retailers/vendors
• Website re-engineering
• Shopping tool more robust
• Qualified Product lists more accurate, easier to
  use

19
Our Action Steps

• Future RSL plans
• 2 rounds/year
• Some variation in products/retailers
• Local appliance/electronics dealers included on a
  limited basis
• Questions

20
Logo Monitoring

• Newspaper/magazine clips
• monthly
• Websites
• quarterly
• Follow up
• calls
• letters
• referral to DOJ

21
Discussion and Feedback

• Are there additional measures we should consider
  taking to protect the integrity of the ENERGY
  STAR label?