usaid/asia, testing for quality, benchmarking energy saving lamps, 4-2010

Upload: detlef-loy

Post on 05-Apr-2018

215 views

Category:

Documents


0 download

TRANSCRIPT

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    1/53

    April 2010

    TESTINGFORQUALITYBenchmarking Energy-Saving Lamps in Asia

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    2/53

    TESTINGFORQUALITYBenchmarking Energy-Saving Lamps in Asia

    DISCLAIMER

    This report is made possible by the generous support o the United States Government through the Asia-Pacifc

    Partnership on Clean Development and Climate (APP). The views expressed in this report do not necessarily

    reect the views o APP, APP partner countries, the United States Agency or International Development, or the

    United States Government.

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    3/53

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    4/53

    ii TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    LIST OF TABLES AND BOXES

    Table 1. Key Metrics and Compliance Standards Evaluated ........................................................................................................... 8

    Table 2. Breakdown o CFL Sample or Laboratory Testing ......................................................................................................... 12

    Table 3. Efcacy Test Pass Rates or All 137 Models vs. ALC Tiers 1, 2, and 3 .......................................................................... 16

    Table 4. Survival Test Pass Rate or All 137 Models vs. ALC Tier 1, 2, and 3 ............................................................................. 20

    Table 5. Lumen Maintenance Test Pass Rate or ALC Tiers 1, 2 and 3 .......................................................................................21

    Table 6. Power Factor Test Pass Rate or ALC Tiers 1, 2 and 3 ................................................................................................... 24

    Table 7. CRI Test Pass Rate or ALC Tiers 1, 2 and 3 .....................................................................................................................26

    Table 8. Pass Rate or all Tested Metrics ...........................................................................................................................................28

    Table 2.3.1. Criteria with Levels that vary with Tier .....................................................................................................................35

    Table 2.3.2. With minimum Threshold Levels ................................................................................................................................. 36

    Table 2.3.3. Passing Conditions .......................................................................................................................................................... 37

    Attachment A Table 1. Table o values used in Appendix A Figure 1 ...................................................................................... 42

    Attachment A Table 2. Table o values used in Appendix A Figure 2 ..................................................................................... 42

    Attachment A Table 3. Table o values used in Appendix B Figure 1 ..................................................................................... 43

    Attachment A Table 4. Table o values used in Appendix B Figure 2 ..................................................................................... 43

    Box 1. Defning CFL Quality .................................................................................................................................................................. 7

    Box 2. The ALC Quality System ............................................................................................................................................................ 9

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    5/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA iii

    LIST OF FIGURES

    Figure 1. Overall CFL Perormance Versus Established Quality Standards ................................................................................ 2

    Figure 2. CFL Mercury Content Test Results ................................................................................................................................... 3

    Figure 3. Estimated Chinese CFL Production 19962007 ............................................................................................................. 6

    Figure 4. Average Efcacy (lumens/Watt) o Test Models vs. Measured Power Taken Ater a 100-hour

    Burn-in Period ................................................................................................................................................................................... 14

    Figure 5. Average Efcacy (lumens/Watt) o Test Models by Efcacy Bins ............................................................................... 14

    Figure 6. Average Efcacy (lumens/Watt) by Brand Type .............................................................................................................15

    Figure 7. Lamp Efcacies and Costs ..................................................................................................................................................15

    Figure 8. Pass/Fail Rates or All 137 Models Tested vs. ALC Tier 1, 2, and 3 Efcacy Test ..................................................... 16Figure 9. Individual Survival Rates or Each o the 137 Models Tested ......................................................................................17

    Figure 10. Survival Rates or 137 Tested Models by Survival Rate Bins ....................................................................................17

    Figure 11. Survival Rates and Brand Type ........................................................................................................................................18

    Figure 12. Lamp Survival Rates and Purchase Price ...................................................................................................................... 19

    Figure 13. Survival Test Pass Rates vs. ALC Tier 1, 2, and 3 .........................................................................................................19

    Figure 14. Lumen Depreciation o Models ater 2,000 Hours o Operation .......................................................................... 20

    Figure 15. Lumen Depreciation Bins o Models Ater 2,000 Hours o Operation ................................................................21

    Figure 16. Lumen Maintenance by Brand Type ...............................................................................................................................22

    Figure 17. Lumen Maintenance Test Pass Rate or ALC Tiers 1, 2 and 3 ..................................................................................23

    Figure 18. Average Power Factor Results or All 137 Models Tested ........................................................................................23

    Figure 19. Power Factor o Models Separated in Bins ..................................................................................................................24

    Figure 20. Power Factor Test Pass Rate or ALC Tiers 1, 2 and 3 .............................................................................................. 25

    Figure 21. Color Rendering Index (CRI) or 91 Tested Models (46 Models Were not Tested) .......................................... 25

    Figure 22. CRI Test results Separated Into Bins .............................................................................................................................25

    Figure 23. CRI Test Results by Brand Type ...................................................................................................................................... 28

    Figure 24. CRI test pass rate or ALC Tiers 1, 2 and 3 .................................................................................................................29

    Figure 25. Pass Rate or All Tested Methods ................................................................................................................................... 29

    Figure 26. Mercury Content o Selected CFL Models (note: Chart Capped at 20 mg) ........................................................ 31

    Figure 27. Mercury Content o Versus Lamp Cost ........................................................................................................................ 31

    Appendix A Figure 1. Minimum allowable 100 hour lumen or declared CFL rated wattage ..........................................40

    Appendix A Figure 2. Minimum limit or lumen maintenance o primary Classes 1, 2 and 3 lamps, and

    any other CFL Class as detailed in the specifcation, at any time through lie ...................................................................41

    Appendix B Figure 1. Standard EN 60064 tungsten flament lamp rating equivalence claim requirements ..................41

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    6/53

    iv TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    ACRONYMS

    Asia Lighting Compact

    Asia-Pacifc Partnership on Clean Development and Climate

    Association o Southeast Asian Nations

    Australian/New Zealand Standard

    Bureau o Indian Standards

    correlated color temperature

    compact uorescent lamp

    Comit International Spcial des Perturbations Radiolectriques

    color rendering indexDepartment o Environment, Water, Heritage, and the Arts (Australia)

    European Commission

    Environmental Cooperation-Asia

    Efcient Lighting Initiative

    electromagnetic compatibility

    Electrical Research and Development Association (India)

    Energy Saving Trust (UK)

    Global Environment Facility

    general lighting service

    high power actor

    hours

    International Electrotechnical Commission

    lumen

    milligram

    non-governmental organization

    National Lighting Test Center (China)

    National Physical Laboratory (India)

    New South Wales (Australia)

    Regional Development Mission or Asia

    Standard Deviation o Color Matching

    total harmonic distortion

    United Kingdom

    United States

    United States Agency or International Development

    watt

    Waste Electrical and Electronic Equipment

    ALC

    APP

    ASEAN

    AS/NZS

    BIS

    CCT

    CFL

    CISPR

    CRIDEWHA

    EC

    ECO-Asia

    ELI

    EMC

    ERDA

    EST

    GEF

    GLS

    HPF

    hrs

    IEC

    lm

    mg

    NGO

    NLTC

    NPL

    NSW

    RDMA USAID

    SDCM

    THD

    UK

    US

    USAID

    W

    WEEE

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    7/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA v

    ThisreportwasfundedbytheUnitedStates

    AgencyforInternationalDevelopmentsRegional

    DevelopmentMissionforAsia(USAID/RDMA)

    throughitsEnvironmentalCooperation-AsiaClean

    DevelopmentandClimateProgram(ECO-Asia).Support

    forthetestingeffortswasprovidedbytheDepartment

    ofEnvironment,Water,Heritage ,andtheArts(DEWHA),

    AustralianGovernmentaspartoftheAsia-Pacic

    PartnershiponCleanDevelopmentandClimate(APP).

    ErikPageofErikPage&Associateswastheprimary

    reportauthor.Dataanalysiswasconductedbyacore

    ACKNOWLEDGMENTS

    teamcomprisingErikPageandStevenBeletichof

    BeletichAssociates.Additionalcontentandrevisions

    wereprovidedbyMyTon,TeamLeader,EfcientLighting,

    ECO-Asia.Thereportwasproducedundertheoverall

    guidanceandsupervisionofPeterduPont,ChiefofParty,

    ECO-Asia,OrestesAnastasia,RegionalEnvironment

    AdvisorforRDMA,andMelanieSlade,Director,Lighting

    andEquipmentEnergyEfciency,DEWHA.Adraftof

    therepor twasreviewedbyanumberofinternational

    experts,includingStuartJeffcottoftheInternationalCFLHarmonizationInitiative.

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    8/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 1

    OVERVIEW

    Nationalandlocaleffortstopromotelightingenergy

    efciencyhavebeengatheringstrengthinAsia.Manyofthese

    programsfeaturethecompactuorescentlamp(CFL),as

    adoptionofCFLsisoneofthequickestandeasiestmeans

    ofdeliveringenergyconservationintheresidentialand

    commercialsectors.Morethanfortycountries,manyof

    theminAsia,haveannouncedplanstophaseouttheuseof

    incandescentlampsaspartoftheireffortstoaddressclimate

    change,withtheCFLbeingpromotedasareplacement.1

    TheincreasingfocusonCFLshassignicantlyaccelerated

    theglobaldemandforthelamps.WorldwideCFLproduction

    hasincreasedsix-foldinthelastdecade,from500million

    lampsin2000tomorethan3billionlampsin2008.2This

    isexpectedtoaccelerate,asthephaseoutofincandescent

    lampscouldboostdemandofCFLstoasmanyas10billion

    unitsperyear.3

    CountriesinAsiafaceseriouschallengeswhenitcomesto

    adoptionofCFLs,includingpurchasecost,sub-standardquality,

    alackofcommonstandardsforCFLs,andalackofconsumerawarenessaboutCFLquality.Inaddition,althoughCFLsare

    beingsoldacrossAsia,thelackofacommonstandardmakes

    itdifcultfordatasharingacrosstheregion,orestablishment

    ofaregionaltestingprogram.SinceCFLsarebeingpromoted

    asadirectreplacementforincandescentlamps,CFLsthat

    donotoutperformincandescentlampscanresultinserious

    consumerdissatisfactionwiththeproductcategoryasawhole.

    Thus,thetermslow-quality,lower-quality,sub-standard,

    poor,orshoddyarenowbeingusedbyexperts,program

    managers,andregulatorstodescribethepoor-performing

    CFLsthatarebeingproducedinlargequantitiesandsoldinmanymarketsintheAsiaregion.

    EXECUTIVE SUMMARY

    PURPOSE AND SCOPE OF THIS REPORT

    InordertoassessandaddresstheseCFLproduct

    qualityandstandardsharmonizationissues,the

    ECO-AsiaCleanDevelopmentandClimateProgram

    (ECO-Asia)partneredwiththeAustralianDepartment

    ofEnvironment,Water,HeritageandtheArts(DEWHA)

    in2008undertheaegisoftheAsia-PacicPartnership

    onCleanDevelopmentandClimate(APP)toinitiate

    asubstantialregionalCFLqualityandperformance

    benchmarktestingprogram.Theprimaryobjectivesof

    thisCFLbenchmarktestingprogramwere:

    ToassesstheoverallqualityofCFLscurrentlybeing

    soldinvariousAsianmarkets.

    Toassesstheopportunitiesforharmonizationof

    CFLstandardsbasedontestresults.

    Togaininsightintothepossibilityofimplementinga

    regionalproducttestingprogramanditscomplexity.

    Tomakearst-orderexaminationoflampmercurycontent.

    THE TEST PROCESS AND RESULTS

    SampleCFLswerepurchasedfromstoresinsixcountries

    Australia,India,Indonesia,thePhilippines,Thailand,and

    Vietnam.AustralianlampswerepurchasedbyDEWHA

    staff,andlampsinIndia,Indonesia,Philippines,Thailand,

    andVietnamwerepurchasedbyECO-Asiastaffusinga

    common,consistentprocurementmethodology.Overall,

    morethan2,600sampleswerecollectedrepresenting

    160models(theperformanceresultsbelowrepresentresultsfrom137models).4Theresultspresentedfocus

    1. Phasing in Quality: Harmonization of CFLs to Help Asia Address Climate Change. USAIDAsia,March2009.

    2. Chen,Yansheng.ChinaAssociationofLightingIndustr y,2008.

    3. Global Lighting: Phase Out of Incandescent Lamps. ProjectIdenticationFormundertheGEFTrustFundfortheGlobalEnvironmentFacility.July2007.

    4. AdditionalandsupplementaryanalysesonthetestdatahavebeencarriedoutbyDEWHA.Themethodologyandresultsfromthesefurtherinvestigationsareavailableonline,andwillbeavailableasDEWHAreportsseparatelyin2010.

    5. Testedinaccordancewith IEC 60969 Ed. 1.3 b:2009. Self-ballasted lamps for general lighting ser vices Performance requirements.

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    9/53

    2 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    6. TheAsiaLightingCompact(ALC)isanon-protpublic-privatepartnershipthatworkstoimprovethequalityoflightingproductsandencouragetheadoptionofenergy-efcientlightinginAsia.TheALCwasformedinOctober2009withmembersincludingnationallightingassociationsinAsia,internationallightingmanufacturers,andgovernmentagencies.

    7. 5mgisthemaximumlevelbeingsetfortheUSandEuropeanmarketsbyvariousorganizations.

    onthefollowingvemetrics:5

    Efcacy

    SurvivalRate

    LumenMaintenance Powerfactor

    ColorRenderingIndex(CRI)

    Alongwiththediscussionofthenumericalresultsofthese

    vekeymetrics,theseresultswerecomparedtothethree

    qualitytiersoftheAsiaLightingCompact:6Tier1,which

    isequivalenttoChinasminimumperformancestandards

    andrepresentsgoodquality;Tier2,whichisharmonized

    withthestandardoftheEfcientLightingInitiative(ELI)and

    representsbetterquality;andTier3,whichisequivalent

    tothequalitystandardforEuropeanlamps,theUnited

    KingdomsEnergySavingTrustandrepresentsthebest

    quality.Figure 1 showsthatonlytwoofthreelamps

    tested(66%)canmeettheTier1standard,andjust58%of

    lampsmeettheTier2standard.

    Asubsetofthelampmodelswastestedfortheirmercury

    content,andtheresultsfromatotalof43randomly

    selectedmodelsfromthesixcountriesarepresented

    belowinFigure 2. Theresultsshowedthatatleast25%

    ofthelampshaveaveragemercurycontentofmorethan

    5mg,andlampswithhigheraveragemercurycontentare

    presentinallmarkets.7Furthermore,whenthemercury

    contentoflampsisconsideredagainstthelampcosts,some

    ofthelower-pricedlampsalsohavemuchhighermercury

    contentrelativetolampswithhighercostsorfrommore

    well-knownmanufacturers.

    Figure 1. Overall CFL Performance Versus Established Quality Standards.

    Australia-purchased lamps

    Non Australia-purchased lamps

    Tier 1

    80.0%

    70.0%

    60.0%

    50.0%

    40.0%

    30.0%

    20.0%

    10.0%

    0.0%

    Tier 2 Tier 3

    Pass Rate - All Metrics

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    10/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 3

    CONCLUSIONS AND RECOMMENDATIONS

    Thefollowingaresomeofthemainconclusionsthatcanbe

    drawnfromtheresultsofthisbenchmarktestingeffort:

    Atleastone-thirdofthesamplefailedtomeetwhatmay

    beconsideredasminimumperformancestandards

    (orthecriteriaforwhatmaybeconsideredaquality

    lamp)fortheregion. 8

    Theoverallfailurerateislikelytobesignicantly

    higherthanpresentedhereduetolimitationsin

    laboratorytesting,andthatonlyasubsetofallrequired

    metricsdeningaqualityCFLwasevaluated.

    Atleast90%oftestedproductsdonotmeettherequirementsforALCTier3,orEuropeanequivalent

    standards.

    Name-brandmodelsgenerallyperformedbetterthan

    low-pricedmodelsinmostcasesagainstmostmetrics.

    Exceptionstothisrulewerenoted.

    WiththeformationoftheAsiaLightingCompact(ALC)

    andthereleaseoftheALCsCFLQualityGuidelines,

    whichpresentacomprehensivesetofCFLqualitycriteria

    developedbaseduponinternationallyacceptedstandards,

    thereisnowasetofqualitystandardsthatcouldbe

    recognizedandappliedacrosstheregion.

    TheALCalongwithotheractorsinAsiacanandneed

    toworktogether,inordertoscaleupthediscussionsof

    CFLpromotiontotheinternationallevelandtoforgean

    agreementoncommonsolutions,beforeacombinationofpolicymisstepsandconsumerbacklashlimitthepotential

    expansionoftheregionalandglobalCFLmarket.In

    addition,regionalmeasuresspecictoCFLtestingand

    marketmonitoringarepresentedbelow.

    Figure 2. CFL Mercury Content Test Results

    8.Note:Failureasusedinthiscontext,indicatesthattheaverageofresultsfromthetestedsamplesofapar ticularCFLmodeldoesnotmeetadenedperformancelevel(i.e.,forefcacy,powerfactororCRI),ratherthanaphysicalormechanicalfailurethatrendersthelampinoperative.Thisappliestoallparametersevaluatedexceptforthesurvivabilitytestresults,whichindicateactuallampfailures.

    EXECUTIVE SUMMARY

    Test Results for CFL Mercury Content(minimum, maximum and average shown)

    20

    17.5

    15

    12.5

    10

    7.5

    5

    2.5

    0

    mgofMercury(Hg)

    AUST-B

    A

    AUST-A

    P

    AUST-V

    AUST-A

    R

    AUST-W

    AUST-A

    S

    AUST-A

    X

    THAI-P1

    AUST-D

    V

    AUST-D

    W

    AUST-D

    X

    INDI-B2

    AUST-D

    U

    THAI-B2

    THAI-P3

    AUST-C

    1

    INDI-P5

    AUST-C

    E

    INDI-B6

    INDO-P

    6

    AUST-B

    1

    PHIL-P

    4

    VIET-P1

    INDI-P1

    AUST-A

    T

    AUST-S

    AUST-C

    S

    INDI-P6

    INDO-B

    2

    AUST-A

    V

    INDO-P

    4

    AUST-C

    L

    INDO-P

    1

    PHIL-P

    3

    AUST-T

    AUST-D

    S

    PHIL-P

    1

    VIET-B2

    PHIL-B

    2

    THAI-P4

    INDO-P

    3

    VIET-P3

    AUST-D

    T

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    11/53

    4 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    Aregionalagreementonacommontestprocedure,

    adata-sharingplan,andwaystomutuallyrecognize

    testresultsacrossnationsisurgentlyneededamong

    standardsandenforcementagencies.

    Thereisapressingneedforauniform,recurring,regional,

    processtotestandassurethequalityofCFLssoldinthe

    region.Suchregulareffortscanservetoinformpolicy

    makersonthestateofthemarket,andalsotoinsurethe

    integrityofprogramstopromoteCFLs.

    Governmentagencies,theprivatesector(including

    manufacturersandretailersofCFLs),and

    non-governmentalorganizations(NGOs)intheregion

    shouldtakeconcreteactionstoincreaseuserawareness

    ofhigh-qualityCFLproductsandwaystoidentifythem,andsupportindependentactionssuchastheALCto

    ensurequalityproductsareavailableforallofAsia.

    Anumberofcountriesintheregionneedtechnical

    assistanceinsettinguptheinfrastructure(testing

    facility,developmentofstandards,trainingoflaboratory

    personnel,etc.)tocertifytheperformanceofCFLstoa

    common,regionallevel,aswellasinrecyclingCFLsand

    dealingwithend-of-lifeissues,includingmercurycontent

    andsafelampdisposal. 9

    Moretestingisrecommendedtocorroboratethese

    initialndings.ThiswouldbeparticularlyusefulinCFLmodelsintendedfortheverylargeandquicklygrowing

    Chinesemarket.Regulatorsandprogrammanagers

    wouldbewell-servedbyanon-going,regular,regional

    testingregime.

    Asabouthalfofthelampmodelstestedhaveatleastone

    ormoresampleswithmorethan5mgofmercury.The

    issueofmercurycontentanddosingcontrolinlampsas

    wellastestmethodologies,meritasecond,focusedround

    oftestingeffortsthatcancovermoreoftheregional

    markets,andmayalsohelptoinformmercuryrecyclingandeducationalprograms.

    Thevalueofarobust,harmonizedsetofqualitystandards

    fortheregioncannotbeunderstated.Withsucha

    mechanism,well-performingproductscouldbeidentied

    independently,allowingpurchaserstoselectproducts

    basedonvalue(price)whilebeingassuredofatleasta

    minimumlevelofperformance.

    9. OneexampleofthistechnicalassistanceistheneedforfacilitiestoconductCRItestingoflampsinIndia.

    EXECUTIVE SUMMARY

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    12/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 5

    BACKGROUND

    Nationalandlocaleffortstopromoteenergyefciencyhave

    beengatheringstrengthworld-wide,spurredbyheightened

    concernsoverissuesofenergysecurity,environmental

    degradation,andclimatechange.Manyoftheseefciency

    effortsincludeprogramstargetinglighting,asitaccountsfor

    aboutone-fthofglobalelectricityconsumption.10Todate,

    morethanfortycountries,includingmanyAsiancountries,

    haveannouncedplanstophaseouttheuseofincandescent

    lamps,withthecompactuorescentlamp(CFL)beingpromotedasadirect,readilyavailable,andcosteffective

    alternative.11

    TheincreasingfocusonCFLshassignicantlyaccelerated

    theglobaldemandfortheselamps.Themostdramatic

    increasehappenedwithinthepastdecade:annualglobal

    CFLproductionisestimatedtohavereachedonebillion

    unitsperyearjustoverveyearsago,andnowexceeds

    threebillionunitsannually.Ifcurrentgrowthtrendscontinue,

    globalCFLproductioncouldexceedfourbillionunits

    annuallyby2010.Thisisexpectedtoaccelerate,asthephaseoutofincandescentlampscouldboostdemandof

    CFLstoasmanyas10billionunitsperyear.

    DuringtheearlystagesofCFLproduction,manufacturing

    wasdominatedbyafewwell-knowninternationalbrands

    andproductionwasbasedinEurope,theUS,Japan,and

    China.Presently,theproductionofCFLsisbeingcarriedout

    mostlybyalargegroupoflesswell-knownmanufacturers

    throughoutAsia.Chinacurrentlyleadstheworldinthe

    numberofCFLmanufacturersandCFLproduction

    (Figure 3):thereareatleast200CFLmanufacturersand400suppliersofspecializedCFLmaterialsandcomponents;

    morethan90percentoftheCFLssoldworldwideare

    manufacturedinChina.12

    CFL ADOPTION IN ASIA AND THE

    ISSUE OF QUALITY

    Asawhole,countriesinAsiafaceanumberofserious

    challengeswhenitcomestoadoptionofCFLs.Purchase

    costcanbeaformidablebarrier.Althoughitrepresents

    oneofthequickestandeasiestmeansofdeliveringenergy

    conservation,aCFLcanpresentaneconomicchallengetotheaverageAsianconsumer.Comparedtoanincandescent

    lamp,aCFLtypicallycarriesa10to15timespricepremium,

    puttingitinlinewithsomefamiliesdailyincome,andplacing

    itoutofreachformanypartsofAsia.

    Suspect product quality is another challenge to CFL adoption,

    especially given its price premium. Since CFLs are being

    promoted as a direct replacement for incandescent lamps, CFLs

    that do not outperform incandescent lamps can result in serious

    consumer dissatisfaction with the product category as a whole.

    Unfortunately,forAsia,thereisnowidelyusedregionalor

    internationalstandardforCFLqualityandperformance,

    noraretherewidelyandpublicallyavailablelamptestdata.

    Whiletherehavebeenanumberofproducttestingefforts

    inplaceoron-going,thelackofregionallyacceptedstandard

    anddataexchangemechanismshavemadeitdifcultfor

    countriestorecognizeandsharetestresults.13Therefore,

    CFLstypicallyhavebeenassessedinrelationtonational

    standardsandguidelinesortomanufacturersadvertised

    claims.Generallyspeaking,apoor-qualityCFLisalampthat

    burnsoutfaster,orgivesofflesslight,thanadvertised,orthanprescribedbynationalstandardsandguidelines.14

    10.From Idea to Action: Clean Energy Solution for Asia to Address Climate Change. USAIDAsiaMay2007.

    11.Phasing in Quality: Harmonization of CFLs to Help Asia Address Climate Change. USAIDAsia,March2009.

    12.ChenYanshen,China Response to Phase-out of Inefcient Lighting. PresentedatthePhase-Out2008WorkingTowardsGlobalPhase-outofInefcientLightingworkshop.SotelHylandHotel,Shanghai,China,May2008.

    13.Forexample,ChinahasacomprehensiveCFLqualitymonitoringandsupervisionsystemfordomesticCFLs.PhilippinesDepartmentofEnergyandThailandsElectricityGeneratingAuthorityalsohavetestingprograms.

    14.However,thisapproachdoesnotallowadirectcomparisonofproductqualityacrosstheregion.

    OVERVIEW:

    THE CFL MARKET IN ASIA

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    13/53

    6 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    Thetermslow-quality,lower-quality,sub-standard,

    poor,orshoddyarenowbeingusedbyexperts,

    programmanagers,andregulatorstodescribethepoor-

    performingCFLsthatarebeingproducedinlargequantities

    andsoldinmanymarketsintheregion.Generallyspeaking,

    forCFLs,qualityreferstotheirabilitytoperformas

    expected,particularlyasrelatedtolongevity,color,and

    lightoutput.Itshouldbenotedthatasignicantpresence

    ofpoor-qualityCFLsinthemarketcanleadtoaconditionknownasmarketspoilage,andcanresultinlimiting

    CFLpenetrationratesasconsumersconsidertheproducts

    apoorvalueproposition.

    CFLqualityissueshavebecomepronouncedinAsian

    marketsasaresultitssignicantgrowthandconsumer

    sensitivitytopurchasecosts.Thiscost-sensitivityhasledto

    theavailabilityofCFLsthataregenerallycheaperthanthose

    inNorthAmericanorEuropeanmarkets,buttheselower

    costshaveoftenbeenachievedattheexpense

    ofproductquality.

    Beyondthis,CFLsthatfailsignicantlybeforetheirrated

    livesposerisksforpolicymakersastheyweighcost-to-

    impactdecisionsaimedatachievingreductionsinenergy

    usageand/orgreenhousegasproduction.

    In2007,ECO-AsiapublishedareportanalyzingCFLmarkets

    andprogramsinChina,India,andthefourlargestASEAN

    countriesIndonesia,thePhilippines,Thailand,andVietnam.15

    ThereportassessedthequalityofCFLsavailableinregional

    marketsandfoundthatasmanyashalfoftheCFLs

    producedandsoldinAsiawereshoddyorsub-standard

    (e.g.,burningoutfasterorproducinglesslightthanadvertisedorrequiredbynationalregulations).Thereportproposedan

    immediateandintensivecoordinationofexistingregionalCFL

    initiativesinordertosupportdevelopmentofabroad-based

    qualityassuranceprocessinAsia.

    Anumberofregionaleffortshavebeenundertakeninan

    efforttoimproveCFLqualityinAsianmarkets,includingthe

    developmentofnationalperformancestandardsforCFLs.

    ManyofthesestandardsrequireCFLstoachievecertain

    minimumperformancebenchmarks(including

    efcacy,life,start-uptime,run-uptime,andmercurycontent)inordertobecertiedascompliant.Therearealsotesting

    requirementsassociatedwithanumberofnationalstandards. 16

    Whilethesestandardshaveaddressedmanyoftheir

    15.Condence in Quality: Harmonization of CFLs to Help Asia Address Climate Change.USAIDAsia.October2007.

    16.Forexample,inIndia,lampsmustmeettheBureauofIndianStandards(BIS)srequirementstobeartheBISlogoandbeallowedonthemarket.

    Figure 3. Estimated Chinese CFL Production 19962007

    OVERVIEW: THE CFL MARKET IN ASIA

    CFL Production in China

    Source:Chen,Yansheng.ChinaAssociationofLightingIndustry,2008.

    1996

    0.150.1 0.210.29

    0.480.75 0.8

    1.041.38

    1.76

    2.4

    3

    1997 1998 1999 2000 2001 2002 2003 2004 2005 2006 2007

    Units (Billion)

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    14/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 7

    objectiveswithregardstoCFLqualityissues,theyhave

    paradoxicallyintroducedanewbarriertothemarket:

    marketconfusionarisingfromthelackofstandardization

    orharmonizationbetweenthesestandards.Thislackof

    harmonizationcreatesconcernsforbothconsumersof

    CFLs,whomustdecideifaCFLishigh-qualityifitpasses

    somestandardsbutfailssomeothers,andformanufacturersofCFLswhomustdevelop,test,andlabelproductsto

    multiplestandards.

    PURPOSE AND SCOPE OF THIS REPORT

    InordertoassessandaddresstheseCFLproductquality

    andstandardsharmonizationissues,USAIDsECO-Asia

    CleanDevelopmentandClimateProgrampartnered

    withtheAustralianDepartmentofEnvironment,Water,

    Heritage,andtheArts(DEWHA)in2008undertheaegis

    oftheAsia-PacicPartnershiponCleanDevelopmentandClimate(APP)toinitiateasubstantialregionalCFLquality

    andperformancebenchmarktestingprogram.Theprimary

    objectivesofthisCFLtestingprogramwere:

    Box 1. Dening CFL Quality

    CFLs are complex electrical devices, and have grown more so with the incorporation o electronic ballasts, along

    with the market drive to reduce the size o the CFL while maximizing the number o locations and fxtures

    in which it can be suitably installed. As a consequence, manuacturers must balance a number o physical andproduction actors in order to deliver a CFL that will simultaneously meet consumer expectations in terms o

    product unctions and price, while satisying regulators and utilities on energy perormance. In this balancing act, a

    small adjustment o one perormance actor has the potential to aect other actors in signifcant ways.

    In defning what constitutes a quality CFL, it is important to consider and even group its various characteristics

    in order to identiy the ones that are necessary or broad acceptance, frst and oremost by consumers, but also

    by regulators, program managers, utilities, energy advocates, and program administrators. In addition, each o these

    characteristics needs to be considered in the context o a mass-produced, international product that has to be

    efcient, aordable, long lasting, and approximate the incandescent lamp in ft, unction, and light quality.

    Many organizations have developed standards and criteria or CFLs based on their area or areas o responsibilities,

    ranging rom saety to energy efciency, and their results reect these multiple views o CFL perormance that can

    take the CFL quite ar in one direction, oten at a cost to its other attributes. For example, a super high-efcacy

    lamp may be more expensive to produce, or may not be able to maintain its lumen output over its lie, depending

    on how the manuacturer chooses to address the issue. Similarly, a long-lie (10,000+ hrs) lamp needs a more

    reliable starting mechanism than a normal lie lamp (6,000-8,000 hrs), and may require a longer starting time.

    Addressing this product quality issue on a piecemeal, country-by-country basis is not practical a regional

    approach is needed. In June 2008, a coalition o national lighting associations and the worlds largest lighting

    companies signed an agreement to push or the elimination o substandard CFLs in the Asia market. Under this

    agreement, known as the Manila Compact, lighting suppliers committed to develop common perormance levels

    to rate the quality o CFLs sold in Asia, introduce a product marking system, and establish an on-line regional

    database that identifes those CFLs that meet quality standards. In order to implement this certifcation andmarking system, the signatories grouped together to ormally establish the Asia Lighting Compact in October 2009.

    OVERVIEW: THE CFL MARKET IN ASIA

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    15/53

    8 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    ToassesstheoverallqualityofCFLscurrentlybeingsoldinvariousAsianandAustralianmarkets.

    Toassesstheopportunitiesforharmonizationof

    CFLstandardsbasedontestresults.

    Togaininsightintothepossibilityofimplementinga

    regionalproducttestingprogramanditscomplexity.

    Togatherarst-orderexaminationoflamp

    mercurycontent.

    Thisreportpresentsthemajorndingsofthislaboratory

    CFLbenchmarktestingprogram.Whilethecompleteraw

    testingdataisprovidedforalltestedvariables,theanalysis

    inthisreportfocusesonhowthefollowtestingresults

    forvekeymetricscomparetotheassociated

    requirementsforthreecompliancestandards(summarized

    inTable 1).AsianLightingCompact(ALC)Tiers1,2

    and3wereusedastheprimarycompliancestandardsfor

    comparisonofthetestedlampresults.17TheALC

    Tierswerechosen,rstandforemost,becausetheonly

    waythetestedlampscanbedirectlyandfairlycompared,

    isagainstonesetofstandards.Asnotedabove,thereisnocommonlyrecognizedregionalorinternational

    standardforCFLqualityandperformanceinAsiaatthe

    timeoftesting.18MostcountriesreferenceIECstandards

    specicallyIEC60969,butthiscanonlybeusedasa

    testingstandardforCFLs,notasperformanceor

    qualitystandard.19

    ThesecondreasonthattheALCTierswerechosenwas

    thatintheabsenceofsuchagreementasetofdeveloped

    metricstocharacterizeCFLqualityisneededasabasisin

    analyzingtheseCFLtestresults.ThemetricsincorporatedbytheALCTiersinclude:lightingcharacteristics(color

    renderingandcolorcorrelatedtemperature),andother

    performanceparameters(start-uptime,lifetime,and

    lumenmaintenance).Finally,itshouldbenotedthat

    ALCTier2hasbeenalignedwiththeEfcientLighting

    InitiativesVoluntaryTechnicalSpecicationforCFLs(ELI),

    andALCTier3hasbeenalignedwiththeUKEnergy

    SavingTrustLampSpecicationsforCFLs(EST). 20Thus

    pass/failreportinginthisreportforALCTier2andALC

    Tier3canbeappliedtoELIandUKEST6.1respectively.

    Table 1: Key Metrics and Compliance Standards Evaluated

    Key Metrics Tested and Compared to Standards Compliance Standards Used for Comparisons

    Efcacy ALC Tier 1

    Survival Rate ALC Tier 2 (ELI)

    Lumen Maintenance ALC Tier 3 (UKEST 6.1)

    Power actor ALC Tier 2

    Color Rendering Index (CRI) ALC Tier 2

    17.IncludedasAppendixA.

    18.ELI(theEfcientLightingInitiative)standardsarereferencedincertainprocurementefforts,butnotrecognizedbynationalgovernmentsotherthanAustralia.

    19.IEC60969Ed.1.3b:2009.Self-ballastedlampsforgenerallightingservices-Performancerequirements.

    20.ELIQualityCerticationInstitute,ELIVoluntaryTechnicalSpecicationforSelf-BallastedCompactFluorescentLamps2006-03-01,andtheUKEnergySavingTrust,EnergySavingTrust:LampSpecication,Version6.12009.

    OVERVIEW: THE CFL MARKET IN ASIA

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    16/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 9

    Box 2. The ALC Quality System

    The Asia Lighting Compact (ALC) is an independent, non-proft organization dedicated to reducing greenhouse gas

    emissions by improving the quality o lighting products and encouraging the adoption o energy-efcient lighting in

    Asia. Formed through a public-private initiative, the ALC works to reduce barriers to trade and mitigate climatechange by harmonizing quality and energy-efciency standards or lighting across the region.

    The ALC does not recreate lighting standards. Instead, the ALC is based on the international testing standards

    developed by the International Electrotechnical Commission (IEC). Based on the IEC test procedures or CFL

    perormance, the ALC has developed a three-tier quality system that is designed to work cooperatively with other

    lighting quality standard initiatives.

    Tier 3. The Best tier is currently based on the UK Energy Savings Trust 6.1 standard and will migrate to

    Europes EUP CFL standard once this standard is fnalized.

    Tier 2. The Better tier is based on and harmonized with the Efcient Lighting Initiative (ELI) standard or CFLs.

    Tier 1. The Good tier represents an initial realistic entry-level perormance standard or countries in the Asia

    region that provides quality, efciency and perormance.

    The three levels are necessary or the region because not all Asian consumers can aord the very highest quality

    CFLs, but they should be protected against poor-quality products. This ALC system is voluntary, transparent, publicly

    reviewed, consistent with the standards o International Electrotechnical Commission (IEC), and is based on the

    IECs saety and perormance test standards.

    Suppliers can qualiy the quality o their CFLs with the ALC using an online registration system. Registered CFLs

    will carry the markings o their qualiying levels, and will be listed in the ALC Quality Registry.

    OVERVIEW: THE CFL MARKET IN ASIA

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    17/53

    10 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    THE PERFORMANCE

    TEST PROCESST

    hissectiondescribesthedetailsofthebenchmark

    testprocessthatwasimplementedtoaddressthe

    qualityandharmonizationissuesdiscussedabove.

    ThisincludesadiscussionofhowtheCFLtestsample

    wasselectedandprocured,whereandhowthetests

    wereconducted,andwhatparametersweremeasured.

    Theresultsofthesetests,includingwhichsamplelamp

    parametersconformedtowhichstandards,willbe

    presentedintheTestResultssectionthatfollows.

    CFL SAMPLE

    Sampledesignandacquisitionareperhapsthemost

    inuentialdeterminantstotheeventualtestingresults.As

    such,averydetailedselectionandprocurementprocess

    wasdevelopedwiththegoalofacquiringsamplesthat

    werereectiveoftheoverallCFLmarketineachofthe

    followingcountries:

    Australia

    India

    IndonesiaPhilippines

    Thailand

    Vietnam

    ThetestplanhadoriginallyincludedChina,butdueto

    complicationsinacquiringarepresentativesample,China

    hadtobedroppedfromthestudy.21

    ECO-AsiaworkedwithDEWHAtodesignacollection

    methodologythattookintoaccounttheavailableCFL

    brandsandpricingineachofthemarket.Then,ECO-Asiaworkedwithpartnersandofcesineachofthetarget

    countriestoprocurethesamples.

    AustralianlampswerepurchasedbyDEWHAstaff,

    andlampsinIndia,Indonesia,Philippines,Thailandand

    VietnamwerepurchasedbyECO-Asiastaff.These

    sampleswerepurchasedthroughordinaryretail

    outletsinastandardizedselectionprocesstoacquirea

    representativemixofCFLmodels.

    Whileprocurementplansvariedslightlybetween

    countries,thesamplegenerallyconformedtothe

    following:

    Number of Models: 16uniquelampmodelswere

    sampledineachcountry,withtheexceptionofAustralia,

    whereamuchlargersampleof77modelswasacquired.

    These77modelsrepresentasignicantportionofthe

    Australianlampmarket.

    Types of Manufacturers:Themodelswerechosen

    toincludeabroadrangeofmanufacturers/distributors.

    Foreachofthesixcountries,modelswereassigned

    oneofthreemanufacturertypeidentierssothatsub-groupanalysiscouldbeperformedlater.These

    threemanufacturergroupstypeswere:

    High:Majorinternationalbrands

    Mid: Knownlocalorregionalbrands

    Low:Unknownorlow-costbrands

    Types of Models: Theselectedmodelswereallbare

    screw-basedCFLs.AnumberofcoveredandreectorlampsfromAustraliawerealsopurchasedandtested,

    buttheresultswerenotreportedhere,asthose

    categoriesrepresentamuchsmallerpercentageinthe

    restofAsia.

    21.Notethattheprocurementeffortwasdesignedtoobtainsamplesrepresentativeofproductsavailableonthemarketineachcountry.Marketshareinformationwasnotavailableinsufcientdetailforweightingofthetestresults.

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    18/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 11

    Lamp Wattages: Theprimarytargetforprocurement

    wastheCFLequivalentofthemostpopularincandescent

    lampthe60-Wattlamp.However,arangeofwattages

    wasselectedinordertobetterunderstandtheefcacy

    distributionofthelampsavailable.

    Quantities of CFLs per model: Generally1012

    samplesofeachCFLmodelwereacquired.Insomecases

    upto24sampleswereacquiredforthepurposes

    ofsending1012samplestoeachofthetwoperformance

    testinglaboratoriesforcross-laborator ycomparisons.

    Forarandomlyselectedsubsetofmodels,6to18

    additionalsampleswereprocuredforthepurposeof

    mercurycontenttestingatthreetestinglaboratories,

    whichrequiresaminimumof5workingsamplesforeach

    ofthetestlaboratory.22

    Purchase Location: Samplesofeachtested

    modelwerepurchasedinaminimumofthreeseparate

    geographiclocationstoensurethatsampleswouldbe

    randomlychosen.

    Location of Manufacture: Themajorityoflampswere

    madeinChina.Wheretherewerelocalmanufacturers,

    teamsmadeeveryefforttoincludeamixoflocaland

    importedproducts.23

    Thefollowinginformationwasrecordedforallselected

    samples:

    PurchaseRegion

    Brand

    ModelName

    Category(high/medium/low)

    RatedPower(W)

    RatedColorTemp

    RatedLife(hours)

    TubeorEnvelopeShape

    No.inEachPackagePurchased

    PackagePrice(Retail,convertedintoUS$

    attheexchangeratesatthetimeofpurchase).

    PriceperLamp(Retail,US$)

    Table 2summarizesthebreakdownofthenumberof

    modelsandquantityofCFLsusedfortesting.Overall,

    theresultsfrom137testedmodelsarereportedhere.24

    ItshouldbenotedthatthelampspurchasedinAustralia

    CFLdominatethesampleand,assuch,thetestresultsfor

    theaggregatesampleshouldnotbeexpectedtoprovide

    informationontheregionasawholewithoutreweighting

    thesample.

    TESTING PROCESS

    FourlaboratorieswereselectedtotesttheCFLsamples.Thelaboratorieswere:

    TheNationalLightingTestCenter(NLTC)inBeijing,

    China,whichconductedtestingonthemajorityofthe

    samplelampsfromAustraliaandASEANcountries

    forperformance,andalsoasubsetofthesamplemodels

    formercurycontent.

    ElectricalResearchandDevelopmentAssociation

    (ERDA)inBaroda,Gujarat,India,whichtestedthe

    lampsamplesfromIndiaandASEANcountriesforperformanceparametersonly.

    SpectroLaboratories,inNewDelhi,India,whichtested

    asubsetoftheAustralian,Indian,andASEANlamp

    samplesformercurycontent.

    AdvancedAnalyticalAustralia,NorthRydeNSW,

    Australia,whichalsotestedasubsetofthelamp

    samplesfromAustralia,India,andASEANcountries

    formercurycontent.

    22.Toaccountforbreakageandotherhandlingissuesthatmayoccurwhenlampsaretransportedtovariousinternationallaboratoriesfortesting,procurementteamswereaskedtoobtainatleast12samplesofeachmodelfromatleast3separategeographicallocationsforperformancetesting(ensuringaminimumsamplesetof10),and6samplesfromatleast3separategeographicallocationsformercurycontenttesting(ensuringaminimumsamplesetof5).Thusforamodelthatisbeingtestedforbothperformanceandmercurycontentatall4labs,amaximumof42sampleswereprocured.Overall,about2,600lampswereprocuredinsixcountriesoverafour-weekperiod.

    23.ExceptinthecaseofIndia,whereallthelampstestedwereofIndianmanufacture.

    24.Theactualnumberofuniquemodelstestedislikelyslightlylessthan137assimilarinternationalbrandmodelswerepurchasedinvariouscountries.Thesemodelsarebeingtreatedseparatelyinthisreporteventhoughtheymaybeidentical.Conversely,manymoresamplespermodelwererequiredforthisprocesssincetestingtookplaceinfourlaboratoriesinthreecountries.

    THE PERFORMANCE TEST PROCESS

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    19/53

    12 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    AllCFLsweresubjectedtothefollowingmeasurementsor

    evaluations25:

    After 100 hours of operation

    (Sample size = 10 lamps):

    lamppower(Watts)

    luminousux(lumens)

    powerfactor

    totalharmonicdistortion(THD)

    ColorRenderingIndex(CRI)

    XandYcoordinatesCorrelatedcolortemperature(CCT)

    SCDM

    start-uptime

    After 2,000 hours of operation

    (Sample size = remaining operational lamps):

    lamppower(Watts)

    luminousux(lumens)

    AsubsetoftheCFLsweresubjectedtothefollowing

    measurementsorevaluations:

    After verication of operation

    (Sample size = 5 lamps):mercurycontent

    Thetestmethodusedtomeasureperformancewasthe

    mostrecentversionofIECdrafttestmethodforintegrated

    CFLs(toreplaceIEC60969),titledIEC 60969 Committee

    Draft V04-21-6-07, withamendmentsasdiscussedatthe

    IECPRESCOmeetinginNovember2007(asoutlined

    indocument34A/1253/CC - Template for Comments

    and Secretariat Observations Dated 14/11/07 regarding

    34A/1235A/CD - IEC 60969 Ed.2).Thistestmethodis

    availablefromIEC(www.iec.ch).

    ForCFLsamplesthatfailedpriortoreaching2,000hours,

    theirtimeoffailurewasrecorded.Forthetestslisted

    above,onlylamppower,luminousux,powerfactor,CRI,

    andtimeoffailure(whenappropriate)wereutilizedforthe

    analysisdiscussedinthisreport.

    Thetestmethodusedtomeasuremercurycontentof

    thelampswasthemostrecentversionoftheAS/NZS

    4782.3-2006(int)Part 3: Double-capped uorescent lamps

    - Performance specications, Part 3: Procedure for quantitativeanalysis of mercur y present in uorescent lamps. This test

    method is available from Standards Australia (www.standards.

    com.au).Thisisadestructivetestmethod,andlamps

    wereconrmedtobeoperationalbeforethetestwas

    conducted.

    Table 2: Breakdown of CFL Sample forLaboratory Testing

    Country of Purchase # of Models Tested

    Australia 77

    India 16

    Indonesia 10

    Philippines 12

    Thailand 12

    Vietnam 10

    TOTAL 137

    25.TheIndianlaboratorydidnothavethecapabilitytomeasuresomecolor-relatedmetrics,thusCRIandSCDMwerenotrecordedforthe687CFLsmeasuredinthislab.

    THE PERFORMANCE TEST PROCESS

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    20/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 13

    TEST RESULTSPERFORMANCE

    Thissectionpresentstheperformanceresultsoflaboratory

    testingof137bareCFLsmodelsfromsixcountries.

    Presentedresultsfocusonthefollowingvekeymetrics:

    1. Efcacy

    2. Survival Rate

    3. Lumen Maintenance

    4. Power factor

    5. Color Rendering Index (CRI)

    Followingthediscussionofthenumericalresultsofthese

    vekeymetrics,wedetailhowtheseresultscompareto

    ALCTiers1,2and3.BecausethenumberofCFLsand

    CFLmodelsfromAustraliaaresignicantlylargerthan

    thesamplesfromtheothercountries,apresentationof

    theaggregatetestresultswouldbedisproportionately

    inuencedbytheAustralianlampresults.Forthisreason,

    wehavechosentodisaggregatetheAustraliandatafrom

    theremainingdatasothatthereadercanviewtheresults

    independentofthisweightingeffect,orintheaggregate

    withthisweightingeffecthighlighted.

    Asdiscussedearlier,duringsampleselection,theselected

    modelswerecategorizedbymanufacturertypeduring

    procurement.Forseveralofthemetrics,wehaveshown

    resultsdisaggregatedbymanufacturertypebasedonthe

    high,midandlowdenitionsoutlined.

    EFFICACY

    Theabilitytoefcientlyconvertpowertolightefcacy

    istheCFLssinglemostimportantattribute,andisoneof

    thefewparameterscoveredbyeveryCFLstandard.Figure 4showstheefcacy(lumens/Watt)vs.measured

    power(W)fromthetestedlampsamplesafterthe

    100-hourburn-inperiod.25 Figure 5presentsthesame

    efcacydataplottedasahistogramthatindicatesthe

    numberofmodelsthatfallintovariousefcacybins.

    Asexpected,theoveralldatasetshowsefcacytrending

    upwardslightlyforhigher-poweredCFLs.Morestrikingly,

    widevariationsinefcacycanbeseenbetweenmodels

    ofsimilarinputpower.Severalverypoorperforming

    low-wattageCFLsareseeninthesample,withefcacies

    below40lumens/Watt.

    Figure 6presentsthesameresultsasFigure2but

    identiesthemodelsbymanufacturertype.Generally

    speaking,highorinternationalbrandsyieldedthehighestefcacies,whilelowmanufacturersyieldedthelowest

    efcacies.Severalhighlyefcaciouslowmodelscanbe

    seen,however.Figure 7 showsthelampsefcacies

    versustheirpurchaseprice.

    TheefcacyrequirementsforALCTiers1,2and3vary

    dependingontheratedwattageandcolortemperatureof

    theCFL.Theserequirementsareincludedintheappendix

    ofthisreport.Forthe137modelstested,measured

    efcacy(presentedabove),alongwithratedwattage

    andcolortemperature,werecomparedtoALCTier1,2,and3todeterminepassorfailratesforeachmodel.

    Table 3andFigure 8presenttheresultsofthisanalysis.

    SURVIVAL RATE

    Lampsurvivalrecordsweremaintainedduringtesting

    andsurvivalrateswerecalculatedafter2,000hoursof

    operation.26Thesurvivalratesweredenedasthefraction

    ofthemodelsfunctioningsamplesat100hoursthatwere

    stillfunctionalat2,000hours.Thesurvivalratecanbea

    predictorofwhetherornotlampswilllastfortheduration

    oftheirclaimedlife.

    Figure 9 showsthesamplesurvivalratesforeachofthe

    137modelstested.TheAustralianmodelsaremodels

    1-78(leftofblackbar)andthenon-Australianmodelsare

    number79-137(rightofbar).

    25.Aburn-inperiodisspeciedbytestmethodologiesasthetypicaltimeneededforlampstoreachtheirstableoperationalstateneededforaccuratetesting.

    26.Duetotimingandresourceconstraints,itwasnotpossibletotestalllampmodelsforthefull6,000hours.

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    21/53

    14 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    Figure 4. Average Efcacy (lumens/Watt) of Test Models vs. Measured Power TakenAfter a 100-hour Burn-in Period.

    Figure 5. Average Efcacy (lumens/Watt) of Test Models by Efcacy Bins

    0.00 5.00 10.00 15.00 25.00 30.00 35.00 40.00

    measured power (W)

    20.00

    80.00

    70.00

    60.00

    50.00

    40.00

    30.00

    20.00

    10.00

    0.00

    Average Efcacy at 100 hours

    lumensperwatt

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    22/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 15

    Figure 6. Average Efcacy (lumens/Watt) by Brand Type27

    TEST RESULTS PERFORMANCE

    0.00 5.00 10.00 15.00 25.00 30.00 35.00 40.00

    Power (W)

    20.00

    80.00

    70.00

    60.00

    50.00

    40.00

    30.00

    20.00

    10.00

    0.00

    Efcacy by Brand Type

    lumensperwatt

    High

    Low

    Mid

    Figure 7. Lamp Efcacies and Costs

    $- $5.00 $10.00 $15.00 $25.00 $30.00

    CFL Model Cost

    $20.00

    80.00

    70.00

    60.00

    50.00

    40.00

    30.00

    20.00

    10.00

    0.00

    Efcacy vs CFL Cost

    lumensperwatt

    27.Foreachofthesixcountries,modelswereassignedoneofthreemanufacturerorbrandtypeidentierssothatsub-groupanalysiscouldbeperformed.Thesethreetypeswere:High:MajorinternationalbrandsMid:KnownlocalorregionalbrandsLow:Unknownorlow-costbrands

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    23/53

    16 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    Figure 8. Pass/Fail Rates for All 137 Models Tested vs. ALC Tier 1, 2, and 3 Efcacy Test

    Table 3: Efcacy Test Pass Rates for All 137 Models vs. ALC Tiers 1, 2, and 3

    Tier 1 Tier 2 Tier 3

    Aus 96.1% 72.7% 90.9%

    Non-Aus 86.7% 83.3% 85.0%

    All Models 92.0% 77.4% 88.3%

    TEST RESULTS PERFORMANCE

    Pass Rate - Efcacy Test

    Tier 1

    100.0%

    90.0%

    80.0%

    70.0%

    60.0%

    50.0%

    40.0%

    30.0%

    20.0%

    10.0%

    0.0%

    Tier 2 Tier 3

    Australia-purchased lamps

    Non Australia-purchased lamps

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    24/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 17

    Figure 9. Individual Survival Rates for Each of the 137 Models Tested

    Figure 10. Survival Rates for 137 Tested Models by Survival Rate Bins

    TEST RESULTS PERFORMANCE

    Survival Rate at 2000 hours

    Model ID Number

    100.00%90.00%

    80.00%

    70.00%

    60.00%

    50.00%

    40.00%

    30.00%

    20.00%

    10.00%

    0.00%1 6 11 16 21 26 31 36 41 46 51 56 61 66 71 76 81 86 91 96 10

    1106

    111

    116

    121

    126

    131

    136

    Aus non-Aus

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    25/53

    18 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    Figure 10showsthesamedatasetintheformofa

    histogram.AsFigures9and10show,whilethemajority

    ofmodelsexperiencedlittletonofailures,severalmodels

    experiencedsignicantfailures.Infact,11models(8%of

    thosetested)producedjustover50%ofthefailuresduringtesting.Eighty-eightmodels(64%)experiencednosample

    failuresduringthe2,000-hourtestperiod.Overall,the31%

    oftheAustralianlampsmodelexperiencedsamplefailures,

    and42%thenon-Australianlampmodelsexperienced

    samplefailures.

    Figure 11presentsthesamesurvivalratedataasa

    functionofbrandtypeandpower.Asmightbeexpected,

    low-pricedbrandswereresponsibleformostoftheodels

    withpoorsurvivalrates,butsomemidandhighmanufac-

    turersalsoproducedmodelsthathadsurvivalratesof60%orlower.

    Figure12presentsthelampsurvivalratesasafunctionof

    theirpurchaseprice.

    Figure 13 presentssurvivalratescomparedwithALC

    requirements.

    ALCTiers1and2requireasurvivalrateof90%orhigher

    after1,000hours,whileTier3requiresasurvivalrateof

    90%orhigherafter30%ofratedlife.ForTiers1and2,

    survivalratesat1,000hourswerecalculatedandcompared

    tothe90%survivaltest.InordertocomparetestresultstoTier3requirements,survivalratesat3,000hoursorlonger

    (asTier3requiresaratedlifeofatleast10,000hours)

    wouldneedtobeknown.

    Testingwasonlyconducteduntil2,000hours,however,so

    fortheTier3survivaltest,a2,000-hoursurvivalratherthan

    3,000hourswasused.Therefore,ifamodelhasa90%or

    greatersurvivalrateat2,000hours,itwasconsideredto

    havepassedtheTier3survivaltest.

    TheeffectofthisapproximationisthatmoreofthetestedmodelswillbegivenapassratingforTier3survival

    thantheylikelywouldhavehadtestingcontinuedto3,000

    hoursorbeyond(asweareeffectivelyassumingzero

    failureswilloccurinthehoursbetweenthe2,000-3,000

    hourtimeperiod).

    Figure 11. Survival Rates and Brand Type 28

    TEST RESULTS PERFORMANCE

    0.00 10.00 30.00 40.00

    Power (W)

    20.00

    120.00%

    100.00%

    80.00%

    60.00%

    40.00%

    20.00%

    0.00%

    2000-hour Survival Rate by Brand Type

    SurvivalRate High

    Low

    Mid

    28.Seefootnote27.

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    26/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 19

    Figure 12. Lamp Survival Rates and Purchase Price

    Figure 13. Survival Test Pass Rates vs. ALC Tier 1, 2, and 3

    TEST RESULTS PERFORMANCE

    Survival_1000 Survival_2000

    $ $5.00 $10.00 $15.00 $20.00 $25.00 $30.00

    100.00%90.00%

    80.00%

    70.00%

    60.00%

    50.00%

    40.00%

    30.00%

    20.00%

    10.00%

    0.00%

    Survival Rate after 1000 hrs and 2000 hrs vs CFL Cost

    CFL Model Cost

    %ofSamplesSurviving

    Pass Rate - Survival Test

    Tier 1

    100.0%

    90.0%

    80.0%

    70.0%

    60.0%

    50.0%

    40.0%

    30.0%

    20.0%10.0%

    0.0%

    Tier 2 Tier 3

    Australia-purchased lamps

    Non Australia-purchased lamps

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    27/53

    20 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    LUMEN MAINTENANCE

    Anotherimportantperformancemetricthatwasevaluated

    waslumenmaintenance(orlumendepreciation)whether

    ornotlampscanmaintainacertainleveloflightoutput

    overtheiroperationallifetime.Lumenmaintenanceat

    2,000hourswascalculatedbycomparingamodelsaverage100-hourlumenoutput(initiallumenmeasurements)from

    theinitialsampleset,tothatmodelsaverage2,000-hour

    lumenoutputfromtheremainingsamples.

    Figure 14showsthelumenmaintenancevaluesforall137

    modelstested.Figure 15 showsthesamedatasetasa

    histogram.125ofthe137modelsexperiencedalumen

    depreciationofatleast10%(i.e.,lumenmaintenance

    droppingbelow90%).23models,oraboutone-sixth

    ofthetestedmodels,hadlumendepreciationof

    morethan20%.29Ninemodelsexperiencedalumen

    depreciationofatleast25%(lumenmaintenancebelow75%).Figure 16 presentslumenmaintenanceasa

    functionofpowerandbrandtype.Onceagain,thelow

    brandspredictablymakeupthebulkofthepoorest

    performingmodelswhenlookingatlumenmaintenance.

    Infact,Figure14showsstrikingsimilaritiestotheefcacy

    versusbrandtypecomparisonshowninFigure4.

    Figure 14. Lumen Depreciation of Models after 2,000 Hours of Operation

    Table 4: Survival Test Pass Rate for All 137 Models vs. ALC Tier 1, 2, and 3

    Tier 1 Tier 2 Tier 3

    Aus 93.5% 93.5% 88.3%

    Non-Aus 85.0% 85.0% 71.7%

    All Models 89.8% 89.8% 81.0%

    29.20%isthemaximumallowedbyALCTiers1&2.

    TEST RESULTS PERFORMANCE

    0 10 20 40 6030 50 70 80

    100.00%

    90.00%

    80.00%

    70.00%

    60.00%

    50.00%

    40.00%

    30.00%

    20.00%

    10.00%

    0.00%

    Lumen Depreciation at 2000 hours

    %Lumenat2000-hours

    Power (W)

    Australia-purchased lamps Non Australia-purchased lamps

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    28/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 21

    ALCTiers1and2requirethatlumenmaintenanceremain

    at80%oraboveafter2,000hourswhileTier3requires

    lumenmaintenanceof88.1%oraboveafter2,000hours.

    Tier3alsospecieslumenmaintenancerequirementsat6,000hours(78.1%)andat10,000hours(75.1%).

    Becausetestingdidnotcontinuelongenoughtoapply

    the6,000-hourand10,000-hourtests,modelswere

    consideredtohavepassedtheTier3lumenmaintenance

    testiftheysimplypassedTier3s2,000-hourrequirement.

    Table 5andFigure 17 presentthelumenmaintenance

    testpassratesforthe137testedmodelsvs.ALCTiers1,2,and3.Only30ofthe137modelspassedtheTier3

    lumenmaintenancetest.30

    Figure15.Lumen Depreciation Bins of Models After 2,000 Hours of Operation

    Table 5: Lumen Maintenance Test Pass Rate for ALC Tiers 1, 2 and 3

    Tier 1 Tier 2 Tier 3

    Aus 85.7% 85.7% 22.1%

    Non-Aus 78.3% 78.3% 21.7%

    All Models 82.5% 82.5% 21.9%

    30.ItshouldbenotedthatnoneofthetestedmodelsclaimedtobeESTcertied,thereforethetestresultsshouldbeviewedasanindicatorofcurrentmarketperformanceonly.

    TEST RESULTS PERFORMANCE

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    29/53

    22 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    POWER FACTOR

    Powerfactorwasmeasuredforallmodelstested.

    Figure 18 presentstheaveragepowerfactorresultsfor

    eachmodelafter100hoursoftesting.31 Figure 19

    showsthesamedataasahistogram.135ofthemodels

    looktohavenormalorlowpowerfactorswhileonlytwomodelscanbeconsideredhighpowerfactorCFLs.

    ALCTiers1and2requirepowerfactorsof0.5or

    greater,whileTier3requires0.55orgreater.Table 6

    andFigure 20 presentthepowerfactortestpassrates

    ofthetestedmodels.

    COLOR RENDERING INDEX (CRI)

    ColorRenderingIndex(CRI)wasrecordedfor91ofthe

    137modelstestedCRIisaquantitativemeasureofthe

    abilityofalightsourcetoreproducethecolorsofvariousobjectsfaithfullyincomparisonwithanidealornatural

    lightsource,andcanbeanapproximationofperceived

    lightquality.LightsourceswithahighCRIaredesirable

    incolor-criticalapplicationssuchasphotographyand

    cinematography.TheIndiantestlaboratory(ERDA)didnot

    havethecapabilitiestomeasureCRI,sotheseresultsare

    notavailableforthe46modelsthatweretestedexclusively

    inIndia.32ThemodelsthatdidnotreceiveCRItesting

    weredisproportionatelynon-Australianmodelsasmore

    ofthesemodelsweretestedinIndia.

    Figure 21showstheCRIresultsforthe91modelstested,

    whileFigure 22presentsthesamedatasetasahistogram.

    Theresultsrangefrom73to86withthemajorityof

    modelshavingaCRIof81orhigher.ACRIof80is

    generallyconsideredverygood,andistheminimumlevel

    requiredbytheALCTiers.

    Figure 23 showsCRItestresultsvs.manufacturertype.

    Theperformancedistinctionbetweenhigh,midandlow

    manufacturertypeislessdistinctforCRIthanthatwhichwasshownforefcacy,lumendepreciation,andsurvival.

    Itisdifculttoreadtoomuchintothisresult,however,as

    thesampleoflampstestedforCRIwaslimited,particularly

    fornon-Australianlamps.

    31.Itshouldalsobenotedthatnoneofthelampstestedclaimedtohavehighpowerfactor(HPF),sotheresultshereshouldbeviewedasanindicationoftheoverallpowerfactoroflampsavailableonthemarket.

    32.Infact,theIndianNationalPhysicalLaboratory(NPL)conrmsthatCRIisnottypicallymeasuredinIndia,andisnotarequirementoftheBureauofIndianStandardsCFLstandards.

    Figure16.Lumen Maintenance by Brand Type

    TEST RESULTS PERFORMANCE

    Power (W)

    0.00 10.00 20.00 30.00 40.00

    100.00%

    90.00%

    80.00%

    70.00%

    60.00%

    50.00%

    40.00%

    2000-hour Lumen Maintenance by Brand Type

    lumenmaintenance

    High

    Low

    Mid

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    30/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 23

    Figure17.Lumen Maintenance Test Pass Rate for ALC Tiers 1, 2 and 3

    Figure18. Average Power Factor Results for All 137 Models Tested

    TEST RESULTS PERFORMANCE

    0 10 20 40 6030 50 70 80

    100.00%

    90.00%

    80.00%

    70.00%

    60.00%

    50.00%

    40.00%

    30.00%

    20.00%

    10.00%

    0.00%

    Power Factor

    Model ID Number

    Averagepowerfactorofmodel

    Pass Rate - Lumen Maintenance Test

    Tier 1

    100.0%

    90.0%

    80.0%

    70.0%

    60.0%

    50.0%

    40.0%

    30.0%

    20.0%

    10.0%0.0%

    Tier 2 Tier 3

    Australia-purchased lamps

    Non Australia-purchased lamps

    Australia-purchased lamps Non Australia-purchased lamps

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    31/53

    24 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    Figure19.Power Factor of Models Separated in Bins

    Table 6: Power Factor Test Pass Rate for ALC Tiers 1, 2 and 3

    Tier 1 Tier 2 Tier 3

    Australia-purchased lamps 94.8% 94.8% 70.1%

    Non Australia-purchased lamps 100.0% 100.0% 78.3%

    All Models 97.1% 97.1% 73.7%

    TEST RESULTS PERFORMANCE

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    32/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 25

    Figure 21. Color Rendering Index (CRI) for 91 Tested Models (46 Models Were not Tested)

    Figure 20. Power Factor Test Pass Rate for ALC Tiers 1, 2 and 3

    TEST RESULTS PERFORMANCE

    Model ID Number

    0 10 5020 6030 7040 80

    88.00

    86.00

    84.00

    82.00

    80.00

    78.00

    76.00

    74.00

    72.00

    Color Rendering Index (CRI)

    CRI

    Pass Rate - Power Factor Test

    Tier 1

    100.0%

    90.0%

    80.0%

    70.0%

    60.0%

    50.0%

    40.0%

    30.0%

    20.0%

    10.0%0.0%

    Tier 2 Tier 3

    Australia-purchased lamps

    Non Australia-purchased lamps

    Australia-purchased

    lamps

    Non Australia-purchased

    lamps

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    33/53

    26 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    ALCTiers1,2,and3requireCRIvaluesof80orhigher.

    Table 7andFigure 24presenttheCRItestpassrates

    forjustthe91modelsforwhichCRIwasmeasured.

    AlargediscrepancyisseenbetweenCRIpassratesfromtheAustralianmodelsandthosefromnon-Australian

    models.Itisunknownifthisisarealeffectthatwould

    havebeendocumentedhadCRItestingofall

    non-Australianmodelsbeenperformed,orifthisisa

    statisticalanomalyduetotherelativelysmallsampleof

    non-AustralianmodelstestedforCRI(only15ofthe

    46non-Australianmodelsweretested).

    ALL METRICS

    Itispossibletoproduceanestimatedpassrateforall

    137modelstestedbysortingthemintomodelsthat

    passedallvetestsabovefromthosewhichfailedoneormoreofthetests.Therearelimitationstothis

    estimate,however,basedondeviationsbetweenthe

    ALCrequirementsandthetestsperformed.Theprimary

    limitationstobenotedinclude:

    1. Pass rates only based on 5 requirements:

    Onlythevetestsdiscussedhereareusedtogenerate

    Figure 22. CRI Test results Separated Into Bins

    Table 7: CRI Test Pass Rate for ALC Tiers 1, 2 and 3

    Tier 1 Tier 2 Tier 3

    Australia-purchased lamps 87.0% 87.0% 87.0%

    Non Australia-purchased lamps 53.3% 53.3% 53.3%

    All Models 81.5% 81.5% 81.5%

    TEST RESULTS PERFORMANCE

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    34/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 27

    thispassrate.ALCsCFLQualityGuidelineshasmany

    otherrequirements(suchasmaximumrun-uptime,

    maximummercurycontent,switchingcycletestsurvival,

    safetyandlabelingrequirements,etc.).Thus,itispossible

    thataCFLmodelcouldpassthe5testsdiscussedhere,butstillnotconformtotheALCGuidelinesbecauseof

    otherrequirements.

    2. Limitations related to CRI testing: Whileall

    137modelsweretestedagainstfourofthemetrics,

    only91weretestedagainstCRI.Forthe91models

    thatweretestedtoallvemetrics,theywererequired

    topassallverequirementsforthevarioustiersto

    beconsideredtohavepassedallmetrics.Butforthe

    46modelsthatwerenottestedforCRI,wewere

    forcedtoassumea100%passratefortheCRItestwhencalculatingtheirpassesallmetricstest.Ofthe

    46modelsthatweregiventhisfreepassonCRI,31

    hadpassedalltheotherTier1tests,30passedTier2

    testsand3passedTier3tests.ThusforTiers1and2,

    approximatelytwothirdsofthemodels

    thatdidnotgettestedforCRIwouldhavehadtheirall

    metricspass/failtestridingontheresultoftheCRItest.

    TheeffectofthemissingCRItestonTier3islimited,

    however,asmostmodelshadalreadyfailedatleastone

    otherofthetestcriteria.

    3. Tier 3 Survival Rate: Thesurvivalratetestwas

    appliedat2,000hoursratherthan3,000+hours.

    4. Tier 3 Lumen Depreciation Rate: Thelumen

    depreciationtestspeciedat2,000hourswasapplied,but

    testrequiredat6,000hoursand10,000hourswerenot.

    Allofthelimitationslistedabovecouldresultinan

    overestimationofthepassratesforthe137modelstested.

    Forthatreason,thepassrateslistedbelowshouldbeconsideredasaceilingratherthanadenitiveestimateon

    compliancerates.

    Table 8andFigure 25 presentthepassratesagainstall

    testedmetrics,subjecttothelimitationslistedabove.

    TEST RESULTS PERFORMANCE

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    35/53

    28 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    Figure 23. CRI Test Results by Brand Type 34

    Table 8: Pass Rate for all Tested Metrics33

    Tier 1 Tier 2 Tier 3

    Australia-purchased lamps 67.5% 53.2% 16.9%

    Non Australia-purchased lamps 65.0% 63.3% 10.0%

    All Models 66.4% 57.7% 13.9%

    33.ItisimportanttonotethatnoneofthelampstestedclaimedtobeESTcertied,sothatthepassingrateforTier3shouldonlybeviewedasthecur-rentstateofthelampsavailableonthemarketonly.

    34.Seefootnote27.

    TEST RESULTS PERFORMANCE

    Model ID Number

    Color Rendering Index (CRI)

    0 5 2510 3015 3520 40

    88.00

    86.00

    84.00

    82.00

    80.00

    78.00

    76.00

    74.00

    72.00

    CRI

    High

    Low

    Mid

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    36/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 29

    TEST RESULTS PERFORMANCE

    Figure 24. CRI test pass rate for ALC Tiers 1, 2 and 3

    Pass Rate - CRI Test

    Tier 1

    100.0%

    90.0%

    80.0%

    70.0%

    60.0%

    50.0%

    40.0%

    30.0%

    20.0%

    10.0%0.0%

    Tier 2 Tier 3

    Australia-purchased lamps

    Non Australia-purchased lamps

    Figure 25. Pass Rate for All Tested Methods

    Pass Rate - All Metrics

    Tier 1

    80.0%

    70.0%

    60.0%

    50.0%

    40.0%

    30.0%

    20.0%

    10.0%

    0.0%

    Tier 2 Tier 3

    Australia-purchased lamps

    Non Australia-purchased lamps

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    37/53

    30 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    TEST RESULTS

    LAMP MERCURY CONTENTA

    subsetofthelampmodelswastestedfortheir

    mercurycontent.Atotalof43randomlyselected

    modelsfromallthreeselectioncategories(high/

    medium/low)fromthesixcountriesweretestedusing

    oneoftheavailablemethodsfortestingmercurycontent

    ofuorescentlampsAS/NZS 4782.3-2006 (int) Part 3:

    Double-capped uorescent lampsPerformance specications,

    Part 3: Procedure for quantitative analysis of mercury present in

    uorescent lamps. Theresultsarepresentedbelow.

    Ascanbeseenfromthetestresultspresentedin Figure

    26,althoughtheaveragerangeofthetestedmodels

    centersaround6.5mgto7.5mgdependingonthe

    purchaselocation(ALCTiersrequirelampstohaveless

    than5mgofmercury),therangeofthelampmercury

    contentcanbequitebroad(notethatthechartiscapped

    at20mg).Itcanbeseenthatlampswithhigheraverage

    mercurycontentarepresentinallmarkets:therighthalfor

    thehighmercurycontentsideofthechartcontainslamps

    fromall6countriestested.

    Further,ascanbeseeninFigure 27,whenthemercury

    contentlampsareconsideredagainstthelampcosts,some

    ofthelowerpricedlampsalsohavemuchhigher

    mercurycontentrelativetolampswithhighercostsor

    frommorewell-knownmanufacturers.Thiscouldbe

    duetothefactthatmorewell-knownandinternational

    manufacturershaveinvestedinmoreadvanced

    manufacturingequipmentthatcanbettercontrol

    mercurydosing,and/oruseamalgammercuryratherthan

    liquidmercuryintheirlamps.

    Itshouldbenotedthattheresultspresentedhereshould

    betreatedasapreliminaryinvestigativeresultsonly,andnotadenitivecharacterizationofmercurycontentin

    CFLinAsia.Thisisdueto:

    1. Sample Size: Alimitedsamplesize:notalllamps

    modelsweretestedformercurycontent

    2. Test Method: Thetestmethodologywaschosenfor

    itssimplerprocessandrepeatabilityoveritsabilityto

    produceexactresults.35

    3. Commonly Accepted Methodology:Therewereon-goingdiscussionstakingplacebyIECtoselecta

    commonlyacceptedmethodduringthetestingprocess.

    35.Infact,theabilitiesofmercurytestmethodologiestoyieldexactresultsarestillunderdiscussionasoflate2009.

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    38/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 31

    TEST RESULTS LAMP MERCURY CONTENT

    Figure 27. Mercury Content of Versus Lamp Cost

    Figure 26. Mercury Content of Selected CFL Models (note: Chart Capped at 20 mg)

    Mercury Content for Selected CFL Models(minimum, maximum and average shown)

    20

    17.5

    15

    12.5

    10

    7.5

    5

    2.5

    0

    Mercury(Hg)

    AUST-B

    A

    AUST-A

    P

    AUST-V

    AUST-A

    R

    AUST-W

    AUST-A

    S

    AUST-A

    X

    THAI-P1

    AUST-D

    V

    AUST-D

    W

    AUST-D

    X

    INDI-B2

    AUST-D

    U

    THAI-B2

    THAI-P3

    AUST-C

    1

    INDI-P5

    AUST-C

    E

    INDI-B6

    INDO-P

    6

    AUST-B

    1

    PHIL-P

    4

    VIET-P1

    INDI-P1

    AUST-A

    T

    AUST-S

    AUST-C

    S

    INDI-P6

    INDO-B

    2

    AUST-A

    V

    INDO-P

    4

    AUST-C

    L

    INDO-P

    1

    PHIL-P

    3

    AUST-T

    AUST-D

    S

    PHIL-P

    1

    VIET-B2

    PHIL-B

    2

    THAI-P4

    INDO-P

    3

    VIET-P3

    AUST-D

    T

    $- $5.00 $10.00 S15.00 $20.00 $25.00

    12

    10

    8

    6

    4

    2

    0

    Average Mercury Content vs CFL Cost

    Mercury(Hg)

    Retail Price (single CFL)

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    39/53

    32 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    CONCLUSIONS

    AND RECOMMENDATIONSA

    necdotalevidencehaslongsuggestedthatthere

    aresignicantqualityissueswithCFLsinAsian

    markets.Priorreportshaveestimatedthat

    asmuchashalfoftheCFLsinsomeAsianmarketsare

    shoddy.36Theresultspresentedinthisreport,although

    representingonlyasnapshotofthesedynamicmarkets,

    aretherstharddatatobackupthisanecdotalevidence

    andestimatesfromearlierreports.

    Thefollowingaresomeofthemainconclusionsthatcanbedrawnfromtheresultsofthistestingeffort:

    Laboratoryevaluationofarepresentativesampleof

    CFLsfromveAsiancountriesandAustraliafoundthat

    atleastone-thirdofthesamplefailedtomeetwhatmay

    beconsideredasminimumperformancestandards

    (orthecriteriaforwhatmaybeconsideredaquality

    lamp)fortheregion.

    Theoverallfailure37rateaswellasthefailureratefor

    eachofthetieredcomparison,arelikelytobesignicantlyhigher.Thisisdueto:a)limitationsinthelaboratory

    testing,andb)thefactthatitwaspossibletoevaluate

    onlyasubsetofallrequiredmetricsforeachTier.

    Atleast90%oftestedproductsdonotmeetthe

    requirementsofthetiercomparisons,orEuropean

    equivalentstandards,suggestingthatCFLsproduced

    forandmarketedtoAsianandAustralianmarketsare

    manufacturedtolowerstandardsthatthoseofWestern

    markets.38

    Thegeneralizationofyougetwhatyoupayforwas

    largelyaccuratebasedonthetestresults,withname-

    brandmodelsperformingbetterthanlow-priced

    modelsinmostcasesagainstmostmetrics.

    ItshouldbenotedthatECO-Asiahasreleasedtwo

    earlierreportscoveringtheAsiaCFLmarketwitha

    numberofpolicyrecommendationsfortheregion.Those

    policyrecommendationsremainvalidinthecontext

    ofimprovingoverallproductquality,internationalandregionalcooperation,aswellasgreenhousegasemissions

    reduction.Itisalsoimportanttoreiteratethetwo

    reportsassertionthatsub-standardCFLsareasignicant

    policyproblemthatrequiresimmediate,coordinated

    regionalactions.39

    WiththeformationoftheAsiaLightingCompactand

    thereleaseoftheALCsCFLQualityGuidelines,which

    presentacomprehensivesetofCFLqualitystandards

    developedandbaseduponinternationallyaccepted

    standardsbyregionalstakeholders,thereisnowasetofqualitystandardsthatcouldberecognizedandapplied

    acrosstheregion.TheALCalongwithotheractorsin

    Asiacanandneedtoworktogetherinordertoscaleup

    thediscussionsofCFLpromotiontotheinternational

    level,andtoforgeanagreementoncommonsolutions,

    beforeacombinationofpolicymisstepsandconsumer

    backlashlimitthepotentialexpansionoftheregional

    andglobalCFLmarket.

    36.Condence in Quality: Harmonization of CFLs to Help Asia Address Climate Change. USAIDAsia.October2007.

    37.Failureasusedinthiscontext,indicatesthattheaverageofresultsfromthetestedsamplesofaparticularCFLmodeldoesnotmeetadenedperformancelevel(i.e.,forefcacy,powerfactororCRI),ratherthanaphysicalormechanicalfailurethatrendersthelampinoperative.Thisappliestoallparametersevaluatedexceptforthesurvivabilitytestresults,whichindicateactuallampfailures.

    38.NotethatnoneofthelampstestedclaimedcerticationforEuropeanstandards.

    39.FromPhasing in Quality: High-levelpolicymakersmustrecognizethatwhileCFLsrepresentaviableandcosteffectivetoolforclimatechangemitigation,theprevalenceoflow-quality(i.e.sub-standard,orshoddy)CFLsinthemarketrepresentsasignicantbarriertothefullrealizationofthisstrategyforthewholeregion.

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    40/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 33

    Thendingsofthisstudysuggestthatanumberofregional

    measuresspecictoCFLtestingandmarketmonitoring,as

    outlinedbelow,needtobebroadlyconsidered.

    Aregionalagreementonacommontestprocedure,adata-sharingplan,andwaystomutuallyrecognize

    testresultsacrossnationsisneededamongstandards

    andenforcementagencies.Thereisapressingneed

    forauniform,recurring,regional,ifnotinternational,

    processtotestandassurethequalityofCFLssoldin

    theregion.Suchregulareffortscanservebothtoinform

    policymakersonthestateofthemarket,andalsoto

    insuretheintegrityoflabelingprograms.

    Governmentagencies,theprivatesector(including

    manufacturersandretailersofCFLs),andnon-governmentalorganizations(NGOs)intheregion

    shouldtakeconcreteactionstoincreaseuserawareness

    ofhigh-qualityCFLproductsandwaystoidentifythem,

    aswellassupportindependentactionssuchastheALC

    toensurethatqualityproductsareavailableforallAsia.

    Anumberofcountriesintheregionneedtechnical

    assistanceinsettinguptheinfrastructure(testing

    facility,developmentofstandards,trainingoflaboratory

    personnel,etc.)tocertifytheperformanceof

    CFLs,aswellasinrecyclingCFLsanddealingwithend-of-lifeissues,includingmercurycontentand

    safelampdisposal.

    Moretestingisrecommendedtocorroboratethese

    initialndings.Thiswouldbeparticularlyusefulfor

    CFLmodelsintendedfortheverylargeandquickly

    growingChinesemarket.

    Theissueofmercurycontentanddosingcontrolin

    theproductionofCFLsmeritasecond,focusedround

    oftestingeffortsthatcancovermoreoftheregional

    markets,andmayalsohelptoinformmercuryrecycling

    andeducationalprograms.

    Thevalueofarobust,harmonizedsetofquality

    standardscannotbeunderstated.Withsucha

    mechanism,well-performingproductscouldbe

    identiedindependently,allowingpurchaserstoselect

    productsbasedonvalue(price)whilebeingassuredofatleastaminimumlevelofperformance

    AlthoughCFLshavebeenshowntobeoneofthe

    mostsignicantandcost-effectivemeasuresthatcan

    bedeployedtoachievereductionofgreenhousegas

    emissions,thiscalculationcanbedramaticallyaltered

    bypoor-qualityproducts.Aregional,coordinated

    testinganddata-sharingprogramamongstandardsand

    enforcementagenciescanformasignicantbarrierto

    preventlower-qualityproductsenteringtheAsianmarket.

    CONCLUSIONS AND RECOMMENDATIONS

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    41/53

    34 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    APPENDIX

    Asia Lighting CouncilCompact Fluorescent Lamp Quality

    Guidelines for Bare Lamps

    Version 1.1

    May 2009

    1.0 GENERAL INFORMATION

    1.1 Purpose

    TheAsiaLightingCouncil(ALC)seekstopromotequalitycompactuorescentlamps(CFLsorCFLIs)in

    ordertoincreasetheprotectionofconsumersfrom

    exposuretosub-standardproducts,toincreaseprotection

    ofmanufacturersfromunfaircompetition,todeliver

    theimprovementsinenergyperformanceplannedby

    mandatoryorvoluntaryschemes,andtoreduceemissions

    ofgreenhousegasesthroughreductioninelectricity

    consumption.

    TheALCaimstostimulatetheuptakeofhighqualityCFLs

    bypromotingasetofcommonqualitycriteriaandsettingperformancelevelsforqualiedCFLsforsaleintheAsia

    region,andpromotetheadoptionoftheseguidelines

    bystakeholders.FulldetailsoftheoverallAsiaLighting

    CouncilsfoundingprinciplestheManilaCompactcan

    befoundatwww.cleanenergyasia.net.

    Thisdocumentdenesthetechnicalrequirementsthatare

    requiredforaCFLinordertoqualifyfortheALCProduct

    Marking.ProtocolsontheOngoingMonitoringofproducts,

    ApplicationProceduresandprocessesareavailable

    separately.Failureofanyproducttomeetanyoralloftherequirementssetoutinthisprotocolwillresultinthat

    productnotbeingqualiedtobeartheALCproductmark.

    TheuseofALCsproductmarkwithoutqualicationsmay

    resultinALCactionsagainsttheproductmanufacturer.

    1.2 Scope

    Version1.0oftheseguidelinesbelow,coversthe

    requirementsforbareCFLswithintegralelectronic

    ballasts(CFLi)only.CFLswhichhavetranslucentor

    reectorenvelopesoverthebareuorescenttubearenot

    covered.Aproductmustmeetalloftheguidelinesquality

    performancecriteriaforitsproducttierinordertoqualify.

    1.3 Reference Standards

    ALCqualiedCFLsshallcomplywiththerelevantclauses

    ofthefollowingstandards:

    AS/NZS4782.3-2006(int)Part3:Double-capped

    uorescentlamps-Performancespecications,Part3:

    Procedureforquantitativeanalysisofmercurypresent

    inuorescentlamps.(Notes:1.Thisstandardshallbe

    supersededbytheIECreferencestandardoncetheIEC

    standardisavailable;2.JEL303-2004,referencedbelow,

    canbeusedasanalternativemethodfordetermining

    mercurycontentoflamps).

    CISPR15Ed7.1(2007),Amendment2(2008)-Limits

    andmethodsofmeasurementofradiodisturbance

    characteristicsofelectricallightingandsimilarequipment.

    EnergySavingTrust:LampSpecication,Version6.1

    2009.

    IEC60968Ed.1.2b:1999.Self-ballastedlampsforgeneral

    lightingservices-Safetyrequirements.

    IEC60969Ed.1.3b:2009.Self-ballastedlampsforgeneral

    lightingservices-Performancerequirements.

    IEC61000-3-2Ed.3.0(2005),Amendment1(2008)-

    Electromagneticcompatibility(EMC)-Part3-2:Limits

    -Limitsforharmoniccurrentemissions(equipmentinput

    current16Aperphase).

    IEC61547Ed.1.0b:1995.Equipmentforgenerallighting

    purposes-EMCimmunityrequirements.

    JEL303-2004,StandardofJapanElectricLamp

    ManufacturersAssociation.Practicalquantitativeanalysis

    procedureformercurycontaininginuorescentlamps.

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    42/53

    TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA 35

    APPENDIX

    (Notes:1.ThisstandardshallbesupersededbytheIECreference

    standardoncetheIECstandardisavailable;2.AS/NZS4782.3-2006

    (int.)Part3,referencedabove,canbeusedasanalternativemethod

    fordeterminingmercurycontentoflamps).

    2.0 TECHNICAL REQUIREMENTS

    2.1 Testing Requirements

    TheperformanceofCFLstobequaliedundertheALC

    processshouldbetestedusingthestandardsreferencedin

    Section1.3.

    ThesafetyofCFLstobequaliedundertheALCprocess

    shouldbetestedusingthestandardsreferencedinSection

    1.3.

    TheEMCofCFLstobequaliedundertheALCprocessshouldbetestedusingthestandardsreferencedinSection

    1.3,asapplicable.

    2.2 Quality Performance Criteria

    Criteria Asia Lighting Council Guidelines Criteria Requirements

    Tier 1 Tier 2 (ELI- Equivalent*) Tier 3 (EST 6.1 - 2009**)

    Efcacy (lumens per Watt)Attachment A, Figure 1 or

    Class 1 lamps

    Wattage bins/CCT 4500K >4500K 4500K >4500K 4500K >4500K

    < 5W 40 36 45 42 4W=32 4W=26

    5W to < 9W 44 40 50 46 8W=43 8W=39

    9W to < 16W 48 44 55 52 15W=53 15W=48

    16W to < 25W 55 51 60 57 24W=60 24W=54

    25W 60 57 65 62 35W=65 35W=59

    Lietime 6,000hours 8,000hours 10,000hours

    Lumen maintenance80%ofmeasured100-hour

    lumenlevelafter2,000hrs

    80%ofmeasured100-hour

    lumenlevelafter2,000hrs

    88.1%@2,000hrs

    78.1%@6,000hrs

    75.1%@10,000hrs

    Colour (x,y)Within7colorsteps(SDCM)

    pertheIECstandard

    Within5colorsteps(SDCM)

    pertheIECstandard

    IEC60081GraphD-16forCCT

    of2700K

    Table 2.3.1. Criteria with levels that vary with tier

    *ELIVoluntaryTechnicalSpecicationforSelf-BallastedCompactFluorescentLamps2006-03-01.

    **EnergySavingTrustLampSpecication6.120

  • 7/31/2019 USAID/Asia, Testing for Quality, Benchmarking Energy Saving Lamps, 4-2010

    43/53

    36 TESTING FOR QUALITY: BENCHMARKING ENERGY-SAVING LAMPS IN ASIA

    APPENDIX

    Criteria Asia Lighting Council Guidelines Criteria Requirements

    Tier 1 Tier 2 Tier 3 (EST 6.1 - 2009**)

    Start-up time 1.5secondsmaximum 2.0secondsmaximum

    Premature ailure Notmorethan10%failurewithin1,000hours Maximum10%failureat30%ofratedlife

    Run-up timeUpto3minutestoreach80%oflightoutput(should

    bealignedwithchangesinIECstandard)60%oflightoutputafter1minute

    Color r