scientific computing at lep
DESCRIPTION
Scientific Computing at LEP. LEPfest 2000 Science Symposium CERN, Wednesday 11 October 2000 David Williams Slides at http://cern.ch/davidw/public/LEPfest.ppt. Caveats. I found this harder than I imagined it would be No single person knows all parts of the story - PowerPoint PPT PresentationTRANSCRIPT
-
Scientific Computing at LEP
LEPfest 2000 Science SymposiumCERN, Wednesday 11 October 2000
David Williams
Slides at http://cern.ch/davidw/public/LEPfest.ppt
-
CaveatsI found this harder than I imagined it would beNo single person knows all parts of the storyIf you want to do a proper history and review it would take many months of researchSo I try to paint a pictureSurely a personal picture, with all the biases that impliesAnd in no way am I trying to assign credit to individuals
I have almost surely forgotten to mention some important aspects of the puzzle
-
AcknowledgementsExperiments plus early MEDDLE membersEspeciallyCarpenter, Cass, Cattaneo, Charpentier, Couet, Giani, Harvey, Hoejenbos, Gokieli, Jacobs, Jones, Knobloch, Newman, Robertson, von RdenApologies to the people I forgot!
But the errors and omissions, and there are surely some, are all mine...
-
More than fifteen yearsHalf a human generation, or five Internet generations
Todays really smart searchers after the Higgs were born in 1975-77They are as old as Microsoft [founded in 1975; released Windows 1.0 in 1985]They were 6-8 years old when we published Computing at CERN in the LEP Era in May 19838-10 years old when MEDDLE first met in May 1985If these whizz-kids parents had a computer then it was likely to be a Sinclair Z80, a Commodore C64 or a BBC MicroCisco didnt exist. [It shipped its first product in 1986 and went public in 1990.]
-
Commodore C64
-
The nature of the problem -People and their interactionsI suspect that the LHC experiments are running at the limit of what is feasibleNot the amount of funds that can be assembledOr the complexity of the detectorsBut the possibility of keeping such a large number of very smart people working enthusiastically and actively towards a common scientific goal
Until the mid-1980s HEPs computing problem was often thought to be about obtaining enough processor powerThen we worried about storage capacityThe real problem has always been, in my opinion, getting people to collaborate on a solution
-
PLANNING A necessary or an unnecessary evil?
-
Brecht OriginalJa, mach nur einen PlanSei nur ein grosses LichtUnd mach dann noch nen zweiten PlanGehn tun sie beide nicht
(Dreigroschenoper - Das Lied von der Unzulnglichkeit menschlichen Strebens)
TranslatedNow lets make a planShow forth a shining lightAnd then lets make a second planFor neither will be right
-
Pushing to get computing on the agendaIn November 1979 ECFA set up a committee on data handling and processing (co-chaired by Lillestol and Rimmer)That committee spawned ten working groups in Spring 1980 (SG5 on Networking, run by Sendall, was very influential)Although the General Meeting on LEP held at Villars in June 1981 had no plenary session on computing issues, there was a lot of work by the ECFA WGs and there is a rather extensive discussion, showing much wisdom, by John Mulvey in his closing remarksincludingThere have been passionate arguments this week over the choice of a standard among the different schemes available for data management.
-
The first planThe 1983 Green Book - Computing at CERN in the LEP EraCommissioned by Erwin Gabathuler (then Research Director)Three sections - DAQ, Networking, Offline (and a special annexe on Microprocessor Support)Plus a Steering Committee Report which was basically an argument for serious funding of LEP computing
Deliberately gave no funding total. Work over the following year concluded that CERN would need to invest some 50 MCHF over the following 5 years to implement the recommendations of the plan.
-
Green Book networkingGood stuff on architectureMove from CERNET to commercial backbone plus special purpose nets (controls, pits, buildings, inside computer centre, phones, ..)Choice of standard LANCERN should choose and support a standard LANEthernet was stated to be the obvious choice (but we stopped short of recommending it exclusively)
Digging deeperdiscussed Cambridge Ring and CATV MetronetsEstimates of users10-50 per experiment at CERN19-100 per experiment outside CERN (Europe, NA, ROW added)I looked for 64 kbps per student but couldnt find it
-
Green Book DAQFastbusBuilt-in processor power in front-end systems VAX will be the preferred family of 32-bit computersAdequate staffing of support services
-
Green Book Offline (i) Be careful of private computersDouble central batch capacity by 1987In retrospect we all had a poor understanding of Moores Law and its vital long-term impactEmulators to be driven by individual experimentsNeed for general (networked) file systemConceptual conversion of MSSBut no concept of worldwide system (like NFS or AFS)Need for Microprocessor SupportComputing for EngineersIn general the level of computer support for engineers at CERN is inadequate and needs to be improvedModern system needed for electronics design and VLSI
-
Green Book Offline (ii) InteractiveThis was the new idea - Did we need it? Was it a toy?Stay flexible - We were afraid to choose at this time - So do everything (CERN compromise!)Follow workstationsInstall a central VAX, which was an 8600VM/CMS pilot service (we were running MVS/Wylbur)
-
Green Book - Microprocessor SupportA final Appendix to the Green Book covered a topic which had been addressed separately, Microprocessor SupportMuch wisdom about the subject in generalAnd a recommendation to install a VAX-11/780 running Unix as the central support systemWith connections to CERNET and Index!
CERNs first mainline Unix service
Jobs for two DWs
-
Green Book generalRecommendation 20
We recommend that the Director responsible for computing should appoint a Deputy for Computing and Communications. We envisage this person being responsible for ensuring inter-divisional cooperation on a range of topics, including, for example, office automation, various special-purpose computing projects, and networks. In addition s/he would be the natural person to organise the inter-laboratory collaboration required for a successful European particle physics network
Not accepted!
-
An interlude to reflect on moneyComputing comes last (in time, I mean)And tends to get funded lastCannot make very sensible estimates 8-10 years before serious dataBut normally sufficiently well, in the end
LEP construction was not an easy time for CERN (tunneling)Led us into complicated stories of what CERN could provide as opposed to what experiments would have to provide for themselvesProbably should teach us that when we do develop sensible estimates for computing they should be respectedVery important to start well, since expectations are now high at machine start-up (of any machine..)
-
Ongoing planning - MEDDLEMEDDLE was created in May 1985Meeting between EP-Electronics, DD and the LEP ExperimentsRoughly four meetings per yearBrought together people responsible for CERN services (Director(s), DL(s), GLs) with the representatives of the experiments.Was it for planning, or more for discussions?
Certainly fulfilled a useful role in the early yearsMetamorphosed when other experiments grew in (computing) importance
-
Early MeddlingAmong other things the first meeting discussed how to handle the list of 27 topics which had been requested for discussion!Four follow-on meetings were scheduled:-NetworksSupport for PCs, workstations, and terminalsOfflineOnlineAnd the presentation on networking says:-Money is the only weapon!Therefore do not buy from non-OSI suppliers
-
A different sort of plan -MUSCLEIn January 1988 (18 months before first data) a much more detailed scenario was developed, with estimates for processor requirements at CERN, data volumes, tape mounting rates and external network needs.
It concluded that in the first year of running each experiment would need some 13.5 CERN units of processor power at CERN, and a similar amount outsideIt developed a model (extremely simplified precursor of MONARC) about how much I/O would be needed to (re) process and access the data
-
More MUSCLE..we insist that a dramatic increase in communications bandwidth will be essential if the hopes of distributing a significant fraction of the LEP computing load are to be realised.
.Although the bandwidth of a lorry-full of recorded cartridges is very high, such transport has to be planned days in advance, and it is certainly not flexible.
-
Regional CentresI am fairly sure that this report was the first use of the term Regional CentreTo qualify a centre needed:-2 CERN units at start-up, doubling two years later10 Gbytes!! of disk space at start-up, doubling two years lateraccess to 100s of 3480 cassettes at ~10 mounts/hour64 kbps link to CERN at start-up, upgraded to 2 Mbps two years laterOS and software environment as close to that at CERN as possiblesensible support services
The recommendation on bandwidth had an important and beneficial impact
-
The second planComputing at CERN in the 1990sStarted towards the end of Herwig Schoppers period as DG, in 1988, by John ThresherA bid for greater realism, in the sense that the computing problem was better understood, and the end of paying off the LEP debts was in sight So perhaps more money would be available, and a rather more credible scenario developed
But by the time it was ready there was a new DG, with his own ideas. The new plan didnt fit well with those ideas
It contained lots of ideas, many of them good. But much of the effort was wasted. Worth more study!
-
Ongoing planning - the COCOTIME annual reviewMEDDLE was created in May 1985COCOTIME had existed since ~1970, and was responsible at that time for allocating batch time among the experimentsStarting in 1994-95 it was morphed into an annual review with the experiments of the status of their computing and their technical and financial needs for the coming yearDirector, CN/IT management, and experiments (plus CCCR) then converge on the following year budget allocations and on the technical plans for implementation during the shut-downRather effective
-
THE PROCESSOR CAPACITY SAGA What was a CERN unit?
-
IBM 370/168 - the CERN Unit
-
Two CERN units per experimentIn the eighth meeting of the LEPC, held in June 1983, in the Open SessionWith respect to computing the Director-General stated that CERN cannot provide more than the equivalent of two 370/168 per LEP experiment.
Todays fast PCs are about 100 CERN units (370/168 power)In February 1983 ALEPH had estimated that they needed 12 CERN units for start-up (1988)The announced limitation was a very important political statement to the experimentsAnd introduced a lot of private computing
-
Three CERN units per experimentBy the time of the tenth LEPC in October 1985 we can read thatI[an] Butterworth presented the policy of the Directorate viz-a-viz data handling in the LEP era.[CERN] will, however, provide the equivalent of three IBM 168 per LEP experiment. (50% increase in 2+ years).
We should note that this commitment was actually preceded by a funding discussion (upping the computing investment line from 6 to 8 MCHF per year) which indicated an understanding that CPU power was not the only issue.
-
Siemens 7880 in 1985
-
Twelve CERN units in 1989In Jan 1988 the MUSCLE report had suggested that each experiment needed access to 13.5 CERN units at CERN in 1989Following the installation of the Cray X-MP/48 in 1987 it became possible to allocate twelve CERN units per experiment in 1989Even if not universally loved (vectorisation, access) the Cray was for some time very cost-effective and provided an extremely effective batch service during its working life at CERNIt was also our first mainframe running Unix, and CERN had a major role in pushing the rapid spread of that change among Cray users
-
How much CPU did we really use?In the year 2000 each LEP experiment has had access to roughly 2000 CERN units of batch capacity at CERNOr roughly 1000 times what they were warned in 1983 would be the limit of CERNs possibilities
Moores law (which predicts the doubling of the processor power every 18 months at roughly constant cost) predicts an increase of 1000 times over 15 years. QED.
-
BATCHCERNVM to SHIFT
-
Types of batchIn 1983, batch was batch, and you ran it on mainframesBut times were changingThe PC-XT was the state of the art (running with a 4.77 MHz 16-bit Intel 8088)The Macintosh, and the 68020, would be introduced in 1984Graphics workstations were starting to appear, with the pioneering, but ultimately unsuccessful PERQ from Three Rivers/ICL leading the way
We started to distinguish simulation from data intensive batch
-
CSFIn December 1991 the Central Simulation facility was assembled, based on 45 HP 9000/720 series workstations (Snakes) running Unix (HP-UX).This was CERNs first computer farm based on commodity equipment. Previous farms had been based on various generations of emulators.It offered a very significant price-performance improvement over conventional mainframes, with a software environment which was rather reasonable.
-
CSF in 1992
-
SHIFTAnother step was to explore the possibility of carrying out much more compute-intensive tasks than CSF could supportWork (HOPE) based on Apollo had not really generated enough I/O powerThen a joint project (SHIFT) between IT, Opal (Indiana), and Silicon Graphics, and using UltraNet to provide localised high-throughput I/O, was started in mid-1990, and became operational for the 1991 run.Over a few years this architecture matured and became CERNs default batch processing architecture. It then naturally developed into the PC farms that we can see today..
-
HOLDING THE DESKTOPS TOGETHERFrom CERNVM to NICE and PLUS
-
The dual role of the mainframeIn 1965 a computer was mainly a powerful calculatorBy 1975 a mainframe processed dataAnd by 1985, in addition to that role, it had started to provide the desktop environmentInitially mainly for dumb terminals connected via Index
But the number of users, and their needs, would grow fast:-Offsite accessSpread of LANs onsiteSpread of computer useExperiments wanting to work collaboratively (email, sharing programs and data)Hence, wish to see uniform logon environment
-
A growing number of usersThis uniform environment was provided de facto by CERNVM, and the number of users grew rapidly, even as the use of PCs and Macs took offIt reached a peak of ~4200 users/week in 1992-93Eventually the CERNVM service was turned off, after sterling efforts by many people to make a migration possible, in the middle of 1996
-
Weekly interactive users 1987-2000Number of Users each WeekWeekCERNVMWINDOWSVXCERNPLUS
Chart4
87011054087018701
87021129087028702
87031212087038703
87041245087048704
87051163087058705
87061305087068706
87071311087078707
87081213087088708
87091276087098709
87101323087108710
87111349087118711
87121382087128712
87131382087138713
87141348087148714
87151201087158715
87161123087168716
87171253087178717
87181337087188718
87191387087198719
87201346087208720
87211286087218721
87221378087228722
87231330087238723
87241446087248724
87251468087258725
87261435087268726
87271466087278727
87281418087288728
87291428087298729
87301432087308730
87311426087318731
87321424087328732
87331440087338733
87341446087348734
87351461087358735
87361433087368736
87371500087378737
87381526087388738
87391486087398739
87401624087408740
87411653087418741
87421680087428742
87431629087438743
87441678087448744
87451711087458745
87461738087468746
87471815087478747
87481842087488748
87491805087498749
87501737087508750
87511229087518751
87520087528752
88011560088018801
88021823088028802
88031863088038803
88041867088048804
88051908088058805
88061928088068806
88071917088078807
88081760088088808
88091845088098809
88101906088108810
88111971088118811
88122006088128812
88131825088138813
9231720088148814
11292049088158815
11782119088168816
11542101088178817
10492092088188818
9841898088198819
11782062088208820
11732058088218821
11362006088228822
11672095088238823
11912076088248824
12492057088258825
12142118088268826
12412096088278827
12552087088288828
8592049088298829
12302048088308830
11082036088318831
11381967088328832
11101976088338833
11871983088348834
02043088358835
11541972088368836
12942171088378837
12472176088388838
11382075088398839
12862255088408840
13482291088418841
13782338088428842
12012223088438843
02243088448844
14362342088458845
14122334088468846
14162391088478847
14552403088488848
15302380088498849
12782354088508850
12152071088518851
00088528852
12260089018901
14162222089028902
14592379089038903
15412436089048904
15372434089058905
14722387089068906
14572345089078907
15592526089088908
14812534089098909
15372495089108910
15382481089118911
14702298089128912
13862154089138913
15642482089148914
16032624089158915
14052594089168916
15572525089178917
14402232089188918
15432546089198919
15442538089208920
15672543089218921
16712688089228922
16712663089238923
16942676089248924
16692653089258925
15672603089268926
16322625089278927
17002580089288928
16872673089298929
17102658089308930
02745089318931
13692691089328932
16412743089338933
16992718089348934
17632863089358935
7322773089368936
17072780089378937
17882886089388938
18072868089398939
18162912089408940
18442944089418941
18793037089428942
18263179089438943
18532988089448944
18363295089458945
18483189089468946
18463174089478947
18573108089488948
17773222089498949
18233245089508950
16252968089518951
00089528952
12842486090019001
17203130090029002
17743147090039003
17693094090049004
18003174090059005
17813259090069006
17573218090079007
17252935090089008
18133211090099009
17433317090109010
18343416090119011
18093205090129012
18693281090139013
18373304090149014
16642944090159015
16602873090169016
18623277090179017
17673213090189018
17033335090199019
19303357090209020
17613225090219021
18263369090229022
18073292090239023
18803310090249024
18213326090259025
18053429090269026
17413448090279027
18543242090289028
18113214090299029
17683134090309030
17113001090319031
16082926090329032
15893053090339033
17083188090349034
17263261090359035
17133170090369036
16523155090379037
16643247090389038
03279090399039
17773371090409040
17643429090419041
18103459090429042
17423429090439043
17993403090449044
18963531090459045
18763597090469046
18173636090479047
18663594090489048
18743627090499049
18803547090509050
16353273090519051
00090529052
897598091019101
17273361091029102
18263466091039103
19163597091049104
17963547091059105
18313515091069106
19493608091079107
17913575091089108
19093581091099109
19423578091109110
18113530091119111
18633592091129112
17623468091139113
17133245091149114
17803643091159115
19823734091169116
19893644091179117
18943515091189118
18713418091199119
19893886091209120
19303576091219121
19283621091229122
19773715091239123
20543761091249124
20193728091259125
19893638091269126
20483696091279127
20593611091289128
20503610091299129
20103599091309130
19963568091319131
18773438091329132
17433301091339133
18333363091349134
19093470091359135
20073580091369136
20843758091379137
20733695091389138
21043796091399139
20663793091409140
21473907091419141
21713931091429142
21813934091439143
21473788091449144
21923941091459145
21823870091469146
20793877091479147
20733891091489148
21973948091499149
21243896091509150
19203685091519151
00091529152
00092019201
20073681092029202
21663841092039203
21073862092049204
21073861092059205
21783853092069206
21563892092079207
21493810092089208
21053922092099209
21423804092109210
21733833092119211
22243832092129212
21923811092139213
22193820092149214
22133917092159215
20673634092169216
19853504092179217
20333693092189218
21983872092199219
21784000092209220
21883846092219221
21573783092229222
22263882092239223
21243727092249224
22314100092259225
22483963092269226
23313942092279227
22874199092289228
21773702092299229
21323633092309230
21643646092319231
19993514092329232
19403517092339233
18793534092349234
21113657092359235
22123839092369236
22453784092379237
22303865092389238
22003888092399239
22993971092409240
22684062092419241
23604074092429242
23964129092439243
23334025092449244
23744180092459245
23324207092469246
22544221092479247
23294172092489248
23524167092499249
23204132092509250
22643993092519251
00092529252
20593556093019301
22583975093029302
22054002093039303
22084101093049304
22764069093059305
22884064093069306
22554076093079307
21483978093089308
22033940093099309
22423985093109310
22303993093119311
21573915093129312
22313937093139313
20733726093149314
20093557093159315
22373880093169316
22433844093179317
22314008093189318
22583985093199319
22313768093209320
22883954093219321
22233913093229322
22854022093239323
23194022093249324
23914054093259325
23453989093269326
23263919093279327
23593846093289328
23033763093299329
22333702093309330
20653635093319331
19663430093329332
19873544093339333
22333749093349334
24053935093359335
23563841093369336
22903881093379337
22933935093389338
23934016093399339
24834114093409340
23634121093419341
24394150093429342
23964094093439343
24994155093449344
25384188093459345
25704207093469346
24534146093479347
25004172093489348
24834047093499349
23413997093509350
00093519351
00093529352
18123364094019401
23623975094029402
23863970094039403
24614033094049404
25144072094059405
23484005094069406
23213904094079407
23833908094089408
22803878094099409
23283929094109410
23063925094119411
23983949094129412
21453583094139413
21493578094149414
23943918094159415
24413986094169416
23633803094179417
23313831094189418
22413668094199419
24463891094209420
23403874094219421
23603879094229422
23773852094239423
24563910094249424
23953899094259425
23963781094269426
24523829094279427
24103684094289428
23993569094299429
22073516094309430
21403486094319431
2050344213894329432
2047348117594339433
2229357718594349434
2348363618694359435
2401364714294369436
2511380016094379437
2520387322394389438
2516371222294399439
2450380422394409440
2479382822794419441
2398383723694429442
2460378618394439443
2385378022594449444
2496378125094459445
2533385726494469446
2511377428394479447
2625379730094489448
2404370429194499449
2435375528794509450
030156694519451
00094529452
1638351417695019501
2346358023295029502
2387362127495039503
2426364529195049504
2924366529895059505
2264357641495069506
2332345242695079507
2360344442995089508
2334349744795099509
2334344945195109510
2321339951295119511
2327340553195129512
2400337256995139513
2363341259895149514
2126316957295159515
2143312357295169516
2365343664195179517
2259321262695189518
2328328969995199519
2366335078495209520
2231319784995219521
2348332274095229522
2247323187595239523
2336322688795249524
2390325296995251315
2392320399495261306
23643190100495271265
2271300498995281218
22402792107395291184
22372799112495301173
21782800107095311195
20172678112895321205
19762697114395331219
21562800127595341232
22482850124895351284
22362879126695361293
22312815129095371327
23362767137195381313
23492818141395391375
22792868148595401466
22582865147895411419
22852866152495421449
22862881159795431485
22642770158895441383
24242875162195451514
23342845162695461523
23062891173095471546
23492893188395481557
23722856193395491520
22412801181195501534
00095510
00095520
1585181811869601614
21292688173696021570
21422573175196031587
21572620186796041627
21542614208396051641
20822518205496061551
20772501209396071683
21032452218696081516
21112454225996091535
21492469233496101564
21672445241196111628
20712372232896121709
20622295234396131735
19231966228396141623
18431964228796151571
20072060237896161722
20012053241496171727
19402044236296181736
19732009253196191809
19851922247996201733
20421843261996211797
19541830253996221529
20131841271896231773
20341821283196241821
20911767309496251839
20939626336396261809
20979627325496271784
19719628318796281605
18929629310796291583
18449630303096301567
17279631300796311593
13449632295796321645
15449633282996331632
16489634305096341611
17429635309096351623
17859636309496361678
18629637330696371802
18429638340896381853
17969639341396391865
18539640343296401888
18679641355596411951
18989642361096422003
18779643371196432010
17879644372196442015
18259645390096452033
18209646379696462047
18669647387196472057
17439648377996482059
17639649382296492065
17849650384796502092
16949651360496512000
09652154396520
654970113669701153
16109702333797021955
16879703354997031955
16289704360097041949
16619705364697051993
16129706370897062107
16879707366397071997
15869708369597082134
16589709365697092164
16589710381897102130
16199711242697112110
15719712368297122082
14619713338397132156
14159714347497141848
15819715373397152149
15029716371197162013
15019717364597172044
11299718356097182056
14669719365197192021
15859720382797202101
15619721374797212110
15159722386397222116
15579723391797232150
14729724381997242139
15619725400097252091
15169726412297262082
15299727404397272069
14729728388997282032
14649729377797291961
14139730383097301959
13799731379397311889
13019732372697321880
12219733350597331885
12819734366997341911
12849735374997351926
14519736405497361998
14499737408697371957
14259738419697382107
13599739399497392197
13979740411697402305
13779741428297412285
13729742421997422280
13799743429997432257
13739744421397442203
13519745437797452270
13639746430597462300
13329747426997472345
12379748424997482353
13119749438197492447
13179750434297502512
12699751407597510
7869752186797520
5759801180498010
1161980236461992152
1275980341032312333
1239980441612312330
1235980541672022346
1212980642062132347
1202980740732472336
1190980841242822440
1159980941222672334
1230981042592942461
1221981142573032467
1153981240272912429
1168981340742962471
1159981440012872466
1058981538122812230
1035981638212852281
1144981742643112490
1087981841553052442
1042981941963452561
1136982042163362550
1091982141173142455
1117982242863492503
1113982344322552349
1100982445603392606
1089982542363792594
1070982644333532471
1067982744843542532
937982844203322496
1054982943462892360
1049983043042842303
963983142143062290
891983240133042306
832983340053192240
812983439464002292
891983542593202333
1006983645013292527
1003983741363212426
993983846293432539
965983944123492532
988984045133852626
985984145223972631
971984246324002653
974984346214332666
954984445674112574
950984545824412736
948984646304642783
976984746924902798
955984845235002806
966984947585392832
909985041305152807
925985144194602722
63998522605113395
4429853191098539853
8119901366796347
889990243273872517
884990344724322727
854990443854622769
851990544044742742
868990644915182769
844990745685062758
852990844454942723
847990945704962765
816991045314882833
811991146035282847
785991243715412808
760991340615552803
744991441034842575
785991543745042554
777991644645532746
787991745405872789
753991844366132869
770991942466302831
802992045405712625
786992144696462755
789992247166312770
783992347526942911
793992448077312934
745992547287352877
760992648317302814
745992747897632850
738992847367672805
706992945677462666
679993046477832643
673993143887502605
571993240867532551
593993342507582495
648993444657922561
679993548657562598
696993648106112410
722993749647852632
714993850288312811
713993949818542813
695994049687982831
676994151107862816
674994252648272897
673994349718302857
663994446757682908
687994549158112879
665994650298642930
672994749558252927
664994848178392949
644994948128883022
646995045288743001
743995136407832861
33799523492175498
63100013971166367
793000247536532568
752000349357622807
711000450108412878
670000550458312914
629000650808922937
621000746878672932
629000848568592941
616000949468852790
606001048368852853
610001148118822881
588001247089112901
586001346218922922
580001450429542911
564001549709702927
547001648879742897
522001746798772662
557001846197672392
555001948239152838
554002051209712869
5530021503810012902
551002249589752856
551002345949662804
5510024478710532874
Weekly Users of Interactive Services 1987-1998
VXCERN
CERNVM
WGS and PLUS
Windows NT
Windows 95
Sheet2
Sheet2
87011054087018701
87021129087028702
87031212087038703
87041245087048704
87051163087058705
87061305087068706
87071311087078707
87081213087088708
87091276087098709
87101323087108710
87111349087118711
87121382087128712
87131382087138713
87141348087148714
87151201087158715
87161123087168716
87171253087178717
87181337087188718
87191387087198719
87201346087208720
87211286087218721
87221378087228722
87231330087238723
87241446087248724
87251468087258725
87261435087268726
87271466087278727
87281418087288728
87291428087298729
87301432087308730
87311426087318731
87321424087328732
87331440087338733
87341446087348734
87351461087358735
87361433087368736
87371500087378737
87381526087388738
87391486087398739
87401624087408740
87411653087418741
87421680087428742
87431629087438743
87441678087448744
87451711087458745
87461738087468746
87471815087478747
87481842087488748
87491805087498749
87501737087508750
87511229087518751
87520087528752
88011560088018801
88021823088028802
88031863088038803
88041867088048804
88051908088058805
88061928088068806
88071917088078807
88081760088088808
88091845088098809
88101906088108810
88111971088118811
88122006088128812
88131825088138813
9231720088148814
11292049088158815
11782119088168816
11542101088178817
10492092088188818
9841898088198819
11782062088208820
11732058088218821
11362006088228822
11672095088238823
11912076088248824
12492057088258825
12142118088268826
12412096088278827
12552087088288828
8592049088298829
12302048088308830
11082036088318831
11381967088328832
11101976088338833
11871983088348834
02043088358835
11541972088368836
12942171088378837
12472176088388838
11382075088398839
12862255088408840
13482291088418841
13782338088428842
12012223088438843
02243088448844
14362342088458845
14122334088468846
14162391088478847
14552403088488848
15302380088498849
12782354088508850
12152071088518851
00088528852
12260089018901
14162222089028902
14592379089038903
15412436089048904
15372434089058905
14722387089068906
14572345089078907
15592526089088908
14812534089098909
15372495089108910
15382481089118911
14702298089128912
13862154089138913
15642482089148914
16032624089158915
14052594089168916
15572525089178917
14402232089188918
15432546089198919
15442538089208920
15672543089218921
16712688089228922
16712663089238923
16942676089248924
16692653089258925
15672603089268926
16322625089278927
17002580089288928
16872673089298929
17102658089308930
02745089318931
13692691089328932
16412743089338933
16992718089348934
17632863089358935
7322773089368936
17072780089378937
17882886089388938
18072868089398939
18162912089408940
18442944089418941
18793037089428942
18263179089438943
18532988089448944
18363295089458945
18483189089468946
18463174089478947
18573108089488948
17773222089498949
18233245089508950
16252968089518951
00089528952
12842486090019001
17203130090029002
17743147090039003
17693094090049004
18003174090059005
17813259090069006
17573218090079007
17252935090089008
18133211090099009
17433317090109010
18343416090119011
18093205090129012
18693281090139013
18373304090149014
16642944090159015
16602873090169016
18623277090179017
17673213090189018
17033335090199019
19303357090209020
17613225090219021
18263369090229022
18073292090239023
18803310090249024
18213326090259025
18053429090269026
17413448090279027
18543242090289028
18113214090299029
17683134090309030
17113001090319031
16082926090329032
15893053090339033
17083188090349034
17263261090359035
17133170090369036
16523155090379037
16643247090389038
03279090399039
17773371090409040
17643429090419041
18103459090429042
17423429090439043
17993403090449044
18963531090459045
18763597090469046
18173636090479047
18663594090489048
18743627090499049
18803547090509050
16353273090519051
00090529052
897598091019101
17273361091029102
18263466091039103
19163597091049104
17963547091059105
18313515091069106
19493608091079107
17913575091089108
19093581091099109
19423578091109110
18113530091119111
18633592091129112
17623468091139113
17133245091149114
17803643091159115
19823734091169116
19893644091179117
18943515091189118
18713418091199119
19893886091209120
19303576091219121
19283621091229122
19773715091239123
20543761091249124
20193728091259125
19893638091269126
20483696091279127
20593611091289128
20503610091299129
20103599091309130
19963568091319131
18773438091329132
17433301091339133
18333363091349134
19093470091359135
20073580091369136
20843758091379137
20733695091389138
21043796091399139
20663793091409140
21473907091419141
21713931091429142
21813934091439143
21473788091449144
21923941091459145
21823870091469146
20793877091479147
20733891091489148
21973948091499149
21243896091509150
19203685091519151
00091529152
00092019201
20073681092029202
21663841092039203
21073862092049204
21073861092059205
21783853092069206
21563892092079207
21493810092089208
21053922092099209
21423804092109210
21733833092119211
22243832092129212
21923811092139213
22193820092149214
22133917092159215
20673634092169216
19853504092179217
20333693092189218
21983872092199219
21784000092209220
21883846092219221
21573783092229222
22263882092239223
21243727092249224
22314100092259225
22483963092269226
23313942092279227
22874199092289228
21773702092299229
21323633092309230
21643646092319231
19993514092329232
19403517092339233
18793534092349234
21113657092359235
22123839092369236
22453784092379237
22303865092389238
22003888092399239
22993971092409240
22684062092419241
23604074092429242
23964129092439243
23334025092449244
23744180092459245
23324207092469246
22544221092479247
23294172092489248
23524167092499249
23204132092509250
22643993092519251
00092529252
20593556093019301
22583975093029302
22054002093039303
22084101093049304
22764069093059305
22884064093069306
22554076093079307
21483978093089308
22033940093099309
22423985093109310
22303993093119311
21573915093129312
22313937093139313
20733726093149314
20093557093159315
22373880093169316
22433844093179317
22314008093189318
22583985093199319
22313768093209320
22883954093219321
22233913093229322
22854022093239323
23194022093249324
23914054093259325
23453989093269326
23263919093279327
23593846093289328
23033763093299329
22333702093309330
20653635093319331
19663430093329332
19873544093339333
22333749093349334
24053935093359335
23563841093369336
22903881093379337
22933935093389338
23934016093399339
24834114093409340
23634121093419341
24394150093429342
23964094093439343
24994155093449344
25384188093459345
25704207093469346
24534146093479347
25004172093489348
24834047093499349
23413997093509350
00093519351
00093529352
18123364094019401
23623975094029402
23863970094039403
24614033094049404
25144072094059405
23484005094069406
23213904094079407
23833908094089408
22803878094099409
23283929094109410
23063925094119411
23983949094129412
21453583094139413
21493578094149414
23943918094159415
24413986094169416
23633803094179417
23313831094189418
22413668094199419
24463891094209420
23403874094219421
23603879094229422
23773852094239423
24563910094249424
23953899094259425
23963781094269426
24523829094279427
24103684094289428
23993569094299429
22073516094309430
21403486094319431
2050344213894329432
2047348117594339433
2229357718594349434
2348363618694359435
2401364714294369436
2511380016094379437
2520387322394389438
2516371222294399439
2450380422394409440
2479382822794419441
2398383723694429442
2460378618394439443
2385378022594449444
2496378125094459445
2533385726494469446
2511377428394479447
2625379730094489448
2404370429194499449
2435375528794509450
030156694519451
00094529452
1638351417695019501
2346358023295029502
2387362127495039503
2426364529195049504
2924366529895059505
2264357641495069506
2332345242695079507
2360344442995089508
2334349744795099509
2334344945195109510
2321339951295119511
2327340553195129512
2400337256995139513
2363341259895149514
2126316957295159515
2143312357295169516
2365343664195179517
2259321262695189518
2328328969995199519
2366335078495209520
2231319784995219521
2348332274095229522
2247323187595239523
2336322688795249524
2390325296995251315
2392320399495261306
23643190100495271265
2271300498995281218
22402792107395291184
22372799112495301173
21782800107095311195
20172678112895321205
19762697114395331219
21562800127595341232
22482850124895351284
22362879126695361293
22312815129095371327
23362767137195381313
23492818141395391375
22792868148595401466
22582865147895411419
22852866152495421449
22862881159795431485
22642770158895441383
24242875162195451514
23342845162695461523
23062891173095471546
23492893188395481557
23722856193395491520
22412801181195501534
00095510
00095520
1585181811869601614
21292688173696021570
21422573175196031587
21572620186796041627
21542614208396051641
20822518205496061551
20772501209396071683
21032452218696081516
21112454225996091535
21492469233496101564
21672445241196111628
20712372232896121709
20622295234396131735
19231966228396141623
18431964228796151571
20072060237896161722
20012053241496171727
19402044236296181736
19732009253196191809
19851922247996201733
20421843261996211797
19541830253996221529
20131841271896231773
20341821283196241821
20911767309496251839
20939626336396261809
20979627325496271784
19719628318796281605
18929629310796291583
18449630303096301567
17279631300796311593
13449632295796321645
15449633282996331632
16489634305096341611
17429635309096351623
17859636309496361678
18629637330696371802
18429638340896381853
17969639341396391865
18539640343296401888
18679641355596411951
18989642361096422003
18779643371196432010
17879644372196442015
18259645390096452033
18209646379696462047
18669647387196472057
17439648377996482059
17639649382296492065
17849650384796502092
16949651360496512000
09652154396520
654970113669701153
16109702333797021955
16879703354997031955
16289704360097041949
16619705364697051993
16129706370897062107
16879707366397071997
15869708369597082134
16589709365697092164
16589710381897102130
16199711242697112110
15719712368297122082
14619713338397132156
14159714347497141848
15819715373397152149
15029716371197162013
15019717364597172044
11299718356097182056
14669719365197192021
15859720382797202101
15619721374797212110
15159722386397222116
15579723391797232150
14729724381997242139
15619725400097252091
15169726412297262082
15299727404397272069
14729728388997282032
14649729377797291961
14139730383097301959
13799731379397311889
13019732372697321880
12219733350597331885
12819734366997341911
12849735374997351926
14519736405497361998
14499737408697371957
14259738419697382107
13599739399497392197
13979740411697402305
13779741428297412285
13729742421997422280
13799743429997432257
13739744421397442203
13519745437797452270
13639746430597462300
13329747426997472345
12379748424997482353
13119749438197492447
13179750434297502512
12699751407597510
7869752186797520
5759801180498010
1161980236461992152
1275980341032312333
1239980441612312330
1235980541672022346
1212980642062132347
1202980740732472336
1190980841242822440
1159980941222672334
1230981042592942461
1221981142573032467
1153981240272912429
1168981340742962471
1159981440012872466
1058981538122812230
1035981638212852281
1144981742643112490
1087981841553052442
1042981941963452561
1136982042163362550
1091982141173142455
1117982242863492503
1113982344322552349
1100982445603392606
1089982542363792594
1070982644333532471
1067982744843542532
937982844203322496
1054982943462892360
1049983043042842303
963983142143062290
891983240133042306
832983340053192240
812983439464002292
891983542593202333
1006983645013292527
1003983741363212426
993983846293432539
965983944123492532
988984045133852626
985984145223972631
971984246324002653
974984346214332666
954984445674112574
950984545824412736
948984646304642783
976984746924902798
955984845235002806
966984947585392832
909985041305152807
925985144194602722
63998522605113395
4429853191098539853
8119901366796347
889990243273872517
884990344724322727
854990443854622769
851990544044742742
868990644915182769
844990745685062758
852990844454942723
847990945704962765
816991045314882833
811991146035282847
785991243715412808
760991340615552803
744991441034842575
785991543745042554
777991644645532746
787991745405872789
753991844366132869
770991942466302831
802992045405712625
786992144696462755
789992247166312770
783992347526942911
793992448077312934
745992547287352877
760992648317302814
745992747897632850
738992847367672805
706992945677462666
679993046477832643
673993143887502605
571993240867532551
593993342507582495
648993444657922561
679993548657562598
696993648106112410
722993749647852632
714993850288312811
713993949818542813
695994049687982831
676994151107862816
674994252648272897
673994349718302857
663994446757682908
687994549158112879
665994650298642930
672994749558252927
664994848178392949
644994948128883022
646995045288743001
743995136407832861
33799523492175498
63100013971166367
793000247536532568
752000349357622807
711000450108412878
670000550458312914
629000650808922937
621000746878672932
629000848568592941
616000949468852790
606001048368852853
610001148118822881
588001247089112901
586001346218922922
580001450429542911
564001549709702927
547001648879742897
522001746798772662
557001846197672392
555001948239152838
554002051209712869
5530021503810012902
551002249589752856
551002345949662804
5510024478710532874
Weekly Users of Interactive Services 1987-1998
VXCERN
CERNVM
WGS and PLUS
Windows NT
Windows 95
Sheet1
Sheet1
1054870100
1129870200
1212870300
1245870400
1163870500
1305870600
1311870700
1213870800
1276870900
1323871000
1349871100
1382871200
1382871300
1348871400
1201871500
1123871600
1253871700
1337871800
1387871900
1346872000
1286872100
1378872200
1330872300
1446872400
1468872500
1435872600
1466872700
1418872800
1428872900
1432873000
1426873100
1424873200
1440873300
1446873400
1461873500
1433873600
1500873700
1526873800
1486873900
1624874000
1653874100
1680874200
1629874300
1678874400
1711874500
1738874600
1815874700
1842874800
1805874900
1737875000
1229875100
0875200
1560880100
1823880200
1863880300
1867880400
1908880500
1928880600
1917880700
1760880800
1845880900
1906881000
1971881100
2006881200
1825881300
172092300
2049112900
2119117800
2101115400
2092104900
189898400
2062117800
2058117300
2006113600
2095116700
2076119100
2057124900
2118121400
2096124100
2087125500
204985900
2048123000
2036110800
1967113800
1976111000
1983118700
2043000
1972115400
2171129400
2176124700
2075113800
2255128600
2291134800
2338137800
2223120100
2243000
2342143600
2334141200
2391141600
2403145500
2380153000
2354127800
2071121500
0000
0122600
2222141600
2379145900
2436154100
2434153700
2387147200
2345145700
2526155900
2534148100
2495153700
2481153800
2298147000
2154138600
2482156400
2624160300
2594140500
2525155700
2232144000
2546154300
2538154400
2543156700
2688167100
2663167100
2676169400
2653166900
2603156700
2625163200
2580170000
2673168700
2658171000
2745000
2691136900
2743164100
2718169900
2863176300
277373200
2780170700
2886178800
2868180700
2912181600
2944184400
3037187900
3179182600
2988185300
3295183600
3189184800
3174184600
3108185700
3222177700
3245182300
2968162500
0000
2486128400
3130172000
3147177400
3094176900
3174180000
3259178100
3218175700
2935172500
3211181300
3317174300
3416183400
3205180900
3281186900
3304183700
2944166400
2873166000
3277186200
3213176700
3335170300
3357193000
3225176100
3369182600
3292180700
3310188000
3326182100
3429180500
3448174100
3242185400
3214181100
3134176800
3001171100
2926160800
3053158900
3188170800
3261172600
3170171300
3155165200
3247166400
3279000
3371177700
3429176400
3459181000
3429174200
3403179900
3531189600
3597187600
3636181700
3594186600
3627187400
3547188000
3273163500
0000
59889700
3361172700
3466182600
3597191600
3547179600
3515183100
3608194900
3575179100
3581190900
3578194200
3530181100
3592186300
3468176200
3245171300
3643178000
3734198200
3644198900
3515189400
3418187100
3886198900
3576193000
3621192800
3715197700
3761205400
3728201900
3638198900
3696204800
3611205900
3610205000
3599201000
3568199600
3438187700
3301174300
3363183300
3470190900
3580200700
3758208400
3695207300
3796210400
3793206600
3907214700
3931217100
3934218100
3788214700
3941219200
3870218200
3877207900
3891207300
3948219700
3896212400
3685192000
0000
0000
3681200700
3841216600
3862210700
3861210700
3853217800
3892215600
3810214900
3922210500
3804214200
3833217300
3832222400
3811219200
3820221900
3917221300
3634206700
3504198500
3693203300
3872219800
4000217800
3846218800
3783215700
3882222600
3727212400
4100223100
3963224800
3942233100
4199228700
3702217700
3633213200
3646216400
3514199900
3517194000
3534187900
3657211100
3839221200
3784224500
3865223000
3888220000
3971229900
4062226800
4074236000
4129239600
4025233300
4180237400
4207233200
4221225400
4172232900
4167235200
4132232000
3993226400
0000
3556205900
3975225800
4002220500
4101220800
4069227600
4064228800
4076225500
3978214800
3940220300
3985224200
3993223000
3915215700
3937223100
3726207300
3557200900
3880223700
3844224300
4008223100
3985225800
3768223100
3954228800
3913222300
4022228500
4022231900
4054239100
3989234500
3919232600
3846235900
3763230300
3702223300
3635206500
3430196600
3544198700
3749223300
3935240500
3841235600
3881229000
3935229300
4016239300
4114248300
4121236300
4150243900
4094239600
4155249900
4188253800
4207257000
4146245300
4172250000
4047248300
3997234100
0000
0000
3364181200
3975236200
3970238600
4033246100
4072251400
4005234800
3904232100
3908238300
3878228000
3929232800
3925230600
3949239800
3583214500
3578214900
3918239400
3986244100
3803236300
3831233100
3668224100
3891244600
3874234000
3879236000
3852237700
3910245600
3899239500
3781239600
3829245200
3684241000
3569239900
3516220700
3486214000
344220501380
348120471750
357722291850
363623481860
364724011420
380025111600
387325202230
371225162220
380424502230
382824792270
383723982360
378624601830
378023852250
378124962500
385725332640
377425112830
379726253000
370424042910
375524352870
30150660
0000
351416381760
358023462320
362123872740
364524262910
366529242980
357622644140
345223324260
344423604290
349723344470
344923344510
339923215120
340523275310
337224005690
341223635980
316921265720
312321435720
343623656410
321222596260
328923286990
335023667840
319722318490
332223487400
323122478750
322623368870
325223909691315
320323929941306
3190236410041265
300422719891218
2792224010731184
2799223711241173
2800217810701195
2678201711281205
2697197611431219
2800215612751232
2850224812481284
2879223612661293
2815223112901327
2767233613711313
2818234914131375
2868227914851466
2865225814781419
2866228515241449
2881228615971485
2770226415881383
2875242416211514
2845233416261523
2891230617301546
2893234918831557
2856237219331520
2801224118111534
0000
0000
181815851186614
2688212917361570
2573214217511587
2620215718671627
2614215420831641
2518208220541551
2501207720931683
2452210321861516
2454211122591535
2469214923341564
2445216724111628
2372207123281709
2295206223431735
1966192322831623
1964184322871571
2060200723781722
2053200124141727
2044194023621736
2009197325311809
1922198524791733
1843204226191797
1830195425391529
1841201327181773
1821203428311821
1767209130941839
9626209333631809
9627209732541784
9628197131871605
9629189231071583
9630184430301567
9631172730071593
9632134429571645
9633154428291632
9634164830501611
9635174230901623
9636178530941678
9637186233061802
9638184234081853
9639179634131865
9640185334321888
9641186735551951
9642189836102003
9643187737112010
9644178737212015
9645182539002033
9646182037962047
9647186638712057
9648174337792059
9649176338222065
9650178438472092
9651169436042000
9652015430
97016541366153
9702161033371955
9703168735491955
9704162836001949
9705166136461993
9706161237082107
9707168736631997
9708158636952134
9709165836562164
9710165838182130
9711161924262110
9712157136822082
9713146133832156
9714141534741848
9715158137332149
9716150237112013
9717150136452044
9718112935602056
9719146636512021
9720158538272101
9721156137472110
9722151538632116
9723155739172150
9724147238192139
9725156140002091
9726151641222082
9727152940432069
9728147238892032
9729146437771961
9730141338301959
9731137937931889
9732130137261880
9733122135051885
9734128136691911
9735128437491926
9736145140541998
9737144940861957
9738142541962107
9739135939942197
9740139741162305
9741137742822285
9742137242192280
9743137942992257
9744137342132203
9745135143772270
9746136343052300
9747133242692345
9748123742492353
9749131143812447
9750131743422512
9751126940750
975278618670
980157518040
9802116136462351
9803127541032564
9804123941612561
9805123541672548
9806121242062560
9807120240732583
9808119041242722
9809115941222601
9810123042592755
9811122142572770
9812115340272720
9813116840742767
9814115940012753
9815105838122511
9816103538212566
9817114442642801
9818108741552747
9819104241962906
9820113642162886
9821109141172769
9822111742862852
9823111344322604
9824110045602945
&A
Page &P
Weekly Users of Interactive Services 1987-1998
CERNVM
VXCERN
WGS and PLUS
NICE
Week
Total Number of Users
cernvm
WeekTOTALCERNVMUNIXNICEVXCERNPLUSWGSRSPLUSLXPLUSHPPLUSDXPLUSATLASCMSCHORUSIONNA48SLAPRPTHW95WNT
8701105410540000
8702112911290000
8703121212120000
8704124512450000
8705116311630000
8706130513050000
8707131113110000
8708121312130000
8709127612760000
8710132313230000
8711134913490000
8712138213820000
8713138213820000
8714134813480000
8715120112010000
8716112311230000
8717125312530000
8718133713370000
8719138713870000
8720134613460000
8721128612860000
8722137813780000
8723133013300000
8724144614460000
8725146814680000
8726143514350000
8727146614660000
8728141814180000
8729142814280000
8730143214320000
8731142614260000
8732142414240000
8733144014400000
8734144614460000
8735146114610000
8736143314330000
8737150015000000
8738152615260000
8739148614860000
8740162416240000
8741165316530000
8742168016800000
8743162916290000
8744167816780000
8745171117110000
8746173817380000
8747181518150000
8748184218420000
8749180518050000
8750173717370000
8751122912290000
8752000000
8801156015600000
8802182318230000
8803186318630000
8804186718670000
8805190819080000
8806192819280000
8807191719170000
8808176017600000
8809184518450000
8810190619060000
8811197119710000
8812200620060000
8813182518250000
8814264317200092300
88153178204900112900
88163297211900117800
88173255210100115400
88183141209200104900
8819288218980098400
88203240206200117800
88213231205800117300
88223142200600113600
88233262209500116700
88243267207600119100
88253306205700124900
88263332211800121400
88273337209600124100
88283342208700125500
8829290820490085900
88303278204800123000
88313144203600110800
88323105196700113800
88333086197600111000
88343170198300118700
88352043204300000
88363126197200115400
88373465217100129400
88383423217600124700
88393213207500113800
88403541225500128600
88413639229100134800
88423716233800137800
88433424222300120100
88442243224300000
88453778234200143600
88463746233400141200
88473807239100141600
88483858240300145500
88493910238000153000
88503632235400127800
88513286207100121500
88520000000
89011226000122600
89023638222200141600
89033838237900145900
89043977243600154100
89053971243400153700
89063859238700147200
89073802234500145700
89084085252600155900
89094015253400148100
89104032249500153700
89114019248100153800
89123768229800147000
89133540215400138600
89144046248200156400
89154227262400160300
89163999259400140500
89174082252500155700
89183672223200144000
89194089254600154300
89204082253800154400
89214110254300156700
89224359268800167100
89234334266300167100
89244370267600169400
89254322265300166900
89264170260300156700
89274257262500163200
89284280258000170000
89294360267300168700
89304368265800171000
89312745274500000
89324060269100136900
89334384274300164100
89344417271800169900
89354626286300176300
8936350527730073200
89374487278000170700
89384674288600178800
89394675286800180700
89404728291200181600
89414788294400184400
89424916303700187900
89435005317900182600
89444841298800185300
89455131329500183600
89465037318900184800
89475020317400184600
89484965310800185700
89494999322200177700
89505068324500182300
89514593296800162500
89520000000
90013770248600128400
90024850313000172000
90034921314700177400
90044863309400176900
90054974317400180000
90065040325900178100
90074975321800175700
90084660293500172500
90095024321100181300
90105060331700174300
90115250341600183400
90125014320500180900
90135150328100186900
90145141330400183700
90154608294400166400
90164533287300166000
90175139327700186200
90184980321300176700
90195038333500170300
90205287335700193000
90214986322500176100
90225195336900182600
90235099329200180700
90245190331000188000
90255147332600182100
90265234342900180500
90275189344800174100
90285096324200185400
90295025321400181100
90304902313400176800
90314712300100171100
90324534292600160800
90334642305300158900
90344896318800170800
90354987326100172600
90364883317000171300
90374807315500165200
90384911324700166400
90393279327900000
90405148337100177700
90415193342900176400
90425269345900181000
90435171342900174200
90445202340300179900
90455427353100189600
90465473359700187600
90475453363600181700
90485460359400186600
90495501362700187400
90505427354700188000
90514908327300163500
90520000000
910114955980089700
91025088336100172700
91035292346600182600
91045513359700191600
91055343354700179600
91065346351500183100
91075557360800194900
91085366357500179100
91095490358100190900
91105520357800194200
91115341353000181100
91125455359200186300
91135230346800176200
91144958324500171300
91155423364300178000
91165716373400198200
91175633364400198900
91185409351500189400
91195289341800187100
91205875388600198900
91215506357600193000
91225549362100192800
91235692371500197700
91245815376100205400
91255747372800201900
91265627363800198900
91275744369600204800
91285670361100205900
91295660361000205000
91305609359900201000
91315564356800199600
91325315343800187700
91335044330100174300
91345196336300183300
91355379347000190900
91365587358000200700
91375842375800208400
91385768369500207300
91395900379600210400
91405859379300206600
91416054390700214700
91426102393100217100
91436115393400218100
91445935378800214700
91456133394100219200
91466052387000218200
91475956387700207900
91485964389100207300
91496145394800219700
91506020389600212400
91515605368500192000
91520000000
92010000000
92025688368100200700
92036007384100216600
92045969386200210700
92055968386100210700
92066031385300217800
92076048389200215600
92085959381000214900
92096027392200210500
92105946380400214200
92116006383300217300
92126056383200222400
92136003381100219200
92146039382000221900
92156130391700221300
92165701363400206700
92175489350400198500
92185726369300203300
92196070387200219800
92206178400000217800
92216034384600218800
92225940378300215700
92236108388200222600
92245851372700212400
92256331410000223100
92266211396300224800
92276273394200233100
92286486419900228700
92295879370200217700
92305765363300213200
92315810364600216400
92325513351400199900
92335457351700194000
92345413353400187900
92355768365700211100
92366051383900221200
92376029378400224500
92386095386500223000
92396088388800220000
92406270397100229900
92416330406200226800
92426434407400236000
92436525412900239600
92446358402500233300
92456554418000237400
92466539420700233200
92476475422100225400
92486501417200232900
92496519416700235200
92506452413200232000
92516257399300226400
92520000000
93015615355600205900
93026233397500225800
93036207400200220500
93046309410100220800
93056345406900227600
93066352406400228800
93076331407600225500
93086126397800214800
93096143394000220300
93106227398500224200
93116223399300223000
93126072391500215700
93136168393700223100
93145799372600207300
93155566355700200900
93166117388000223700
93176087384400224300
93186239400800223100
93196243398500225800
93205999376800223100
93216242395400228800
93226136391300222300
93236307402200228500
93246341402200231900
93256445405400239100
93266334398900234500
93276245391900232600
93286205384600235900
93296066376300230300
93305935370200223300
93315700363500206500
93325396343000196600
93335531354400198700
93345982374900223300
93356340393500240500
93366197384100235600
93376171388100229000
93386228393500229300
93396409401600239300
93406597411400248300
93416484412100236300
93426589415000243900
93436490409400239600
93446654415500249900
93456726418800253800
93466777420700257000
93476599414600245300
93486672417200250000
93496530404700248300
93506338399700234100
93510000000
93520000000
94015176336400181200
94026337397500236200
94036356397000238600
94046494403300246100
94056586407200251400
94066353400500234800
94076225390400232100
94086291390800238300
94096158387800228000
94106257392900232800
94116231392500230600
94126347394900239800
94135728358300214500
94145727357800214900
94156312391800239400
94166427398600244100
94176166380300236300
94186162383100233100
94195909366800224100
94206337389100244600
94216214387400234000
94226239387900236000
94236229385200237700
94246366391000245600
94256294389900239500
94266177378100239600
94276281382900245200
94286094368400241000
94295968356900239900
94305723351600220700
94315626348600214000
943256303442138020500138457221
94335703348117502047017557772498
943459913577185022290185607927109
943561703636186023480186647728107
94366190364714202401014228762774
94376471380016002511016036812986
943866163873223025200223818442115
94396450371222202516022281894183
944064773804223024500223788641108
944165343828227024790227848339147
944264713837236023980236848842148
944364293786183024600183428140146
944463903780225023850225787944159
9445652737812500249602501037846167
9446665438572640253302641048157148
9447656837742830251102831208457139
9448672237973000262503001239360159
94496399370429102404029110693621911
9450647737552870243502871258353197
94513081301566000660048180
9452000000000000
95015328351417601638017679523096
9502615835802320234602321037230189
9503628236212740238702741248937168
9504636236452910242602911259840208
9505688736652980292402981329342238
950662543576414022641262881261388044188
950762103452426023321362901361318945178
950862333444429023601372921371299244198
950962783497447023341522951521308743278
951062343449451023341722791721199035278
95116232339951202321184328184129369536248
95126263340553102327198333198125459538228
95136341337256902400202367202155518943227
95146373341259802363210388210176539134277
95155867316957202126226346226137449439257
95165838312357202143224348224136429541277
951764423436641023652613802538148579843268
95186097321262602259266360256101455410129238
95196316328969902328300399286141565510146329
9520650033507840236636242233032169729248347
9521627731978490223140144836140187749944368
9522641033227400234830943127435165649953419
9523635332318750224741745838037190749549419
9524644932268870233647541239184174598847377
95257926325296913152390504465426781967698464181315
952678953203994130623925204744437721574104423451306
9527782331901004126523645084964258320798100463961265
952874823004989121822715144754298519689103443491218
9529728927921073118422405455284489721992113534291184
95307333279911241173223760951549711222092110493681173
9531724328001070119521785834874859819687114463861195
9532702826781128120520176294995221071977796804271205
9533703526971143121919765855584909521887949651121219
953474632800127512322156685590548137223961009860131232
953576302850124812842248678570527151232641099757111284
953676742879126612932236653613530123262791011016191293
953776632815129013272231679611535144249951031005681327
953877872767137113132336730641579151253981031146581313
953979552818141313752349742671580162289921051136571375
9540809828681485146622798146716251892741081031314691466
9541802028651478141922588346446351992501041031215881419
9542812428661524144922858356896451902731181101265481449
9543824928811597148522868957026812142791131031455391485
95448005277015881383226492366568923424211910014351101383
954584342875162115142424944677731213278119831394991514
954683282845162615232334900726738162281128961595391523
954784732891173015462306100372774026330010710315651101546
95488682289318831557234910867978212653521289815752101557
954986812856193315202372116476988128329813910715461101520
9550838728011811153422411104707809295271125981475881534
95510000000000000000
95520000000000000000
96015203181811866141585639547476163243837186559614
960281232688173615702129108065682225825610910011959131570
96038053257317511587214211056468332722571049711165121587
96048271262018671627215712056629132922945910312469131627
960584922614208316412154132475998533930412210514768131641
960682052518205415512082129875697032828112511316658131551
9607835425012093168320771362731101135128411411314167121683
9608825724522186151621031413773105935432112510314467131516
9609835924542259153521111477782106341432812710814857141535
9610851624692334156421491500834108741336414310214762161564
9611865124452411162821671542869112042233517711416467121628
9612848023722328170920711543785113241130616412110575141709
9613843522952343173520621596747117342330813610412168101735
9614779519662283162319231549734118036928913710912068111623
961576651964228715711843160568212113942781271081075481571
9616816720602378172220071614764118143332213511011869101722
9617819520532414172720011632782119244030816410412373101727
961880822044236217361940158278011644183171661051156891736
9619832220092531180919731684847123744736216110911983131809
9620811919222479173319851672807122644633716410910582101733
9621830118432619179720421778841126451434419010610091101797
962278521830253915291954167586412004753591981021217681529
96238345184127181773201318139051298515365226971218791773
9624850718212831182120341911920136554636520910913394101821
96258791176730941839209120901004144364740624111513596111839
9626726533631809209321761187153464246625212513410112971809
9627713532541784209720901164145363743425812113699111051784
9628676331871605197120211166137065144425712314088141001605
962965823107158318922011109613946174312281101427713951583
963064413030156718441965106513296364222261101159014881567
963163273007159317271970103713626083902199712910112891593
963259462957164513441925103213216043852119512310616961645
9633600528291632154418121017124456836920310312410713981632
9634630930501611164819231127132559840022911315312013991611
96356455309016231742191311771342571422231123159125101071623
96366557309416781785186812261339529463224127167116101191678
96376970330618021862203212741434598509234116170111121221802
9638710334081853184221231285146560949521243119166106131171853
963970743413186517962187122615186185147624010917099141181865
964071733432188818532224120815056497045323811316394181291888
96417373355519511867231312421520661132445243117177107121411951
96427511361020031898231212981531667114482247113192102131492003
96437598371120101877239713141614663120476273101199106131462010
96447523372120151787241913021627675117491248107199100121452015
96457758390020331825255713431616785156489265114197103151602033
96467663379620471820248213141620728134483244109191107171632047
96477794387120571866251913521641750128534243114187103141572057
96487581377920591743243613431598705133543240103170105161662059
96497650382220651763246413581603723138521260113178105141672065
965077233847209217842456139115767451355022989919310212161692092
965172983604200016942338126615356891144742569216310211141542000
965215431543009995446692161142121086957980000
9701217313661536548065604632381052031104666394587153
97026902333719551610220811291458641109427197991299814111541955
9703719135491955168723361213151070012646821311514210217121441955
9704717736001949162823541246154468112947520811716710625111371949
97057300364619931661237812681569688121482246931581042491521993
9706742737082107161224161292157671312748525410315410121101642107
9707734736631997168723461317154768311648925711017310222121521997
97087415369521341586238713081554710123511245105159992491562134
9709747836562164165823601296152771312057124111217462391602164
971076063818213016582397142115567141275672571231809827101592130
97116155242621101619110113252897071055462821051167630131572110
97127335368220821571232313591493694136491326110165912681422082
9713700033832156146121241259136664910946425799155992571532156
9714673734741848141521581316142164196470273119171902791571848
971574633733214915812356137715297111164902731221931052691592149
971672263711201315022328138315147031115012821191861082681532013
97177190364520441501233313121504701128435289115182962881592044
97186745356020561129225413061455676123465271109172972781572056
971971383651202114662285136614706821334832951021801072891622021
972075133827210115852446138115597461414812891091921102491672101
972174183747211015612351139614897351275232731081871072391662110
9722749438632116151523931470154472712258428612218210726101532116
9723762439172150155724371480158574111154031012418510530181682150
9724743038192139147224231396156074811549829210318710129111752139
9725765240002091156124931507159976313150333712022410531151722091
9726772041222082151625571565167074714051238310623010530131862082
9727764140432069152925271516159379414052932911121210030171882069
9728739338892032147223881501152474312153531712620310027131802032
972972023777196114642340143714867331214823121151959827141941961
9730720238301959141324121418151177812348530010718010628151971959
9731706137931889137923611432149174112947032012017310930151951889
9732690737261880130123621364149274512545430111016511324121851880
9733661135051885122122031302137570812041029310615610830141851885
9734686136691911128122511418144968711545433712015611331131941911
9735695937491926128422551494147867110652431912917811231111901926
9736750340541998145124261628158370913457734913319911231132141998
9737749240861957144924541632159072913559034512420812131122011957
9738772841962107142525841612167677613256132812322212236112092107
9739755039942197135924181576159671610652532012121812631122232197
9740781841162305139724991617159976513554333012022712131152302305
9741794442822285137725521730161080413859236311924812431102432285
9742787142192280137225651654162380214058332811524211332122292280
9743793542992257137925831716164479214761136312324610729102272257
9744778942132203137325471666160479814558635811123910731112232203
9745799843772270135126181759164282015658538912427811233142242270
9746796843052300136325611744159382014862436012224811332122332300
9747794642692345133225181751153983214767735811823110731112182345
9748783942492353123725691680161080115861434512822511633112082353
9749813943812447131126431738162685416363638312720211135112332447
9750817143422512131725891753161381715958442212422110436122502512
9751534440750126924551620153077415154335911821510537122310
975226531867078610178506353325026415475118551881580
980123791804057510487566623236321714054121621661400
980271583646235111612254139214277031244492881161979535112012152199
9803794241032564127524911612159575114554436211220911536122222333231
9804796141612561123925561605158881115756733110822410534122242330231
9805795041672548123525271640155781115959136510521810534112112346202
9806797842062560121225661640159279917557235411521510737122282347213
9807785840732583120224521621150477017855434311921010740132352336247
9808803641242722119025331591152376624453335011722310035122212440282
9809788241222601115924711651150775720760634911020810736122232334267
9810824442592755123025201739149980221964737712522210637132122461294
9811824842572770122124951762151976720961042012722711038122182467303
9812790040272720115323981629146175518254235811722511937122192429291
9813800940742767116824151659148974917758035410323711638122192471296
9814791340012753115924591542149975720348534410623010938112192466287
981573813812251110582303150913797501745202961112169837132182230281
9816742238212566103523281493143272916752529810719111034122162281285
9817820942642801114426061658158481920358535311022212139112172490311
9818798941552747108725111644153677819756635112122111339112222442305
9819814441962906104225551641157876421355036411322011739122262561345
9820823842162886113625691647154781320958132113422311839142172550336
9821797741172769109125061611147281721757334410921311233122152455314
9822825542862852111726101676155184621359436711921311137122232503349
9823814944322604111326561776156388021363938112421811937122462349255
9824860545602945110026931867160887021567344412122011840112402606339
98258298423629731089270715291600884223590423113010639132452594379
9826832744332824107026991734157189323556737912224512338112492471353
9827843744842886106727371747161793318758037311426611737122482532354
982881854420282893726761744155690721358038311125512236112462496332
9829804943462649105426281718149691022256337612624211837112452360289
9830794043042587104925851719149787221659139512520511435112432303284
983177734214259696324731741145882818759638512521811540132492290306
983275144013261089123621651138180417758237111418611436112372306304
98337396400525598322393161214227831885543649919911033112422240319
983474503946269281223801566139580218353434810119211631112332292400
983578034259265389125661693149687619455138811122512340102452333320
9836836345012856100626971804158889621360341611523112838132602527329
9837788641362747100324391697143382418264733511021610332102442426321
98388504462928829932726190315939002337103971182671183192532539343
983982584412288196526211791156485620165038910725011631102382532349
984085124513301198827121801155190126060437911828112036132502626385
984185354522302898527001822149694525963236510829310439102712631397
984286564632305397127641868150696429465038511728411339102702653400
984386944621309997427411880150094130064340711528111241112702666433
984485064567298595427431824150994628862240010326711337112712574411
98458709458231779502748183415589252656403841062641193792752736441
984688254630324794827531877156390528569140410929211539112162783464
984789564692328897627641928159190027372041311328812937132152798490
984887844523330695527041819151588830161636011233012136122322806500
984990954758337196628481910157695032264144311530212438142332832539
985083614130332290922511879151642531062748411325511538132342807515
985185264419318292525991820143586529961943910924312039142372722460
985237522605508639136512407085031543523548717371166181395113
9853235219100442944966511345882583104511265176153
99014921366744381122561411127173325247826410020210941621134796
990281204327290488926051722148082330257836410325312740162412517387
990385154472315988426701802152083831262438711626012638122392727432
990484704385323185426701715147686732757637010524611338152522769462
990584714404321685126741730148486832255740510925310842152412742474
990686464491328786826811810148886033361337910827812840142502769518
990786764568326484427201848149989033169736611225711839102492758506
990885144445321785226181827145982633369037511124910636132472723494
990986784570326184727331837153087732663038810728110942142662765496
991086684531332181626281903144586032362141511232111344142632833488
991187894603337581126671936147985333563047911129211040122622847528
991285054371334978525951776145182332160138910925311937132552808541
99138179406133587602384167713237632985873619423810730102502803555
99147906410330597442361174213297782545873869624911241122592575484
991582174374305878526061768145084031658835211827411743132632554504
991685404464329977726931771149586932959236311526212144132612746553
991787034540337678726691871146685534860842611526712140142802789587
991886714436348275326241812145084433058240511227611043122722869613
991984774246346177024981748135280334357438110922912143142772831630
99208538454031968022686185414628603646224019327712940132792625571
992186564469340178625871882141684033165139611026813247112672755646
992289064716340178927341982150287535769144011427113745142702770631
992391404752360578327701982152885738567247610826912845132712911694
992492654807366579327182089149985236766756511327513037122902934731
9925908547283612745275419741484989336861749011029713142122752877735
99269135483135447602883194815454889939161345711828812639132942814730
99279147478936137452824196515004588939062646110927413343153042850763
99289046473635727382738199815044284035263047412027613441143092805767
99298685456734127062646192114364781534859448111526112939122902666746
99308752464734266792655199214395183233359848311527513639113352643783
99318416438833556732546184213556279833158843110824013438142892605750
99327961408633045712335175112426073629758241310121812436112662551753
9933809642503253593246217881329637553155774559920712640122722495758
99348466446533536482543192213778075533159049011324314142132902561792
99358898486533546792776208915059584133567351812828114141122952598756
99368527481030216962707210314938976635969053012526814038103022410611
99379103496434177222799216515008784037270652112531013640133142632785
993893845028364271429262102156311089435968148612632213839112992811831
993993614981366771329102071155312285637965349411231313843103082813854
994092924968362969528802088160211977438564950311432013045103172831798
994193885110360267630242086157512088444563451610531312140103472816786
99429662526437246743110215415951299294576505481053161284093582897827
994393314971368767329781993155613787640962849010628711934103192857830
99449014467536766632743193214171248173856044579429812636113062908768
994592924915369068728502065153213279039662950612232012041103172879811
99469488502937946652948208115601528364006234901293621204193072930864
994793794955375267229112044150315983141864648211230711941103272927825
994892694817378866426792138156110859541566954811631112442113172949839
994993664812391064426982114150918757442864256911528513839113153022888
995090494528387564625721956144818557436559449810226612937113193001874
99