lta status - astron adriaan renting lofar status meeting 17 september 2014 astron is part of the...
TRANSCRIPT
![Page 1: LTA status - ASTRON Adriaan Renting Lofar Status Meeting 17 September 2014 ASTRON is part of the Netherlands Organisation for Scientific Research (NWO) 1 . Results 20 August – 17](https://reader036.vdocuments.site/reader036/viewer/2022063011/5fc4e7d0a182130f292c8f6d/html5/thumbnails/1.jpg)
Netherlands Institute for Radio Astronomy
LTA status
Adriaan Renting Lofar Status Meeting 17 September 2014
1 ASTRON is part of the Netherlands Organisation for Scientific Research (NWO)
![Page 2: LTA status - ASTRON Adriaan Renting Lofar Status Meeting 17 September 2014 ASTRON is part of the Netherlands Organisation for Scientific Research (NWO) 1 . Results 20 August – 17](https://reader036.vdocuments.site/reader036/viewer/2022063011/5fc4e7d0a182130f292c8f6d/html5/thumbnails/2.jpg)
Results 20 August – 17 September
2
Data transferred to the LTA: ±480 TB + transfers by EoR Data staged/retrieved from the LTA: 108 TB Total stored: 13.8 PB (3.4 Jülich/8.7 SARA/1.6 Target)
![Page 3: LTA status - ASTRON Adriaan Renting Lofar Status Meeting 17 September 2014 ASTRON is part of the Netherlands Organisation for Scientific Research (NWO) 1 . Results 20 August – 17](https://reader036.vdocuments.site/reader036/viewer/2022063011/5fc4e7d0a182130f292c8f6d/html5/thumbnails/3.jpg)
Uptime 20 August – 17 September
3
Big interruptions (several days to weeks): • None Various smaller issues (less than single day) • Stop days. • Network interrupts. • Software bugs. • Operational support errors. • Hardware/file system problems.
![Page 4: LTA status - ASTRON Adriaan Renting Lofar Status Meeting 17 September 2014 ASTRON is part of the Netherlands Organisation for Scientific Research (NWO) 1 . Results 20 August – 17](https://reader036.vdocuments.site/reader036/viewer/2022063011/5fc4e7d0a182130f292c8f6d/html5/thumbnails/4.jpg)
Work and plans
4
Ongoing: • Processing in the LTA: Imaging. (WK) • User Ingest. • Public release of LOFAR data. Implemented: • Improved monitoring. • Download server. (JK)
• Robustness (No more internal server error 500) • Speed (less internal copy buffers) • Speed (better server hardware) • Speed (more simultaneous connections) • Download resume function (see LTA Howto)
• GridFTP/SRM service Target/RuG. • Information page on how to install LOFAR software on clusters.
http://www.astron.nl/radio-observatory/lofar/lofar-tools/lofar-tools • Speed improvements (multiple ingest servers, database opt.).
![Page 5: LTA status - ASTRON Adriaan Renting Lofar Status Meeting 17 September 2014 ASTRON is part of the Netherlands Organisation for Scientific Research (NWO) 1 . Results 20 August – 17](https://reader036.vdocuments.site/reader036/viewer/2022063011/5fc4e7d0a182130f292c8f6d/html5/thumbnails/5.jpg)
Work and plans
5
Planned: • More speed improvements in ingest and download server. • More monitoring improvements. • Download server.
• Update the Jülich location. • Data transfer tool (ltacp) improvements. • GridFTP/SRM service Target/RuG improvements.
• Currently tape storage is not fully functional. • Not only EoR access to the stored data.
• More monitoring visible to users. Note: Advice on what to consider when building a cluster for Lofar data.