software testing and qa- arc middleware
DESCRIPTION
Jozef Černák , [email protected] Marek Kočan, Martin Savko P. J. Safarik University in Kosice Slovak Republic. Software Testing and QA- ARC middleware. The software development process. Basic models Code and Fix model Waterfall model Spiral model Complex models - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Software Testing and QA- ARC middleware](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f60550346895daa2e97/html5/thumbnails/1.jpg)
Software Testing and QA- ARC middleware
Jozef Černák, [email protected]
Marek Kočan, Martin Savko
P. J. Safarik University in Kosice
Slovak Republic
![Page 2: Software Testing and QA- ARC middleware](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f60550346895daa2e97/html5/thumbnails/2.jpg)
The software development process
• Basic models– Code and Fix model – Waterfall model – Spiral model
• Complex models – Combination of basic models
![Page 3: Software Testing and QA- ARC middleware](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f60550346895daa2e97/html5/thumbnails/3.jpg)
Code-and-Fix model
nordugrid middleware –predecessor of ARC (2001-2006)
![Page 4: Software Testing and QA- ARC middleware](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f60550346895daa2e97/html5/thumbnails/4.jpg)
Waterfall model
![Page 5: Software Testing and QA- ARC middleware](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f60550346895daa2e97/html5/thumbnails/5.jpg)
Complex model
ARC middlewar (2006-2010)-project KnowARC http://www.knowarc.eu
![Page 6: Software Testing and QA- ARC middleware](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f60550346895daa2e97/html5/thumbnails/6.jpg)
Testing
• Each stage of development process could be tested
• Ideas, design by model analyzer for example Alloy project http://alloy.mit.edu/
• Development – unit tests, – build tests,– functional tests, performance
tests,interoperability tests – usability tests
![Page 7: Software Testing and QA- ARC middleware](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f60550346895daa2e97/html5/thumbnails/7.jpg)
Tests in KnowARC
• Testing started at coding stage
• Pieces of software -Unit tests (smal number of tests)
• Building binaries from sources was tested for each revision
• Functional tests were performed for any night builds
• Performace tests were performed only two two times during 3.5 years
• Usability test (one at the end of the project)
• Otcome of the Design stage was not be systematicaly tested
![Page 8: Software Testing and QA- ARC middleware](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f60550346895daa2e97/html5/thumbnails/8.jpg)
![Page 9: Software Testing and QA- ARC middleware](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f60550346895daa2e97/html5/thumbnails/9.jpg)
![Page 10: Software Testing and QA- ARC middleware](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f60550346895daa2e97/html5/thumbnails/10.jpg)
![Page 11: Software Testing and QA- ARC middleware](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f60550346895daa2e97/html5/thumbnails/11.jpg)
![Page 12: Software Testing and QA- ARC middleware](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f60550346895daa2e97/html5/thumbnails/12.jpg)
QA
• We concentrated to set up procedures for two main outcomes of the project: – software, – Deliverables.
• We have defined the proces for Relase management http://wiki.nordugrid.org/index.php/Release_management
• Testing (testing plan, metric).• Analyses of bug status.• We could not implement the best practices of QA due
to limited number of project participants many of them had many roles in the project.
![Page 13: Software Testing and QA- ARC middleware](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f60550346895daa2e97/html5/thumbnails/13.jpg)
Testing and bugfixing processes
![Page 14: Software Testing and QA- ARC middleware](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f60550346895daa2e97/html5/thumbnails/14.jpg)
What have we learned?• The most significant bugs were found during
performance tests (memory leak, scalability issues).• The new features of new releases were not right
defined in some cases. • The functional tests on bigger infrastructure
(operational tests) were not realised. Pilot Grid System (infrastructure of several servers 10) does not fulfil initial expectations.
• Testing in permanent stress due to accumulation of delays in previous activities (bug fixing of critical bugs).
• Small numbers of beta-testers• We were looking for other frameworks, for example
internal review of ETIC. • Our test framework is capable to detect many bugs
for many platforms Linux, MAC OS an Windows.
![Page 15: Software Testing and QA- ARC middleware](https://reader036.vdocuments.site/reader036/viewer/2022062518/56813f60550346895daa2e97/html5/thumbnails/15.jpg)
EMI TESTING
• Will all project use the same testing tools?• What is procedure to propose test cases?• Interoperability tests?• Usability tests?• Performance tests?