allure framework

Artem Koshelev

Allure framework

1

Selenium Conference, 4-6 Sept, Bangalore

2

Artem Koshelev

QA Team Lead @ Yandex

[email protected]

twitter: @art_koshelev

mailto:[email protected]

3 image source: flickr.com

4

Reports

image source: flickr.com

What is a good report?

5

Allure framework architecture

Demo


6

Good reports…


7

Good report - speed and precision


8

Unit-tests

9

API-tests

10

Web-tests

11

Good report - contains all required data


12

Good report - same, but different


13

You have no time


Allure framework


15

Step-based


16

Cross-language

17

Easy integration


18

http://bit.ly/allure-demo-report

19

Allure architecture


20

Adapter

21

Model

Adapter

22

Model

Adapter Report

23

Model

24

Step 0: use xUnit model

image source: blog.cloudbees.com

25

Standard xUnit model

26


test suite (test class)

27


test suite (test class)

test case (test method)

28

<?xml version="1.0" encoding="UTF-‐8" ?> !<testsuite tests="1" failures="0" name= "ru.yandex.qatools.allure.junit.example.SearchTest" time="27.084" errors="0" skipped="0"> ! <testcase classname= "ru.yandex.qatools.allure.junit.example.SearchTest" name="seleniumConfSearch" time="27.084"/> !</testsuite>


29



30



31



32

Step 1: simplify and enrich


33


Standart xUnit model

34

Test case status

35

Test case start/stop time


36

<ns2:test-‐suite xmlns:ns2="urn:model.allure.qatools.yandex.ru" start="1408112244726" stop="1408112247426" version="1.4.0.RC9"> <name>ru.yandex.qatools.allure.junit.example.SearchTest</name> <test-‐cases> <test-‐case start="1408112244737" stop="1408112247287" status="passed"> <name>seleniumConfSearch</name> <steps/> <attachments/> <labels/> </test-‐case> </test-‐cases> <labels> <label name="framework" value="JUnit"/> <label name="language" value="JAVA"/> </labels> </ns2:test-‐suite>

Allure model

37

! <test-‐case start="1408112244737" stop="1408112247287" status="passed"> <name>seleniumConfSearch</name> <steps/> <attachments/> <labels/> </test-‐case>

Allure model

38

Step 2: attachments


39

…?

Step 2: attachments

40

Step 3: steps


41

Steps == test scenario

image source: xkcd.com

Nested steps42


43

Step status

44

Step attachments


45

Step 4: labels


47

features


48

features

stories


49

xUnit + raw data +

attachments + steps + labels

= Allure model

image source: blog.cloudbees.com

50

Model

51

Model

Adapter

52

Step 1: language APIs

53

PyUnit

TestNg

Step 2: framework adapters

54

Model

Adapter

55

Model

Adapter Report

56

Allure model - raw data<ns2:test-‐suite xmlns:ns2="urn:model.allure.qatools.yandex.ru" start="1408112244726" stop="1408112247426" version="1.4.0.RC9"> <name>ru.yandex.qatools.allure.junit.example.SearchTest</name> <test-‐cases> <test-‐case start="1408112244737" stop="1408112247287" status="passed"> <name>seleniumConfSearch</name> <steps/> <attachments/> <labels/> </test-‐case> </test-‐cases> <labels> <label name="framework" value="JUnit"/> <label name="language" value="JAVA"/> </labels> </ns2:test-‐suite>

57

Step 1: model data processing

image source: wikipedia.org

58

Step 2: build html-report

59

Allure report builder plugins

60

Allure architecture

61

xUnit

Allure architecture

62

Adapter

xUnit

Allure architecture

63

Adapter

ModelxUnit

Allure architecture

64

Adapter

ModelxUnit

Data generator

Allure architecture

65

Adapter

ModelxUnit

Data generator

Report

Allure architecture

66

Allure in action


Artem Koshelev

http://allure.qatools.ru

67

Selenium Conference, 4-6 Sept, Bangalore

[email protected]: @art_koshelev

mailto:[email protected]

allure framework

Software

allure modelimage source

precisionimage source

differentimage source

enrichimage source

stepsimage source

labelsimage source

action66image source

time13image source