how russian users respond to internet advertising · the iab russia better ads committee...

HOW RUSSIAN USERS RESPOND TO INTERNET ADVERTISINGRESEARCH STUDY

December 2017

IAB RUSSIA BETTER ADS COMMITTEE

2

copy 2017 IAB Russia

CONTENTSBACKGROUND RESEARCH __________________________________________________ 3

GOAL AND OBJECTIVES OF THE STUDY _______________________________________ 4

RESEARCH METHODOLOGY _________________________________________________ 5

OVERALL CONCLUSIONS ___________________________________________________ 10

RESULTS FOR DESKTOP FORMAT ___________________________________________ 15

RESULTS BY MOBILE FORMATS _____________________________________________ 22

APPENDIX 1 CASE STUDYING THE ADDITION OF A NEW FORMAT ________________ 29

APPENDIX 2 DESKTOP AD FORMATS INCLUDED IN THE STUDY __________________ 32

APPENDIX 3 MOBILE AD FORMATS INCLUDED IN THE STUDY ____________________ 39

APPENDIX 4 QUESTIONNAIRE ______________________________________________ 48

CONTACTS _______________________________________________________________ 57

3


BACKGROUNDIn Russia ad blockers are growing rapidly in popularity People install ad blockers because ads annoy them However not all ads are created equal some formats annoy or disrupt people more than others

If you dont want users to take a slash-and-burn approach to all internet advertising you must avoid using formats that annoy them By implementing our advice on how to use engaging ad formats you can improve the user experience and minimize market loss

For Western countries the list of formats to avoid for internet advertising was prepared by the Coalition for Better Ads

The IAB Russia Better Ads Committee commissioned this study which was led from October-November 2017 The aim was to improve how Russian users relate to advertising and develop a set of Russian recommendations for producing high-quality internet ads

Detailed information about the IAB Russia Better Ads Committee is published on their official page httpsiabrusrucommitteesworkgroup160

4


GOAL OF THE STUDYTo create a rating system for desktop and mobile internet-advertising formats that will inform the Russian recommendations for producing high-quality internet ads

OBJECTIVESCompare ad formats and put together ratings for desktop and for mobile options

Evaluate the following factors for the most common desktop and mobile ad formats

bull To what extent does the format annoy the user

bull To what extent does the format disrupt the user

bull How does the format affect the advertised products credibility

bull How does the format affect how the page is perceived

5


RESEARCH METHODOLOGY DESCRIPTION OF APPROACHIn real life users do not interact with advertising in isolation but rather confront it on sites they found by searching for content So for the purposes of this study special content web pages were created where respondents were served ads in the formats being tested

For content we used 350-400-word fragments of short stories by Arkady Averchenko The ad blocks served users ads for upholstered furniture We chose furniture because it is a gender-neutral advertising subject and people search for it frequently

Every respondent evaluated four web pages One page served as the control (ie it had the content but no advertising) Each of the other three pages contained ads in one of the formats being studied Furthermore each respondent exclusively evaluated either desktop or mobile pages After they looked over each individual page respondents answered a series of questions about their impressions of the page and the ads served on it

In the course of the study 47 internet-advertising formats were evaluated 25 for desktop and 22 for mobile

The lists of formats for the study were put together based on those that are used most prevalently in the Russian market This was undertaken in collaboration with members of the IAB Russia Better Ads Committee Exhaustive lists of formats used are found in the appendices This methodology let us add new formats to the rating

6


RESEARCH METHODOLOGY COMPILING THE RATINGTo create a format rating based on acceptability each respondent was asked to select the best and worst format of the three that they saw

Question 12 Which ad format was least acceptable

Question 13 Which ad format was most acceptable

For example respondents evaluated formats A B and C If they said that format A was most acceptable and C mdash least acceptable then A won over B and B won over C

All data about winning and losing formats were processed using the Bradley-Terry Models in R (The BradleyTerry2Package Heather Turner David Firth 2017) which calculated the success of each format This indicator formed the basis for the rating The worst format got a value of 0 and the most successful mdash 5

А - the best

В

С - the worst

А gt В

В gt С

7


RESEARCH METHODOLOGY FORMAT SCORINGIn addition to compiling a format rating each format was evaluated individually for the following how seriously the format annoys or disrupts the user how it impacts their perception of the page and how it affects the credibility of the advertised product

When respondents finished viewing a page containing content and ads they answered four questions

bull Share your overall impressions about the page containing text (Possible answers very bad page bad page average page good page great page)

bull Did the ad inspire trust in the advertised product (Yes no hard to say)

bull How annoying was the ad (Not at all annoying slightly annoying moderately annoying seriously annoying extremely annoying)

bull How disruptive was the ad (Not disruptive at all a little disruptive noticeably disruptive seriously disruptive extremely disruptive)

The questionnaire can be found in Appendix 4

8


DESKTOPTARGET AUDIENCE SAMPLING GEOGRAPHYTARGET AUDIENCEResidents of Russia between 18-45 years old who use a desktop computer or notebook to access the internet

GEOGRAPHIC AREA OF STUDYSample audience based on quotas for gender age and size of geographic area (cities with more than 100000 residents)

Data was weighted by gender age and size of geographic area

DATA COLLECTION METHODOLOGYAn online survey involving the Tiburon Research panel

Data collection consisted of two stages

bull A survey of 24 ad formats and the building of a rating system (N = 2603)

bull A survey of the new video format with increasing sound id26 (N = 331)

STRATA NUMBER OF RESPONDENTS

Moscow 473

Other cities with 1M+ residents (including Saint Petersburg) 781

Cities with 500Kndash999K pop 510



Total 2934

9


MOBILE TARGET AUDIENCE SAMPLING GEOGRAPHYTARGET AUDIENCE Residents of Russia between 18 years old who use an Android mobile device to access the internet


Sampling data was weighted by gender age and size of geographic area



Moscow 529





Total 3116

10


OVERALL CONCLUSIONS

11


OVERALL CONCLUSIONSbull Most users (60) agree that online advertising can be useful

bull Users offered mixed ratings of the various ad formats Some formats annoyed users more than others

bull Mobile formats tend to annoy users to a similar extent whereas there was a broader range of annoyance in response to desktop formats Additionally ads on mobile devices annoy users more overall than ads on desktops do

bull Youth between 18ndash24 were more annoyed by ads

bull The study was not able to demonstrate how ad formats influence product credibility

bull More often than not ads negatively affect the users perception of the page We were not able to determine any connection between a users impression of a webpage and the format of the ads served on it

bull Among both desktop and mobile ad-formats the following were rated in the lower half

bull Those that automatically launch a video with sound

bull Those with a backward countdown until the Close button appears

bull Those that partially or fully cover the content

12


SIXTY PERCENT OF USERS AGREE THAT ONLINE ADVERTISING CAN BE USEFUL

Online advertising can be useful

Please indicate the extent to which you agree or disagree with the following statements Online advertising can be usefulPoll of those using a desktop computer or notebook to access the internet

of total users surveyed N = 2934

4 9 28 35 25

1- Completely disagree 2 3 4 5 - Completely agree

13


ADS ON MOBILE DEVICES ANNOY AND DISRUPT USERS MORE THAN ADS ON DESKTOPS DO

HOW ANNOYING WAS THE AD DESKTOP MOBILE

Average based on a scale across all formats 245 280

Average percent of users who found ads annoying 22 31

HOW DISRUPTIVE WAS THE AD DESKTOP MOBILE



Average and percent value of all answers Desktop N = 8897 Mobile N = 8680Red indicates statistically significant differences

How annoying was the ad (based on a 5-point scale)1 mdash not annoying 2 mdash a bit annoying 3 mdash moderately annoying 4 mdash seriously annoying 5 mdash extremely annoying

How disruptive was the ad (based on a 5-point scale)1 mdash not disruptive at all 2 mdash a little disruptive 3 mdash noticeably disruptive 4 mdash seriously disruptive 5 mdash extremely disruptive

Those who answered that ads were extremely annoyingdisruptive (5) or seriously annoyingdisruptive (4)

14


YOUNG AUDIENCES HAVE A MORE NEGATIVE ATTITUDE TOWARDS ADS

DESKTOP 18mdash24 years old 25mdash34 years old 35mdash45 years old

Annoying (average) 265 242 236

Disruptive (average) 249 227 221

MOBILE 18mdash24 years old 25mdash34 years old 35mdash45 years old






15


RESULTS FOR DESKTOP FORMATS

16


DESKTOP FORMAT RATINGS CONCLUSIONSFive worst desktop ad-formats by rating

bull Fullscreen prestitial banner ads with a countdown to the close buttonbull Popups with a countdown to the cross buttonbull Videos that display before the content and launch with soundbull Videos embedded within the content that play sound when the cursor hovers on thembull Sticky ads at the top of the page that dont close

The most preferable formats banners and teasers in columns on the right and ads in the background

Factors that negatively impact the users ad experience

bull Countdowns for popups and full-screen formats timers negatively impact the users perception of the format (options with a timers received the lowest rating)

bull Sound that launches automatically for video formats

bull Video formats that launch with sound are less acceptable than those where sound launches by clickbull Videos with sound that starts instantaneously when the cursor hovers over them got a lower rating than videos with sound that increases

17


DESKTOP FORMAT RATINGSID FORMAT NAME POSITIONS RATING SCORE24 Small static banners in the right column 1 mdash the best 502 Takeover ads static 2 4617 Static sticky ad right-side column 3 4218 Static sticky teaser block right-side column 4 421 Takeover ads sticky 5 417 Static teaser blocks after content 6 393 Static banners on the right side 7 354 Two static banners along the sides 8 345 Static teaser block above content 9 3222 Top outstream video ad with on-click sound 10 3220 Autoplaying reflowing video wo sound 11 3112 Left-bottom sticky ad 12 3025 Medium-sized static banner inside content animated 100 13 2913 Bottom sticky ad 100x800px 14 286 Static teaser block inside content 15 2519 Static sticky teaser blocks both sides (four teasers) 16 248 Fullscreen prestitial banner wo countdown 17 2326 Outstream video ad with on-hover slow sound inside content 18 2214 Bottom sticky ad 250px full width 19 2111 Popup wo countdown 20 1616 Top-sticky ad 200px height full width 21 1423 Outstream video ad with on-hover sound inside content 22 1121 Outstream video ad with autosound muteable 23 0910 Popup with countdown 24 099 Fullscreen prestitial with countdown (7 seconds) 25 mdash the worst 00

Value calculated using the Bradley-Terry model

0 mdash worst format 5 mdash best format

18


HOW ANNOYING WAS THE AD DESKTOP568

79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728

5 mdash extremely annoying 4 mdash seriously annoying 3 mdash moderately annoying 2 mdash slightly annoying 1 mdash not annoying at all

The most annoying

The most annoying

The most annoying

Small static banners in the right column N=263Takeover ads static N=546

Static sticky ad right-side N=228Static sticky teaser block right-side column N=220

Takeover ads sticky N=262Static teaser block after content N=307Static banners on the right side N=200

Two static banners along the sides N=294Static teaser block above content N=365

Top outstream video ad with on-click sound N=307Autoplaying reflowing video wo sound N=521

Left-bottom sticky ad N=381Middle static banner inside content animated N=280

Bottom sticky ad 353x800px N=353Static teaser block inside content N=379

Static sticky teaser blocks both sides (four teasers) N=467Fullscreen prestitial wo countdown N=367

Outstream video ad with on-hover slow sound inside content N=118Bottom sticky ad 547px full width N=547

Popup wo countdown N=537Top-sticky ad 409 px height full width N=409

Outstream video ad with on-hover sound inside content N=371Outstream video ad with autosound muteable N=446

Popup with countdown N=370Fullscreen prestitial with 7-sec countdown before close button N=357

Percentage of those who answered that the format was extremely annoying or seriously annoying was higher than the average for all formats (higher than 22)Statistically significant differences

of answers by format

19


HOW DISRUPTIVE WAS THE AD DESKTOP

Percentage of those who answered that the format was extremely disruptive or seriously disruptive was higher than the average for all formats (higher than 20)Statistically significant differences


5 mdash extremely disruptive 4 mdash seriously disruptive 3 mdash noticeably disruptive 2 mdash a little disruptive 1 mdash not at all disruptive

Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20


DID THE AD INSPIRE TRUST IN THE ADVERTISED PRODUCT DESKTOP


2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21


PLEASE SHARE YOUR OVERALL IMPRESSIONS ABOUT THE PAGE CONTAINING TEXT DESKTOP

1 mdash very bad page 2 mdash bad page 3 mdash average page 4 mdash good page 5 mdash great page

3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211

Page with no ads N = 2934














22


RESULTS BY MOBILE FORMATS

23


MOBILE FORMAT RATINGSFive worst mobile ad-formats by rating

bull Fullscreen postitial banner ads with a countdown to the close button

bull Fullscreen prestitial banner ads with a countdown to the close button

bull Videos embedded within the content that play sound when they launch

bull Fullscreen postitial banner ads with a close button

bull Fullscreen prestitial banner ads with auto-close

Overall the least acceptable formats for mobile ads were the options that completely cover over content

The most preferable formats were narrow sticky banners at the bottom of pages and banners that were not very tall before and after content

As with the desktop results the user experience is negatively affected when there are timers counting down to when the ad can be closed and sound launches automatically

24


MOBILE FORMAT RATINGSID FORMAT NAME POSITIONS RATING SCORE16 Sticky-bottom 95 width 50px height not closeable 1 mdash the best 5021 Static block below content 50 screen size 2 431 Static block above content 50 screen size 3 415 Static blocks 30 4 4114 Sticky-bottom 95 width 100px height closeable 5 383 Static block inside content 50 screen size 6 374 Static block inside content 80 screen size 7 372 Static banners before content 80 8 379 Static teaser block within content 80 screen 9 3415 Sticky-bottom 95 width 240px height closeable 10 337 Large static blocks 70 total density 11 296 Static blocks 70 total density 12 2310 Fullscreen prestitial wo countdown 13 188 Static block inside content 100 screen size 14 1813 Popup wo countdown 15 1820 Autoplaying video-ad inside content without sound 16 1122 Fullscreen scroll-over 17 1011 Fullscreen prestitial auto close countdown 18 0418 Postitial ads wo countdown 19 0319 Autoplaying video ad inside content with sound mutable 20 0312 Fullscreen prestitial with countdown (7 seconds) 21 0217 Postitial Ads with Countdown 7 sec 25 mdash the worst 00


0 mdash worst format

5 mdash best format

25


HOW ANNOYING WAS THE AD MOBILE

Percentage of those who answered that the format was very seriously annoying or seriously annoying was higher than the average for all formats (31)Statistically significant differences



13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying

Sticky-bottom 95 width 50px height not closeable N=224

Static block below content 50 screen size N=523

Static block above content 50 screen size N=333

Static blocks 30 N=255

Sticky-bottom 95 width 100px height closeable N=269

Static block inside content 50 screen size N=270



Static teaser block 80 inside content N=329


Large static blocks 70 total density N=460


Fullscreen prestitial wo countdown N=820


Popup wo countdown N=439

Autoplaying video-ad inside content without sound N=235

Fullscreen scroll-over N=168

Fullscreen prestitial auto close countdown N=389

Postitial ads wo countdown N=423

Autoplaying video ad inside content with sound mutable N=228

Fullscreen prestitial with 7-sec countdown before close button N=621

Postitial Ads with Countdown 7 sec N=682

26


HOW DISRUPTIVE WAS THE AD MOBILE

Percentage of those who answered that the format was extremely disruptive or seriously disruptive was higher than the average for all formats (29)Statistically significant differences


5 mdash extremely disruptive 4 mdash seriously disruptive 3 mdash noticeably disruptive 2 mdash a little disruptive 1 mdash not at all disruptive Most disruptive

Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27


DID THE AD INSPIRE TRUST IN THE ADVERTISED PRODUCT MOBILE

of answers by format Yes No Hard to say

23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28


PLEASE SHARE YOUR OVERALL IMPRESSIONS ABOUT THE PAGE CONTAINING TEXT MOBILE

1 mdash very bad page 2 mdash bad page 3 mdash Average page 4 mdash good page 5 mdash great page

4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111


Sticky-bottom 95 width 50px height not closeable N=224Static block below content 50 screen size N=523Static block above content 50 screen size N=333

Static blocks 30 N=255Sticky-bottom 95 width 100px height closeable N=269

Static block inside content 50 screen size N=270Static block inside content 80 screen size N=255Static block above content 80 screen size N=255

Static teaser block 80 inside content N=329Sticky-bottom 95 width 240px height closeable N=412

Large static blocks 70 total density N=460Static blocks 70 N=462

Fullscreen prestitial wo countdown N=820Static block inside content 100 screen size N=627

Popup wo countdown N=439Autoplaying video-ad inside content without sound N=235

Fullscreen scroll-over N=168Fullscreen prestitial auto close countdown N=389

Postitial ads wo countdown N=423Autoplaying video ad inside content with sound mutable N=228

Fullscreen prestitial with 7-sec countdown before close button N=621Postitial Ads with Countdown 7 sec N=682


29


CASE STUDYING THE ADDITION OF A NEW

DESKTOP FORMAT TO THE RATING

APPENDIX 1

30


DESCRIPTION OF CASE AND CONCLUSIONSAfter we had already put the rating together we had to add a new format videos located within content with increasing sound that are launched when the cursor hovers over them (id26)

Videos with different parameters for sound activation occupy very different places in the rating If the sound activates by click (id22) this annoys users less than if the sound activates by hovering the cursor over the ad (id23) We hypothesized that if the sound increased gradually with the second format that format would annoy users less

The studys results show that this improved option did indeed occupy a higher position in the rating than the initial version of the video (18th position for id26 vs 22nd position for id23) Users also indicated that the improved option was less disruptive

31


EVALUATION RESULTS FOR THE IMPROVED VIDEO FORMAT

Video formats with sound that gradually increases are not as disruptive to users as videos that activate sound instantaneously

Users rated videos with sound that gradually increases as more acceptable

of answers by format Formats that occupied 14th through 25th place are displayed

6

13

9

12

16

18

46

32

23

26

Outstream video ad withon-hover slow soundinside content N=118

Outstream video ad withon-hover sound

inside content N=118

5 mdash extremely disruptive 4 mdash seriously disruptive3 mdash noticeably disruptive 2 mdash a little disruptive1 mdash not at all disruptive

ID FORMAT NAME POSITIONS RATING SCORE

13 Bottom sticky ad 100 times 800px 14 28

6 Static teaser block inside content 15 25

19 Static sticky teaser blocks both sides (four teasers) 16 24

8 Fullscreen prestitial banner wo countdown 17 23

26 Outstream video ad with on-hover slow sound inside content

18 22

14 Bottom sticky ad 250px full width 19 21

11 Popup wo countdown 20 16

16 Top-sticky ad 200px height full width 21 14

23 Outstream video ad with on-hover sound inside content

22 11

21 Outstream video ad with autosound muteable 23 09

10 Popup without countdown 24 09

9 Fullscreen prestitial with countdown (7 seconds) 25 - the worst 09

32


DESKTOP FORMATS INCLUDED IN THE STUDY

APPENDIX 2

33


ID FORMAT NAME DESCRIPTION

1 Takeover ads sticky A static image in the background of the site When you scroll it follows along to the sides of the content It takes up 250 px above the content

2 Takeover ads static A static image in the background of the site When you scroll it follows along to the sides of the content It takes up 250 px above the content

3 Static banners on the right side One static banner in the right column without animation Size 300 times 300 pixels

4 Two static banners along the sides Two static banners along the sides of the main content no animation each 300 times 600 px

5 Static teaser block above content A teaser block (direct) before the main content 3 static creatives Overall block size 850 times 320 px The size of each creative is 280 times 315 px

6 Static teaser block inside content Teasers block (direct) inside the main content 3 static creatives Overall block size 850 times 320 px The size of each creative is 280 times 315 px

7 Static teaser blocks after content Teasers block (direct) after the main content 3 static creatives Overall block size 850 times 320 px The size of each creative is 280 times 315 px

8Fullscreen prestitial banner wo countdown

Static ad block covering the full screen that appears immediately after the page loads The close button appears immediately The cross radius is 15-20 px

9Fullscreen prestitial with countdown (7 seconds)

Static ad block covering the full screen that appears immediately after the page loads The close button appears after 7 seconds (after a countdown)The cross radius is 15-20 px

10 Popup without countdown Popup in the center cross to close the ad appears after 7 seconds size is 600 times 450 px scales up to 50 of the screen width The cross radius is 15-20 px

11 Popup wo countdown Popup in the center cross to close the ad appears immediately size is 600 times 450 px scales up to 50 of the screen width The cross radius is 15-20 px

12 Left-bottom sticky ad Small sticky popup at the bottom of the screen to the left It doesnt close and doesnt block content Size 300 times 300 pixels

13 Bottom sticky ad 100 times 800px Narrow sticky block at the bottom of the page no animation closeable Size 800 times 100 px Radius of cross 15mdash20 px

34



14 Bottom sticky ad 250px full width Large sticky banner at the bottom of the page no animation closeable Size of banner 600 times 250 px Spans entire width of screen The cross radius is 15-20 px

16Top-sticky ad 200px heightfull width

Wide sticky block at the top that spans the full screen width Not closeable Size 100 of screen width 200 px in height

17 Static sticky ad right-side column Large sticky banner on the right no animation no content covering Size 300 times 600 px

18Static sticky teaser blockright-side column

Sticky teaser block to the right no animation no content covering Block size 300 times 600 px The size of each creative is 300 times 295 px

19Static sticky teaser blocksboth sides (four teasers)

Two sticky teaser blocks to the right and left no animation no content covering 2 teasers in each column Size 240 times 400 px

20Autoplaying reflowingvideo wo sound

Video ads after content (sound launches when cursor hovers over video) Size 550 times 310 px

21Outstream video ad with autosoundmuteable

Separate ad blocks with video ads before the content (but after the menu) Size 550 times 310 px Sound plays automatically after the ad is launchedUsers can mute the sound by clicking the icon in the lower-right corner of the videoclip

22Top outstream video adwith on-click sound

Separate ad block with a video ad before the menu Size 550 times 310 px The user must click on the video area to hear soundThe sound icon is in the lower-right corner

23Outstream video ad withon-hover sound inside content

Separate ad block with a video ad inside the content Size 550 times 310 px The user must hover their mouse on the video area to hear soundThe sound icon is in the lower-right corner

24Small static bannersin the right column One static banner in the right column without animation Size 240 times 400 px

25Medium-sized static banner insidecontent animated 100 One medium-sized animated banner inside content Spans the full width of the content Size 300 px in height

26Outstream video ad with on-hoverslow sound inside content

Separate ad block with a video ad inside the content Size 550 times 310 px The user must hover their mouse on the video area to hear soundThe volume increases The sound icon is in the lower-right corner

35


httpsodnacobro-adsadvertstatictheme=background-fill-sticky

httpsodnacobro-adsadvertstatictheme=aside-all

httpsodnacobro-adsadvertstatictheme=background

httpsodnacobro-adsadvertstatictheme=direct-before

httpsodnacobro-adsadvertstatictheme=aside-right

httpsodnacobro-adsadvertstatictheme=direct-content

id1

id4

id2

id5

id3

id6

36


httpsodnacobro-adsadvertstatictheme=direct-after

httpsodnacobro-adsadvertpopuptheme=middleampclose=hideamptimer=7

httpsodnacobro-adsadvertpopuptheme=full-screenampclose=yes

httpsodnacobro-adsadvertpopuptheme=middleampclose=yes

httpsodnacobro-adsadvertpopuptheme=full-screenampclose=hideamptimer=7

httpsodnacobro-adsadvertstickytheme=bottom-left

id7

id10

id8

id11

id9

id12

37


httpsodnacobro-adsadvertstickytheme=bottom-middleampclose=yes

httpsodnacobro-adsadvertstickytheme=right

httpsodnacobro-adsadvertstickytheme=bottom-paranjaampclose=yes

httpsodnacobro-adsadvertstickytheme=rightamptisers=1

httpsodnacobro-adsadvertstickytheme=topampclose=yes

httpsodnacobro-adsadvertstickytheme=aside-allampsticky=1amptype=1

id13

id17

id14

id18

id16

id19

38


httpsodnacobro-adsadvertvideoaspect=authorampsound=hover

httpsodnacobro-adsadvertvideoaspect=textampsound=hover

httpsodnacobro-adsadvertvideo

httpsodnacobro-adsadvertstatictheme=aside-right-small httpsodnacobro-adsadvertstatictheme=animate-banner-content

httpsodnacobro-adsadvertvideoaspect=topampsound=off

httpsodnacobro-adsadvertvideoaspect=textampsound=hoverampvolume=rising

id20

id23

id21

id24 id25

id22

id26

39


MOBILE AD FORMATS INCLUDED IN THE STUDY

APPENDIX 3

40



1Static block above content50 screen size

One ad block above content that takes up 50 of the screen height and 95-98 of the content width

2 Static banners before content 80 One ad block above content that takes up 80 of the screen height and 95-98 of the content width

3 Static block inside content50 screen size One ad block inside content that takes up 50 of the screen height and 95-98 of the content width

4 Static block inside content80 screen size

One ad block inside content that takes up 80 of the screen height and 95-98 of the content width

5 Static blocks 30 Ad blocks that take up 30 of the screen height and 95-98 of the content width (for example 320 times 11 px) total size equals 30 of the content One of the blocks in the article is motion

6 Static blocks 70 total density Ad blocks that take up 30 of the screen height and 95-98 of the content width (for example 320 times 100 px) total size equals 70 of the content One of the blocks in the article is motion

7 Large static blocks70 total density

Ad blocks that take up 50 of the screen height and 95-98 of the content width total size equals 70 of the content One of the blocks in the article is motion


Large ad block that takes up 100 of the screen height and 95-98 of the content width Breaks up the content

9 Static teaser block within content80 screen

Several ad blocks that take up 80 of the screen height and 95-98 of the content width Breaks up the content

10 Fullscreen prestitial wo countdown Fullscreen banner without animation appears immediately after page loads close button appears immediately

11 Fullscreen prestitialauto close countdown

Fullscreen banner without animation appears immediately after page loads banner closes automatically after animated countdown

41



12 Fullscreen prestitial with countdown 7 sec Fullscreen banner without animation appears immediately after page loads close button appears after animated countdown

13 Popup wo countdown Popup without a timer close button appears immediately Size 320 times 320 pixels

14 Sticky-bottom 95 width100px height closeabl Sticky-bottom banner no animation 95 width 100 px in height Closeable


16Sticky-bottom 95 width50px height not closeabl

Sticky-bottom banner no animation 100 width 50 px in height Not closeable

17 Postitial Ads with Countdown 7 sec Fullscreen banner appears after user spends 10 seconds on site No animation Seven-second countdown at upper-right followed by close button

18 Postitial ads wo countdown Fullscreen banner appears after user spends 10 seconds on site No animation Close button appears immediately in upper-right corner

19Autoplaying video ad insidecontent with sound mutable

Block with video ad inside content Sound enables automatically option to turn sound off by clicking icon in lower-right corner

20Autoplaying video-ad inside content without sound

Block with video ad inside article Sound disabled option to turn sound on by clicking icon in lower-right corner

21Static block below content50 screen size

Block following content 95 and 50 of screen

22 Fullscreen scroll-over Fullscreen banner that scrolls down gradually as the user moves down the page and then also moves up the screen Takes up 100 of the screen

42


httpsodnacobro-adsadvertstatictheme=before-contentampsize=50 httpsodnacobro-adsadvertstatictheme=before-contentampsize=80 httpsodnacobro-adsadvertstatictheme=inside-contentampsize=50 httpsodnacobro-adsadvertstatictheme=inside-contentampsize=80

id1 id2 id3 id4

43


httpsodnacobro-adsadvertstatictheme=inside-contentampsize=30ampmotion=yes httpsodnacobro-adsadvertstatictheme=inside-content|inside-contentampsize=30|30ampmotion=yes httpsodnacobro-adsadvertstatictheme=inside-content|inside-contentampsize=50|50ampmotion=yes httpsodnacobro-adsadvertstatictheme=inside-content-full-screen

id5 id6 id7 id8

44


httpsodnacobro-adsadvertstatictheme=inside-content|inside-contentampsize=80|80 httpsodnacobro-adsadvertprerolltheme=prerollampclose=yes httpsodnacobro-adsadvertprerolltheme=prerollamptimer=7ampautoclose=yes httpsodnacobro-adsadvertprerolltheme=prerollamptimer=7ampclose=no

id9 id10 id11 id12

45


httpsodnacobro-adsadvertprerolltheme=popup-topampclose=yes httpsodnacobro-adsadvertprerolltheme=sticky-bottomampclose=yes httpsodnacobro-adsadvertprerolltheme=sticky-bottom-biggerampclose=yes httpsodnacobro-adsadvertprerolltheme=sticky-bottom-small

id13 id14 id15 id16

46


httpsodnacobro-adsadvertprerolltheme=prerollamptimer=7ampclose=noampdelay=10 httpsodnacobro-adsadvertprerolltheme=prerollampclose=yesampdelay=10 httpsodnacobro-adsadvertvideo httpsodnacobro-adsadvertvideosound=off

id17 id18 id19 id20

47


httpsodnacobro-adsadvertstatictheme=after-contentampsize=50 httpsodnacobro-adsadvertprerolltheme=scroll

id18 id19

48


QUESTIONNAIREAPPENDIX 4

49


QUESTIONNAIREB1 ENTER YOUR GENDER

bull Malebull Female

B2 WHAT IS YOUR BIRTHDAY

(enters birthday) -gt age of respondent calculated

B3 WHAT REGION DO YOU LIVE IN

bull Central (including Moscow)bull Northwest (including Saint Petersburg)bull Volga regionbull Siberiabull Uralsbull The North Caucasusbull Southbull Far East

В3А WHAT CITY DO YOU LIVE IN List of cities

B4 PLEASE INDICATE THE EXTENT TO WHICH YOU AGREE OR DISAGREE WITH THE FOLLOWING STATEMENTS (one answer in each line)

COMPLETELYDISAGREE

COMPLETELYAGREE

I can learn a lot of new things on the internet 1 2 3 4 5

I enjoy purchasing things on the internet 1 2 3 4 5

Online advertising can be useful 1 2 3 4 5

I enjoy spending time on social networks 1 2 3 4 5

50


QUESTIONNAIREINSTRUCTIONS SCREENPlease rate four internet sites with excerpts from short stories by the Russian author Arkady AverchenkoYou will see the links to sites later Go to each site by clicking ltbutton icongt Read the text and then go back to the survey and answer the questions about the siteThe websites will open in a new window Before you click to the next screen please enable sound on your device

PAGE 1To get to the site please click on the button below Read the text on the page and then go back to the survey The page will open in a new window

B5 WHICH OF THE FOLLOWING SENTENCES DESCRIBES THE TEXT THAT YOU READ (POTENTIAL ANSWERS RELATE TO SPECIFIC TEXT ON THE PAGE)

TEXT 1bull The protagonist foolishly proposed to the lady and now doesnt know what to dobull The protagonist is planning a trip and asks his friend for advicebull The protagonist discusses with his friend how he is preparing for married lifebull Its difficult to answer

TEXT 2bull A young lady talks about a situation that happened one day at a park with her husbandbull A young man and woman discuss Othellobull A young lady tells her friend about how her husband smashed his headbull Its difficult to answer

51


QUESTIONNAIRETEXT 3

bull The story is about an encounter with a stranger on a trainbull The story is about an encounter on a train with the Pope and a Cardinal from the Vaticanbull The story is about how a bureaucrat met his wife on a trainbull Its difficult to answer

TEXT 4

bull The story is about a new teacher that comes to the home of a wealthy landownerbull The story is about a student who returns home from boarding schoolbull The story is about a wealthy landowner who sends his son to study at boarding schoolbull Its difficult to answer

B6 SHARE YOUR OVERALL IMPRESSIONS ABOUT THE PAGE CONTAINING TEXT

bull The page is very badbull The page is badbull The page is averagebull The page is goodbull The page is great

52


QUESTIONNAIRETHIS BLOCK REPEATS FOR PAGES 2-4

To get to the site please click on the button below Read the text on the page and then go back to the surveyThe page will open in a new window


TEXT 1

The protagonist foolishly proposed to the lady and now doesnt know what to doThe protagonist is planning a trip and asks his friend for adviceThe protagonist discusses with his friend how he is preparing for married lifeIts difficult to answer

TEXT 2

A young lady talks about a situation that happened one day at a park with her husbandA young man and woman discuss OthelloA young lady tells her friend about how her husband smashed his headIts difficult to answer

53


QUESTIONNAIRETEXT 3

bull The story is about an encounter with a stranger on a trainbull The story is about an encounter on a train with the Pope and a Cardinal

from the Vaticanbull The story is about how a bureaucrat met his wife on a trainbull Its difficult to answer

TEXT 4

bull The story is about a new teacher that comes to the home of a wealthy landowner

bull The story is about a student who returns home from boarding schoolbull The story is about a wealthy landowner who sends his son to study at

boarding schoolbull Its difficult to answer



NOW THERE WILL BE A FEW QUESTIONS ABOUT THE ADS THAT YOU MAY HAVE NOTICED ON THE PAGE (display image of page with ad)

B9 DID THE AD INSPIRE TRUST IN THE ADVERTISED PRODUCT

bull Yes bull No bull Hard to say

54


B10 HOW ANNOYING WAS THE AD (display image of page with ad)

bull Not annoying at all bull Slightly annoyingbull Slightly annoyingbull Seriously annoyingbull Extremely annoying

B11 HOW DISRUPTIVE WAS THE AD (display image of page with ad)

bull Not at all disruptivebull A little disruptivebull Noticeably disruptivebull Seriously disruptivebull Extremely disruptive

After rating the four pages

NOW PLEASE COMPARE ALL THE AD FORMATS THAT YOU SAW (display images of the three pages containing ads)

B12 WHICH AD FORMAT WAS LEAST ACCEPTABLE

Format on page 2 (image)Format on page 3 (image)Format on page 4 (image)

B13 WHICH AD FORMAT WAS MOST ACCEPTABLE


QUESTIONNAIRE

55


QUESTIONNAIRED0 WHAT OPERATING SYSTEM IS INSTALLED ON THE MOBILE DEVICE YOU USED TO TAKE THE SURVEY (only for surveys taken on mobile devices)

bull Androidbull iOS (iPhone iPad)bull Windowsbull Other

IN CONCLUSION WE HAVE A FEW QUESTIONS ABOUT YOU

D1 WHAT EDUCATION LEVEL HAVE YOU COMPLETED

bull Some high schoolbull Finished high schoolbull Some collegebull Bachelors degree or higher

D2 ARE YOU CURRENTLY EMPLOYED

bull I work full time (30 plus hours per week)bull I work part time (8-29 hours per week)bull I dont work -gt Ask question D3

56


QUESTIONNAIRED3 WHAT IS YOUR MAIN ACTIVITY

bull Homemaker Childcarebull Studentbull Unemployed and looking for workbull Unemployed and not looking for workbull Retiredbull Other (specify)_____________bull Prefer not to answer

D4 HOW WOULD YOU DESCRIBE YOUR FAMILYS FINANCIAL SITUATION AT PRESENT

bull We dont always have money to cover basic needs like foodbull We have money for food but other essentials like clothing can be a problembull We have money to cover the essentials but we cant afford to buy major appliances without taking out a loan or borrowing money some other waybull We have money for things like major appliances but we would not be able to buy a new car without taking out a loan or borrowing money some other waybull We can afford to buy basically anything (such as a car) without taking out a loan or borrowing money with the exception of an apartment or dachabull We can afford to buy an apartment or dacha with money we have on hand (without necessitating taking our a loan or borrowing money)

CONTACTSIAB Russia Better Ads Committee

Head of the committee Boris Omelnitsky+79161159349baoiabrusru

Coordinator of IAB Russia Tatiana Shatalova+79251046546tasiabrusru

IAB Russia office 3 Polkovaya St Bldg 3 4th Fl

Information about the committeehttpsiabrusrucommitteesworkgroup160

copy IAB Russia BetterAds Committee 2017

2


CONTENTSBACKGROUND RESEARCH __________________________________________________ 3

GOAL AND OBJECTIVES OF THE STUDY _______________________________________ 4

RESEARCH METHODOLOGY _________________________________________________ 5

OVERALL CONCLUSIONS ___________________________________________________ 10

RESULTS FOR DESKTOP FORMAT ___________________________________________ 15

RESULTS BY MOBILE FORMATS _____________________________________________ 22

APPENDIX 1 CASE STUDYING THE ADDITION OF A NEW FORMAT ________________ 29

APPENDIX 2 DESKTOP AD FORMATS INCLUDED IN THE STUDY __________________ 32

APPENDIX 3 MOBILE AD FORMATS INCLUDED IN THE STUDY ____________________ 39

APPENDIX 4 QUESTIONNAIRE ______________________________________________ 48

CONTACTS _______________________________________________________________ 57

3







4









5







6







А - the best

В

С - the worst

А gt В

В gt С

7









8










Moscow 473





Total 2934

9







Moscow 529





Total 3116

10


OVERALL CONCLUSIONS

11












12






4 9 28 35 25


13













14












15



16









17





18



79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728


The most annoying

The most annoying

The most annoying















19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












3







4









5







6







А - the best

В

С - the worst

А gt В

В gt С

7









8










Moscow 473





Total 2934

9







Moscow 529





Total 3116

10


OVERALL CONCLUSIONS

11












12






4 9 28 35 25


13













14












15



16









17





18



79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728


The most annoying

The most annoying

The most annoying















19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












4









5







6







А - the best

В

С - the worst

А gt В

В gt С

7









8










Moscow 473





Total 2934

9







Moscow 529





Total 3116

10


OVERALL CONCLUSIONS

11












12






4 9 28 35 25


13













14












15



16









17





18



79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728


The most annoying

The most annoying

The most annoying















19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












5







6







А - the best

В

С - the worst

А gt В

В gt С

7









8










Moscow 473





Total 2934

9







Moscow 529





Total 3116

10


OVERALL CONCLUSIONS

11












12






4 9 28 35 25


13













14












15



16









17





18



79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728


The most annoying

The most annoying

The most annoying















19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












6







А - the best

В

С - the worst

А gt В

В gt С

7









8










Moscow 473





Total 2934

9







Moscow 529





Total 3116

10


OVERALL CONCLUSIONS

11












12






4 9 28 35 25


13













14












15



16









17





18



79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728


The most annoying

The most annoying

The most annoying















19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












7









8










Moscow 473





Total 2934

9







Moscow 529





Total 3116

10


OVERALL CONCLUSIONS

11












12






4 9 28 35 25


13













14












15



16









17





18



79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728


The most annoying

The most annoying

The most annoying















19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












8










Moscow 473





Total 2934

9







Moscow 529





Total 3116

10


OVERALL CONCLUSIONS

11












12






4 9 28 35 25


13













14












15



16









17





18



79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728


The most annoying

The most annoying

The most annoying















19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












9







Moscow 529





Total 3116

10


OVERALL CONCLUSIONS

11












12






4 9 28 35 25


13













14












15



16









17





18



79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728


The most annoying

The most annoying

The most annoying















19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












10


OVERALL CONCLUSIONS

11












12






4 9 28 35 25


13













14












15



16









17





18



79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728


The most annoying

The most annoying

The most annoying















19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












11












12






4 9 28 35 25


13













14












15



16









17





18



79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728


The most annoying

The most annoying

The most annoying















19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












12






4 9 28 35 25


13













14












15



16









17





18



79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728


The most annoying

The most annoying

The most annoying















19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












13













14












15



16









17





18



79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728


The most annoying

The most annoying

The most annoying















19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












14












15



16









17





18



79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728


The most annoying

The most annoying

The most annoying















19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












15



16









17





18



79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728


The most annoying

The most annoying

The most annoying















19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












16









17





18



79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728


The most annoying

The most annoying

The most annoying















19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












17





18



79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728


The most annoying

The most annoying

The most annoying















19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












18



79109913

11547

61010

1471211121313

1812

97

161381113

1715

787

1214

1110

1215

1616

131615

1216

2623

2424

182320

2418

272626

2226

2724

2329

2527

212524

2423

2119

1820

2020

1520

2018

2222

212420

2120

2419

1921

222318

21

4045

3337

4536

4429

3336

404138

3132

3531

252927

332525

2728


The most annoying

The most annoying

The most annoying















19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












19






Most disruptive

Most disruptive

Most disruptive

Most disruptive

55

999101011

148

647

51110

166

1112111314

1913

55

1210

6101011

128

57

1211

108

99

1213

121211

1312

1414

1812

8914

1715

2015

101219

1816

1816

1918

1918

1716

19

3128

2729

273021

3023

2632

3128

3132

2727

4627

3224

3232

2528

4648

3441

5141

4632

3639

4248

4134

3039

3023

3026

3426272828













20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












20




2732

262830

2333

26272928272727

2330

2532

2523

272527

2026

4540

504945

5346

5052

45424547

5050

4454

4553

5448

5048

5751

2828

2423

2525

212422

26302827

232626

22232223

2525252323

yes

no

hard to say













21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












21




3

56

86

64779

735457

7685587

77

7

37

4238

3942

3937350

3938

413734

4239

4036

393436

4042

3641

4339

49

4244

4143

4545

4939

4241

4649

3843

424344

424640

4041

4136

42

10

111211

89

128

1310111212131310

1210

1611

139

14111211















22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












22



23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












23











24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












24





5 mdash best format

25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












25






13

14

12

19

14

14

13

15

13

20

15

10

18

15

18

19

10

12

17

16

17

26

16

13

14

14

18

15

14

14

16

16

16

14

12

16

15

12

17

10

16

14

16

16

24

26

25

25

21

27

28

21

27

25

26

29

26

27

28

23

21

28

27

28

25

20

18

19

23

24

22

18

28

23

22

21

20

22

20

22

21

23

26

23

20

22

21

17

30

28

26

19

24

26

17

28

22

19

23

26

23

21

17

23

26

27

21

20

21

22

The most annoying

The most annoying























26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












26






Most disruptive

11

15

14

18

14

15

14

17

15

20

14

12

19

15

19

16

12

13

19

17

19

27

11

11

11

12

12

12

15

7

14

14

13

10

12

15

13

12

13

9

12

16

13

14

21

18

17

19

20

18

20

15

20

18

21

20

17

20

19

19

17

17

21

17

20

15

28

25

29

34

29

28

34

36

29

33

33

34

28

31

30

29

35

33

29

29

28

24

28

32

29

17

26

27

18

26

23

15

20

24

23

18

19

24

23

28

19

20

20

21























27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












27




23

26

27

19

22

22

19

20

25

16

20

25

23

21

23

27

27

27

24

21

22

20

59

49

44

58

51

53

53

58

55

59

52

48

54

54

53

50

52

46

52

51

55

55

18

25

29

22

27

25

27

22

21

25

28

26

23

25

24

23

21

27

24

27

23

24























28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












28




4

58

109

610810

991099

105

97

1691279

40

4239

3741

4238

35036

404141

414140

3740

4236

4138

3938

44

3937

3836

3637

4536

36373840

3741

453740

3938

373939

12

12131312

141310

151011

98

118

111110

89

121111













29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












29




APPENDIX 1

30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












30





31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












31






6

13

9

12

16

18

46

32

23

26











18 22





22 11




32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












32



APPENDIX 2

33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












33


















34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












34























35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












35








id1

id4

id2

id5

id3

id6

36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












36








id7

id10

id8

id11

id9

id12

37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












37








id13

id17

id14

id18

id16

id19

38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












38








id20

id23

id21

id24 id25

id22

id26

39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












39



APPENDIX 3

40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












40




















41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












41


















42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












42



id1 id2 id3 id4

43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












43



id5 id6 id7 id8

44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












44



id9 id10 id11 id12

45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












45



id13 id14 id15 id16

46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












46



id17 id18 id19 id20

47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












47



id18 id19

48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












48



49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












49










COMPLETELYDISAGREE

COMPLETELYAGREE





50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












50







51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












51


QUESTIONNAIRETEXT 3


TEXT 4




52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












52





TEXT 1


TEXT 2


53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












53


QUESTIONNAIRETEXT 3



TEXT 4









54












QUESTIONNAIRE

55









56












54












QUESTIONNAIRE

55









56












55









56












56












how russian users respond to internet advertising · the iab russia better ads committee...

Documents