cutgroup 6 openstreetmap.org final report

66
CUTGroup 6 OpenStreetMap.org In-person test on January 22, 2014 Overview: For our Civic User Testing session, we tested the map editing features of OpenStreetMap.org. Target Group: CUTGroup members that said they were interested in in-person tests as of January 13, 2014 – 551 users Chicago residents from different areas of Chicago A random selection of people who responded “yes” or “no” to various screening questions Test Type: In-person test for about 15 participants We ask a variety of questions and captured responses via form. Some testers will fill out their own form, while other testers will be asked questions by proctors and then the proctors will out the form. In the cases when proctors write down responses, testers will have a chance to verify and make changes to the responses captured before submission. o “Yes” or “no” questions to gather quantitative results o Open-ended questions to see what users were interested in doing o Leading questions are asked so users will visit specific areas of the website and respond with their experience Questions: How do users use the site? And what can be improved from an UX standpoint? Why does the general audience want (or not want) to use OSM Editor? Do people see themselves as potential long-term users? Is this useful to general internet users? Do general internet users want to contribute? If so, how?

Upload: smarziano

Post on 22-Nov-2014

457 views

Category:

Technology


0 download

DESCRIPTION

Smart Chicago's final report of Civic User Testing session. Tested map editing features OpenStreetMap.org on 1/22/2014. OpenStreetMap.org is a Web site that is built by a community of mappers that contribute local knowledge and information to a map for everyone to use. Anyone can sign up, add information and edit the map.

TRANSCRIPT

Page 1: CUTGroup 6 OpenStreetMap.org Final Report

CUTGroup 6 – OpenStreetMap.org

In-person test on January 22, 2014

Overview:

For our Civic User Testing session, we tested the map editing features of OpenStreetMap.org.

Target Group:

CUTGroup members that said they were interested in in-person tests as of January 13,

2014 – 551 users

Chicago residents from different areas of Chicago

A random selection of people who responded “yes” or “no” to various screening questions

Test Type:

In-person test for about 15 participants

We ask a variety of questions and captured responses via form. Some testers will fill out

their own form, while other testers will be asked questions by proctors and then the

proctors will out the form. In the cases when proctors write down responses, testers will

have a chance to verify and make changes to the responses captured before submission.

o “Yes” or “no” questions to gather quantitative results

o Open-ended questions to see what users were interested in doing

o Leading questions are asked so users will visit specific areas of the website and

respond with their experience

Questions:

How do users use the site? And what can be improved from an UX standpoint?

Why does the general audience want (or not want) to use OSM Editor?

Do people see themselves as potential long-term users?

Is this useful to general internet users? Do general internet users want to contribute? If so,

how?

Page 2: CUTGroup 6 OpenStreetMap.org Final Report

CUTGroup 6 – OpenStreetMap.org

In-person test on January 22, 2014

Results:

16 users tested the Web site and gave us feedback, below are some key highlights for each

question.

What browser are you using?

75% (12) - Chrome

13% (2) - Safari

6% (1) - Firefox

6% (1) - Internet Explorer

How do you use maps?

The majority of testers mentioned that they use maps specifically to get directions. 5 testers called

out Google maps specifically.

Review the homepage. What do you think this site does?

4 out of 16 testers (25%) mentioned that this would be a map that they could edit. 3 of those

testers said this was reminiscent of Wikipedia.

The majority of testers thought this was like other maps to search for specific places throughout

the world.

Without looking back at the Web site, what are three things you noticed on the homepage?

While the map is the focal point on this page, the next top items that testers mentioned that they

noticed are as follows:

5 – Colors used

4 – Web site is simple/easy to use or navigate

4 – Search option

3 – Sign-in option

3 – Map icons/options

Only 1 tester mentioned the “Start Mapping” button.

OpenStreetMap allows users to modify and edit the map. Would you want to edit this map?

62% (10) – Yes

38% (6) – No

Why or why not? [re: allowing users to modify/edit map]

Here are some responses from testers who said “Yes”:

“I believe in power of people and having a significant contribution to these things. Gives a

sense of community and add value in the sense of belonging” – Tester #5, kirehernan

“If I notice outdated information, I feel compelled to update services I use because I'd

expect others to do the same” – Tester #12, cherub

Page 3: CUTGroup 6 OpenStreetMap.org Final Report

CUTGroup 6 – OpenStreetMap.org

In-person test on January 22, 2014

“I would add information about safe, passable pedestrian routes in neighborhoods, as well

as information about transit station exits and entrances” – Tester #13, tech educator

Here are some responses from testers who said “No”:

“I personally would but I would not want others to have the same access as I would due to

the lack of restrictions.” – Tester #7, B

“I have no reason to edit. The map should already be accurate.” –Tester #9, Sweetie Pie24

“What am i editing? State borders? Would I edit the information that is overlayed on the

map... maybe, but first i'd need to see what kind of information is already there or read

some guidelines on what is acceptable or expected by other users” – Tester#14, i like

maps. i also like UI/UX

Click "Start Mapping" - did you decide to register or use OpenID?

94% (15) - Click "Register Now"

6% (1) – Used OpenID

Tell us more. [re: registering]

The majority of testers were not familiar with OpenID. Also, with the placement at the bottom, most

testers began to register before seeing the OpenID option. A side-by-side sign-in option might be

more successful

After logging in, this site brings you to a welcome page. Did the welcome page give you helpful

information?

94% (15) – “Yes”

6% (1) – “No”

Tell us more. [re: welcome page]

Mostly everyone thought that the welcome page was helpful. Here are some additional

comments/questions that testers had about this page:

“I'm immensely happy to see the site clearly stating that this sight is not for opinions.

Comment sections are a great place to see the depth of human depravity. But I was a little

bummed to see that it also mentioned there will not be historical data.” –Tester #12,

cherub

“I saw it after confirming my email. I like the info -- I feel like it confirms what I thought the

maps could do. Maybe an example of what "mapping" looks like?” – Tester #13, tech

educator

“Good overview. I'm curious about editing vs just adding a note. Why one over the other?

Are they substantially different?” –Tester #15, snarky

Click "Start Mapping" at the bottom of this welcome page. Then choose "Start the walkthrough."

Tell us about this experience using the walkthrough.

Page 4: CUTGroup 6 OpenStreetMap.org Final Report

CUTGroup 6 – OpenStreetMap.org

In-person test on January 22, 2014

5 of 16 testers (31%) were never prompted to do the walkthrough, or the walkthrough would not

load.

Out of the 11 testers who gave feedback on their walkthrough experience – 5 testers had positive

experiences, while 6 testers had negative experiences.

Here are some positive experiences:

“The walkthrough was very nicely created. Great use of highlighting the specific areas of

interest. I went through the entire tuturial without much hesitation at all. The initial instance

of "marking/contributing" to the map was a little getting used to only because like past

experiences, maps and directions were pretty static. So changing that mind set from

consumer to contributor is a pretty awesome shift. I like it!” –Tester #5, kirehernan

“It was amazingly straight forward and easy to understand.” –Tester #7, B

“It helped get me acquainted with the features and how exactly to use them. It was short

and to the point. Some of the grammar or lingo tripped me up. One sentence in particular

had a strange cadence to it-it used three similar words in a row and confused me as to what

it was saying. Assigning special specific meanings to commonly used nouns where they

mean one thing everywhere in the world except for this one specific website seems like a

bad idea.” –Tester #12, cherub

Here are some negative experiences:

“I felt like I would have liked a video or a voice over guiding the walk through rather than

me just clicking around aimlessly” –Tester #1, mouthwash

“Issue with creating a line, I start the line where I think the line begins but am not sure

because the road is under the cover of trees. Next when I follow the next step I do not know

how to finish making the line. I assume hitting the esc key will work and it does. I am not

able to create a line successfully. On Macbook Pro Retina” –Tester #3, Young Chicagoan

“Difficult to see the "zoom in to start mapping" flag under the Edit link. We don't use cafe

unless we're in paris.” –Tester #11, Over-the-road tour guide

“This is really helpful in teaching me how to use it. I'm not a fan of how the toolbar on the

left flickered with mouse-over in the beginning of the tutorial, though. I'm having a lot of

trouble with the Lines function -- I know I wasn't doing it right, but the directions weren't

super clear about where to start, and then I managed to break it it asked me to select

"Road" from the left but I couldn't type or see anything. Fixed it by clicking "Line" on the

progress bar, though. It's interesting that there is no "Save" function before you close the

editor -- that doesn't feel natural to me. But I don't see it as a problem as long as users

complete the training.” –Tester #13, tech educator

Did this meet your expectations?

56% (9) – “Yes”

44% (7) – “No”

Did you finish the walkthough?

56% (9) – “Yes”

44% (7) – “No”

Page 5: CUTGroup 6 OpenStreetMap.org Final Report

CUTGroup 6 – OpenStreetMap.org

In-person test on January 22, 2014

If not, when did you stop? Why?

Here are some comments:

“After the first three steps.” –Tester #9, Sweetie Pie24

“Buggy/slow computer/missing mouse” -Tester #11 Over-the-road tour guide

Did you like the walkthrough?

56% (9) – “Yes”

44% (7) – “No”

Why or why not?

Here are responses from testers who said “Yes”:

“It was easy to use, and was simple and concise with the directions.” –Tester #6, Frequent

Mobile User

“It was helpful. Would have tried to figure it out.” –Tester #4, Qualified to be a taxi driver

“Not too long and kept with just the basics.” – Tester #12, cherub

Here are responses from testers who said “No”:

“Time consuming and boring would have preferred a video where I could pause and watch

again if I'm confused about something.” –Tester #9, Sweetie Pie24

“I felt like it didn't teach me much” –Tester #1, mouthwash

Once you reach the map, what is the first thing you do?

31% (5) – Moved the Map View

31% (5) – Click “Edit”

20% (3) – Used the Search Feature

6% (1) – Click “History”

6% (1) – Click “Export”

6% (1) – Other: Inspect Element

0 – Added a point/line/area

0 – Clicked “Zoom in to Edit”

0 – Used Map Tools

Tell us more about the first thing you did.

A tester who selected a Moved the Map View:

“The first thing I did was look around the map to see if there was anything labeled. Having

an overhead view of the area gave me a new perspective on the area, and showed me a lot

of buildings I hadn't noticed, and I have lived in the area over a year.” –Tester #1,

mouthwash

Testers who selected a Clicked Edit:

“I'm trying to leave a comment on a "topic" and am unclear about how to do it.” –Tester #8,

slackerdiva

Page 6: CUTGroup 6 OpenStreetMap.org Final Report

CUTGroup 6 – OpenStreetMap.org

In-person test on January 22, 2014

“I didn't get to do the walkthrough so I wasn't really sure what to do now. As i moved my

mouse around the browser, I noticed that when I moused over buildings that the sidebar on

the left appeared. I was curious to explore the functionality of that so I clicked on a building.

From there I clicked the "type of feature" to see what types i could choose from. I was a bit

confused why we can add cafes, restaurants, or places of worship... but not retail stores,

bars, or other similarly specific types of buildings. I see now that some of these are under

"land use" but i'm not sure that the groupings of the types of features make sense to me.” –

Tester #14, i like maps. i also like UI/UX

A tester who Used Search Feature:

“Wanted to orient myself on the map and have a better idea of what I was looking at.

Picked my hometown suburb thinking it'd be easier than the major metropolitan area of

Chicago. Spent a little time getting used to the symbols and where to look to find all the

different information available. The titles of whatever I had selected didn't stand out as

much as I wanted, I found my eyes overlooking it pretty regularly.” – Tester #12, cherub

1 tester who clicked History:

“Wanted to see what other users searched for and edited. was curious. Did not expect the

site to be so boring. Expectations not met. Useless.” –Tester #9, Sweetie Pie24

1 tester who clicked Export:

“I tried clicking on a state on the map. Then I hit explore. It's not as helpful as I thought.

The site needs improving.” – Tester #2, Location Finder

1 tester who selected Other (Inspect Element):

“Still learning about coding myself and always enjoy looking at how the site was created.

Although, not fully understanding every step, I have an opportunity to find a few things that

look familiar.” –Tester #5, kirehernan

Please find a school, store, community center, or restaurant. Edit the information or add it to the

map, and then tell us about this experience.

8 testers mentioned some difficulty in editing the map. Difficulties were in (1) search feature –

some testers could not find what they were looking for, (2) finding or choosing the correct

identifying tag, and (3) some thought editing was confusing.

Out of these 8 testers:

5 indicated that they finished the walkthrough

4 said “No” they do not like the walkthrough

Here are some of their comments:

“I struggled with identifying if a place was a restraunt or not, I am aware it is in a general

area but I can't be sure.” –Tester #1, mouthwash (Finished walk-through, but did not like it)

“I added the YMCA from my hometown since it wasn't labeled. Had some difficulty picking

the right identifying tag, didn't find a "community center" one. I like that there's not a

minimum amount of information you have to add, just whatever you know is okay. Think

that allows for more up to date and accurate listings.” –Tester #12, cherub (Finished walk-

through, and liked it)

“I wasn't able to edit. The page timed out while loading. Again, I'm using an iPad.” –Tester

#15, Snarky (Did not finish walk-through)

Page 7: CUTGroup 6 OpenStreetMap.org Final Report

CUTGroup 6 – OpenStreetMap.org

In-person test on January 22, 2014

4 testers had positive experiences with editing.

Here are some of their comments:

“It wasn't hard to get the map over my local area. Editing the map was simple, and I would

use this in the future, especially if it were available via mobile” –Tester #6, Frequent Mobile

User (Finished walk-through, and liked it)

“I found a neighborhood bar I've been to that was unidentified so far. I added its name and

its category. The ability to add information to a specific building is awesome -- I can see this

being really useful to me when I am wondering what a building houses -- maybe someone

has added information to it on OpenStreetMap and I can find out more! (I would love to

contribute to that knowledge pool)” –Tester #13, tech educator (Finished walk-through, and

liked it)

Do you like the edit features?

75% (12) – “Yes”

25% (4) – “No”

Was it easy to find what you were looking for?

62% (10) – “Yes”

38% (6) – “No”

Please search for an address, and tell us about that experience.

9 testers were able to search and find the address they were looking for, while the remaining 7

testers had difficulties in finding a specific address.

Here are some responses from testers that found it easy:

“The experience once again was fast and efficient. The search bar allows me to find what

I'm looking for.” –Tester #2, Location Finder

“It was easy to find it. I would add though, that if I was for some reason in the mood to

search up [and edit] many places that were not within one mapview, it would be really

annoying that "world wide search" is not the default. Additional thought: I tried to change

the field under "building" and it wasn't clear to me that i was changing the type of feature

(i.e. didn't know it was same as if i clicked the first field/icon in editing dashboard). The

yes/no through me off, and then i didn't know if i should choose house or residential (it's a

house that was converted to a two flat and now about to be renovated back to a single

family home). the ","s in the helper text imply I can choose multiple options?” –Tester #14, i

like maps. i also like UI/UX

“Search bar is very easy to use.” –Tester #15, Snarky

Here are some responses from testers that found it more difficult to use:

“Wish the names and/or titles of the selected were more prominent on the left panel. Wish

some of the buttons were labeled or included in the overview because I wasn't always

certain what they did. Obviously the search is a must for any map. But I didn't like how I

always had to click "search worldwide" because none of my search terms showed up in my

visible map area.” –Tester #12, cherub

Page 8: CUTGroup 6 OpenStreetMap.org Final Report

CUTGroup 6 – OpenStreetMap.org

In-person test on January 22, 2014

“Tried it but it did not work for me” –Tester #10, jjohnson

“Search was not properly functioning. It doesn't direct me to a single spot on the map.” –

Tester #6, Frequent Mobile User

“VERY cumbersome. There were many lists to the left side of the screen and the one I

wanted was not there.” –Tester #7, B

Do you like the search feature?

69% (11) - “Yes”

31% (5) - “No”

Will you use the map editor again, on your own?

69% (11) – “Yes”

31 (5) – “No”

Why or why not?

Here are responses from people that said “Yes”:

“It's super cool! I haven't seen any other geographic resource like this, and it's something

I've often wanted.” –Tester #13, tech educator

“Out of sheer curiosity because it was fun being a part of something experimental but not

something I would use.” –Tester #7, B

“This would be similar to the comments above, I like the idea of collaboration and

contribution. Some areas don't have as much visibility as others and if I have access to it,

I'm more than happy to add to it's visibility” – Tester #5, kirehernan

Here are responses from people that said “No”:

“If I'm snowed in, trying to keep myself occupied. A business owner might do this -- one time

thing.” –Tester #4, Qualified to be a taxi driver

“No need when I have google maps.” – Tester #9, Sweetie Pie24

Do you like this Web site?

88% (14) – “Yes”

12% (2) – “No”

Tell us more. [re: Do you like the Web site?]

Here are some responses from testers who said “Yes”:

“I think it's a really cool tool, nice design, works pretty smoothly. Does what it says it can do

and then some.” –Tester #14, i like maps. i also like UI/UX

“I like the concept, and I hope people will add useful information, such as walking routes or

local businesses.” –Tester #15, Snarky

“This is a hyper local thing that can definitely be utilized as a social and communicative tool

in innumerable ways.” –Tester #8, slackerdiva

Page 9: CUTGroup 6 OpenStreetMap.org Final Report

CUTGroup 6 – OpenStreetMap.org

In-person test on January 22, 2014

Here is a response from a tester who said “No”:

“If it would function to what it is expected to do then it would be something I would use.” –

Tester #16, Twinnie Mommie

In what ways would you improve this map editor to serve your needs? Or why does a map editor not

serve your needs?

“Google is too cut-throat in their editing options and accepting the edits. It was added by the

time I got to this part.” –Tester #3, Young Chicagoan

“Truthfully I feel a great affinity to google maps and it would be hard to change it for me. I

feel like it provides me with everything I need to know and I am never really frustrated with

using it.” –Tester #1, mouthwash

“I think a map editor gives too many people access to create useless, invasive and incorrect

information on points of interest. Where someone died, lives, kissed, got engaged, the food

(good or bad). etc etc. I think these things should be done by a qualified topograher.” –

Tester #7, B

“Make it more user intuitive. Like a kindergartner would understand. Not that we think like

5 year olds but just very intuitive so I don't have to second guess the lingo.” –Tester #8,

slackerdiva

“I have no need to edit the maps. An map that isnt accurate is useless in my opinion.” –

Tester #9, Sweetie Pie24

Do you like the CUTGroup?

100% (16) – “Yes”

0% – “No”

Did you like this CUTGroup test?

94% (15) – “Yes”

6% (1) – “No”

Anything else you want to add?

“Helpful instructors. Nice atmosphere. Horrid location. Need a location downtown.” – Tester

#9, Sweetie Pie24

“First time, couldn't come to the last one.” –Tester #11, Over-the-road tour guide

“I typically do enjoy providing input into new sites but this time I was unable to use the site

properly.” –Tester #16, Twinnie Mommie

Page 10: CUTGroup 6 OpenStreetMap.org Final Report

CUTGroup 6 – OpenStreetMap.org

In-person test on January 22, 2014

Conclusions

How do users use the site? And what can be improved from an UX standpoint?

Walkthrough:

We learned that providing information through a walkthrough and the welcome page are

important for users to understand how to map

5 testers (31%) were never prompted to do the walkthrough or the walkthrough would not

load

Out of the 11 testers who did at least some of the walkthrough, only 5 had positive

experiences. 6 testers thought some parts were difficult or confusing

Here are some suggestions we learned:

1. It is important that users have an easy access point to the walkthrough. Instead of having

the walkthrough prompt being based on what the user clicks, the walkthrough option needs

to be always accessible by the user. This will allow users to access information when they

want and go back to it if they need more assistance

2. Some walkthroughs did not work properly: difficulty creating a line, highlighted areas did

not line up correctly, "zoom in to start mapping" was difficult to see

3. It might be helpful to consider breaking up the walkthrough into different steps. This will

allow users to choose what they want to learn and serve their needs better for the type of

information they want to add (ex: add a path, add an area, add information, add a note, etc)

4. 2 testers thought that a video might be easier alternative to follow

Search Function:

11 testers (69%) liked the search feature, while 5 testers (31%) did not like the search

function

Testers became frustrated that when their search was not in the visible map area that they

had to choose "Search Worldwide"

When searching, testers received sometimes too many options that were irrelevant to what

they were looking for, or could not find their search term. Testers are interested in having a

clearer way of searching for locations. Additionally, it would be helpful to understand why

some results may not appear, and provide a prompt for the user to add/edit information

Editor:

8 testers mentioned some difficulty in editing the map. Difficulties were in (1) search

feature – some testers could not find what they were looking for, (2) finding or choosing the

correct identifying tag, and (3) some thought editing was confusing. Out of these 8

testers, 5 indicated that they finished the walkthrough

12 testers (75%) liked the edit features, while 4 testers (25%) said they did not like the

editor features

Page 11: CUTGroup 6 OpenStreetMap.org Final Report

CUTGroup 6 – OpenStreetMap.org

In-person test on January 22, 2014

Why does the general audience want (or not want) to use OSM Editor?

14 testers (88%) said they liked the Web site, and 11 testers (69%) said they would use the map

editor again. Here are some reasons why testers want to use OSM editor:

Update outdated data

Contribute to a neighborhood's visibility

Feel the need to customize or make a map more personal

Add information about safe pedestrian and bike paths

In addition, two testers mentioned that they wanted OSM to have a feature to see the history of a

location to know what it used to be and what it is now.

A couple of testers do not feel like they would want to edit because they believe that maps should

accurate in the first place, and that is the responsibility of the map-maker.

Do people see themselves as potential long-term users?

Testers are interested in adding information to locations that were important to them, or updating

outdated information. This would happen on a case-by-case basis, and therefore, it might be hard

to tell if testers see themselves as long-term users. Testers were not interested in mapping outside

of their own realm of knowledge.

Is this useful to general internet users? Do general internet users want to contribute? If so, how?

At this time, OSM editor is a series of tools that might be difficult for some users to use. This test

has informed us that most people do want to contribute, but in different ways. Some testers want

to update text information, others want to add paths, and others might want to add a note.

Conclusion

When testers were asked about things they noticed on the homepage, only 1 tester mentioned the

"Start Mapping" button. Since testers are interested in contributing knowledge through the editor in

different ways, there needs to be different points of engagement for users. OSM might want to

consider prompting users to add information in different ways throughout the experience. In

addition, the suite of editor features might be cumbersome for the general audience, and different

levels of editing will serve a larger audience.

Page 12: CUTGroup 6 OpenStreetMap.org Final Report

Tester #: 1

Tester Profile (given by tester): mouthwash

Was this form filled out by a Proctor? No What browser are you using? Chrome How do you use maps? To get directions and to just gage distances Review the homepage. What do you think this site does? I felt like the homepage is slightly bland and I do not know where to move forward. I feel like their is a lack of clairity. Without looking back at the Web site, what are three things you noticed on the homepage? It immediately shows the united states. It has some copyright thing as well as a sign in option. OpenStreetMap allows users to modify and edit the map. Would you want to edit this map?

Yes

Why or why not?

I feel like it would allow me to be creative with what I want to look

Click “Start Mapping” – did you decide to register or use OpenID? Click "Register Now"

Tell us more.

Not particularly familiar with OpenID

After logging in, this site brings you to a welcome page. Did the welcome page give you helpful information? Yes

Tell us more.

It seemed simple enough, but often times people skip all of the information and dive right in so there was nothing specific that stuck out to me.

Click “Start Mapping” at the bottom of this welcome page. Then choose “Start the walkthrough.” Tell us about this experience using the walkthrough.

Page 13: CUTGroup 6 OpenStreetMap.org Final Report

I felt like I would have liked a video or a voice over guiding the walk through rather than me just clicking around aimlessly Did this meeting your expectations? Yes Did you finish the walkthough? Yes

If not, when did you stop? Why?

Did you like the walkthrough? No

Why or why not?

I felt like it didn't teach me much

Once you reach the map, what is the first thing you do?

� Moved the Map View Tell us more about the first thing you did. I scanned around and looked for things. I also like to check street view when I am a little lost, becuase it is hard to remember the exact address. Please find a school, store, community center, or restaurant. Edit the information or add it to the map, and then tell us about this experience. I struggled with identifying if a place was a restraunt or not, I am aware it is in a general area but I can't be sure. Did you like the edit features? Yes Was it easy to find what you were looking for? No Please search for an address, and tell us about that experience. I have searched for two different addresses. My current residence gave the wrong zip code and then my childhood home it it said it was signiificantly further up the street. Do you like the search feature? No Will you use the map editor again, on your own? No

Why or why not?

I feel like it was not comprehensive enough and I was not interested in adding things because what I needed was already there.

Do you like this website? Tell us more.

Page 14: CUTGroup 6 OpenStreetMap.org Final Report

Yes

I think it is a great opportunity for people to check out a website and add specific things to a map to have a more collaborative effort. This provides the option for people to mention traffic detours or other situations that are not always constant.

In what ways would you improve this map editor to serve your needs? Or why does a map editor not serve your needs? Truthfully I feel a great affinity to google maps and it would be hard to change it for me. I feel like it provides me with everything I need to know and I am never really frustrated with using it. Do you like the CUTGroup? Yes Did you like this CUTGroup test? Yes Anything else you want to add? Nope I had a very pleasant experience.

2014-01-22 17:39:52

Page 15: CUTGroup 6 OpenStreetMap.org Final Report

Tester #: 2

Tester Profile (given by tester): Location finder

Was this form filled out by a Proctor? No What browser are you using? Internet Explorer How do you use maps? To find locations Review the homepage. What do you think this site does? Gives viewers the options of checking locations in various cities and states. Without looking back at the Web site, what are three things you noticed on the homepage? The map options, colors, and the sizes. OpenStreetMap allows users to modify and edit the map. Would you want to edit this map?

No

Why or why not?

It's fine in it's current state. No adjustments are needed.

Click “Start Mapping” – did you decide to register or use OpenID? Click "Register Now"

Tell us more.

No opinion

After logging in, this site brings you to a welcome page. Did the welcome page give you helpful information? Yes

Tell us more.

The welcome page consisted of valuable information that was helpful.

Click “Start Mapping” at the bottom of this welcome page. Then choose “Start the walkthrough.” Tell us about this experience using the walkthrough. no walkthru

Page 16: CUTGroup 6 OpenStreetMap.org Final Report

Did this meeting your expectations? No Did you finish the walkthough? No

If not, when did you stop? Why? not shown

Did you like the walkthrough? No

Why or why not?

Once you reach the map, what is the first thing you do?

� Click "Export" Tell us more about the first thing you did. I tried clicking on a state on the map. Then I hit explore. It's not as helpful as I thought. The site needs improving. Please find a school, store, community center, or restaurant. Edit the information or add it to the map, and then tell us about this experience. The experience was great. By using the search bar I was able to find the exact location that I was looking for. Did you like the edit features? Yes Was it easy to find what you were looking for? Yes Please search for an address, and tell us about that experience. The experience once again was fast and efficient. The search bar allows me to find what I'm looking for. Do you like the search feature? Yes Will you use the map editor again, on your own? Yes

Why or why not?

It's extremely helpful by allowing me to find the locations in a prompt amount of time.

Do you like this website?

Yes

Tell us more. It's great site and it's not time consuming.

Page 17: CUTGroup 6 OpenStreetMap.org Final Report

In what ways would you improve this map editor to serve your needs? Or why does a map editor not serve your needs? I would allow users to find information about each state by clicking on the states icon. Now that can't be done. Do you like the CUTGroup? Yes Did you like this CUTGroup test? Yes Anything else you want to add? I wouldn't add anything at this time.

2014-01-22 17:44:11

Page 18: CUTGroup 6 OpenStreetMap.org Final Report

Tester #: 3

Tester Profile (given by tester): Young Chicagoan

Was this form filled out by a Proctor? No What browser are you using? Chrome How do you use maps? Google Maps for travel information by bus, train, bike, and walking. Review the homepage. What do you think this site does? The website looks like an interactive map. Similar to maps i have used online in the past, a sleek build and looks simple to use. Easy search bar, nice focus on the United States as the homepage opens up. Without looking back at the Web site, what are three things you noticed on the homepage? Search bar, brings use to view of the United States, and toggle buttons on the righthand side. OpenStreetMap allows users to modify and edit the map. Would you want to edit this map?

Yes

Why or why not?

Add information on missing data.

Click “Start Mapping” – did you decide to register or use OpenID? Click "Register Now"

Tell us more.

Not sure of OpenID and not liking bottom placement.

After logging in, this site brings you to a welcome page. Did the welcome page give you helpful information? Yes

Tell us more.

Pretty good

Click “Start Mapping” at the bottom of this welcome page. Then choose “Start the walkthrough.” Tell us about this experience using the walkthrough.

Page 19: CUTGroup 6 OpenStreetMap.org Final Report

Issue with creating a line, I start the line where I think the line begins but am not sure because the road is under the cover of trees. Next when I follow the next step I do not know how to finish making the line. I assume hitting the esc key will work and it does. I am not able to create a line successfully. On Macbook Pro Retina Did this meeting your expectations? No Did you finish the walkthough? Yes

If not, when did you stop? Why? But never completed the line.

Did you like the walkthrough? Yes

Why or why not?

It was working well but the issue was the line.

Once you reach the map, what is the first thing you do?

� Moved the Map View Tell us more about the first thing you did. Moved over to a location I knew. Please find a school, store, community center, or restaurant. Edit the information or add it to the map, and then tell us about this experience. I added a node to Wilbur Wright College, I added a cafe that is open inside the building. Did you like the edit features? Yes Was it easy to find what you were looking for? Yes Please search for an address, and tell us about that experience. I found my house, sure worked out. Do you like the search feature? Yes Will you use the map editor again, on your own? Yes

Why or why not?

Sure will, seems pretty good and great for public maps.

Do you like this website?

Tell us more.

Works well, the little glitch wasn't fun in the tutorial.

Page 20: CUTGroup 6 OpenStreetMap.org Final Report

Yes In what ways would you improve this map editor to serve your needs? Or why does a map editor not serve your needs? Google is too cut-throat in their editing options and accepting the edits. It was added by the time I got to this part. Do you like the CUTGroup? Yes Did you like this CUTGroup test? Yes Anything else you want to add? Nice usability test :) I study IT and had a class on Interactive Social Media last semester.

2014-01-22 17:50:09

Page 21: CUTGroup 6 OpenStreetMap.org Final Report

Tester #: 4

Tester Profile (given by tester): Qualified to be a taxi driver

Was this form filled out by a Proctor? Yes What browser are you using? Chrome How do you use maps? default to Google Maps, used to use Mapquest. Review the homepage. What do you think this site does? - Has lots of detail, lots of detail block-by-block. State routes noticeable as compared to local roads. - Tried to use arrows keys, problems with the trackpad on the laptop took a second to understand how to navigate. - Noticed a train line. - "I know this is 290 but it doesn't say." Could spot 294 label at zoom 13. - Some of the surface streets are labeled, had a hard time finding. - Purposefully looking at suburbs because of the grid system. - Used the plus icon to zoom in. - Locations/POI are indicated - Very detailed! Parking lot! "Intense". Food and drink at the mall. - Nice to have a key. "Motorway - must be british" has lived in England so comfortable with that. - Colors might need to be bolder Without looking back at the Web site, what are three things you noticed on the homepage? - Very detailed: Addresses on blocks. Different types of roads are really obvious because of colors. - Easy to navigate. - Wasn't trying to map directions. OpenStreetMap allows users to modify and edit the map. Would you want to edit this map?

No

Why or why not?

Hesitant because it's very subjective. Something like a map shouldn't be screwed around with, especially if it's an area you're not familiar with. Would be more comfortable with e-mailing to notify about a problem.

Click “Start Mapping” – did you decide to register or use OpenID? Click "Register Now"

Tell us more.

Using a generic e-mail address for registration. Had to highlight the text to read the registration info. Is reading the terms of use. "Want my blood, too?" Was concerned about logging in to e-mail on test computer for confirmation.

After logging in, this site brings you to a welcome page. Did the welcome page give you helpful information?

Tell us more.

Straightforward what the 4 keywords are. "Virtual helpdesk". Make the bottom part about notes bigger. Everything's pretty small.

Page 22: CUTGroup 6 OpenStreetMap.org Final Report

Yes Click “Start Mapping” at the bottom of this welcome page. Then choose “Start the walkthrough.” Tell us about this experience using the walkthrough. Didn't notice that the location was being asked for because it was at the top. There was an odd bug where it went back to the non-edit page and we had to backtrack. A little confused about where the Point button is. Had a hard time deciding on a name for the Cafe. Trying to hit enter to accept the name change but it wouldn't work. The "menu around the point" was a bit confusing because it wasn't around the point, it was just a circle to the lower left of the point. Didn't seem very excited about actually doing the mapping. "This can get a little intricate" "I don't know" for the name of the playground. The grey box around the preset editor is blocking the residential road preset selection. Got really frustrated at this point. Called it a test. The last part was confusing and didn't know how to get past Residential road. Did this meeting your expectations? Yes Did you finish the walkthough? No

If not, when did you stop? Why? Bug in the residential road selection.

Did you like the walkthrough? Yes

Why or why not?

It was helpful. Would have tried to figure it out.

Once you reach the map, what is the first thing you do?

� Click "Edit" Tell us more about the first thing you did. If I had some time, I'd try to look for what's listed and what's not. Went to google to find the place and it's address. Found "1328 Morse" and Google has it, but OSM doesn't. It's between two buildings, so do we add it? Do we look at google to know how they did it? Please find a school, store, community center, or restaurant. Edit the information or add it to the map, and then tell us about this experience. Clicked the edit arrow instead of the button, "That's Confusing". Didn't find a preset for her place. If I had the time, could get in to it. Did you like the edit features? Yes Was it easy to find what you were looking for? Yes Please search for an address, and tell us about that experience.

Page 23: CUTGroup 6 OpenStreetMap.org Final Report

Found the search box easily. It comes up quickly; it's not changed on the map but came up on the search. Same as on Google. Do you like the search feature? Yes Will you use the map editor again, on your own? No

Why or why not?

If I'm snowed in, trying to keep myself occupied. A business owner might do this -- one time thing.

Do you like this website?

Yes

Tell us more. It's OK. I liked the detail, takes some getting used to.

In what ways would you improve this map editor to serve your needs? Or why does a map editor not serve your needs? Line and Area would be tedious. Do you like the CUTGroup? Yes Did you like this CUTGroup test? Yes Anything else you want to add?

2014-01-22 18:01:28

Page 24: CUTGroup 6 OpenStreetMap.org Final Report

Tester #: 5

Tester Profile (given by tester): kirehernan

Was this form filled out by a Proctor? No What browser are you using? Chrome How do you use maps? google maps to find directions Review the homepage. What do you think this site does? I believe the site's function is similar to most all other atlases which provides directions to locations of interest. I might be inclined to use it because I'm curious to find out why there is a log in option? It makes me wonder if I will have an opportunity to contribute to the building of this map/program Without looking back at the Web site, what are three things you noticed on the homepage? There is a log in option at the top right. There is a search option on the left and some interactive options on the right to play with. These are things that seem worth investigating further OpenStreetMap allows users to modify and edit the map. Would you want to edit this map?

Yes

Why or why not?

I believe in power of people and having a significant contribution to these things. Gives a sense of community and add value in the sense of belonging

Click “Start Mapping” – did you decide to register or use OpenID? Click "Register Now"

Tell us more.

Not familiar with OpenID and have really just become used to registering the more conventional way.

After logging in, this site brings you to a welcome page. Did the welcome page give you helpful information? Yes

Tell us more.

I would probably compare it to the legend section of most all other maps

Click “Start Mapping” at the bottom of this welcome page. Then choose “Start the

Page 25: CUTGroup 6 OpenStreetMap.org Final Report

walkthrough.” Tell us about this experience using the walkthrough. The walkthrough was very nicely created. Great use of highlighting the specific areas of interest. I went through the entire tuturial without much hesitation at all. The initial instance of "marking/contributing" to the map was a little getting used to only because like past experiences, maps and directions were pretty static. So changing that mind set from consumer to contributor is a pretty awesome shift. I like it! Did this meeting your expectations? Yes Did you finish the walkthough? Yes

If not, when did you stop? Why? Very fun, Look forward to contributing.

Did you like the walkthrough? Yes

Why or why not?

Easy functionality

Once you reach the map, what is the first thing you do?

� Inspect element Tell us more about the first thing you did. Still learning about coding myself and always enjoy looking at how the site was created. Although, not fully understanding every step, I have an opportunity to find a few things that look familiar. Please find a school, store, community center, or restaurant. Edit the information or add it to the map, and then tell us about this experience. I initially searched by the name of the community center "A Safe Haven", search results came up empty. Then inputted the address in the search bar, snake eyes. I reverted to the zoom out option and scrolled over to a different location, "Richard Daley Library" near Kedzie and Chicago. After a bit of drag and scroll over, I was able to find the location. Maybe I need a little more practice on the program to learn a little more on its functionality Did you like the edit features? Yes Was it easy to find what you were looking for? No Please search for an address, and tell us about that experience. same as above Do you like the search feature? Yes Will you use the map Why or why not?

Page 26: CUTGroup 6 OpenStreetMap.org Final Report

editor again, on your own? Yes

This would be similar to the comments above, I like the idea of collaboration and contribution. Some areas don't have as much visibility as others and if I have access to it, I'm more than happy to add to it's visibility

Do you like this website?

Yes

Tell us more. It's a good start and look forward to sharing it with others to get their opinion

In what ways would you improve this map editor to serve your needs? Or why does a map editor not serve your needs? love the shortcut options. add more. The more I use the program the more likely I will use the shortcuts, too. Do you like the CUTGroup? Yes Did you like this CUTGroup test? Yes Anything else you want to add? Your group is AWESOME!!! You're invited to hangout at our space and come in for tea: http://www.icstars.org/engage/high-tea

2014-01-22 18:25:44

Page 27: CUTGroup 6 OpenStreetMap.org Final Report

Tester #: 6

Tester Profile (given by tester): Frequent Mobile User

Was this form filled out by a Proctor? No What browser are you using? Chrome How do you use maps? Google Maps via mobile device Review the homepage. What do you think this site does? The homepage is very bland. It's just a basic map in a single color. The only initial thought is that it has something to do with geography or maps. Not something I would actively go to or use, mainly due to its lack of color and landmarks. Without looking back at the Web site, what are three things you noticed on the homepage? The map, search bar to the right, and the green writing on the top of the screen. OpenStreetMap allows users to modify and edit the map. Would you want to edit this map?

Yes

Why or why not?

I felt the need to customize it, and make it more personal. Add some basic landmarks, and things that even a non native would know.

Click “Start Mapping” – did you decide to register or use OpenID? Click "Register Now"

Tell us more.

Registration was easy, and didn't require a ton of information

After logging in, this site brings you to a welcome page. Did the welcome page give you helpful information? Yes

Tell us more.

I like how the information clearly showed users how to edit the maps.

Click “Start Mapping” at the bottom of this welcome page. Then choose “Start the walkthrough.” Tell us about this experience using the walkthrough.

Page 28: CUTGroup 6 OpenStreetMap.org Final Report

It was detailed, and gave a great first hand view of the city. It was pretty easy to get started, and label things on the maps. All the basics were covered. With all the basics being covered, it was still pretty short, and didn't drag Did this meeting your expectations? Yes Did you finish the walkthough? Yes

If not, when did you stop? Why?

Did you like the walkthrough? Yes

Why or why not?

It was easy to use, and was simple and concise with the directions.

Once you reach the map, what is the first thing you do?

� Moved the Map View Tell us more about the first thing you did. The first thing I did was look around the map to see if there was anything labeled. Having an overhead view of the area gave me a new perspective on the area, and showed me a lot of buildings I hadn't noticed, and I have lived in the area over a year. Please find a school, store, community center, or restaurant. Edit the information or add it to the map, and then tell us about this experience. It wasn't hard to get the map over my local area. Editing the map was simple, and I would use this in the future, especially if it were available via mobile Did you like the edit features? Yes Was it easy to find what you were looking for? Yes Please search for an address, and tell us about that experience. Search was not properly functioning. It doesn't direct me to a single spot on the map. Do you like the search feature? No Will you use the map editor again, on your own? Yes

Why or why not?

As a Chicago native, i would use it to become familiar with areas I don't travel to as often. I could see it as a huge asset to people who are downtown, and with some edits, a huge asset to tourists.

Page 29: CUTGroup 6 OpenStreetMap.org Final Report

Do you like this website?

Yes

Tell us more. It was extremely clear and concise at the homepage. It could use a little color. As of right now I would use it, due to its's capabilities to customize my area. I could see a lot of neighborhoods adding the local businesses that can get overshadowed.

In what ways would you improve this map editor to serve your needs? Or why does a map editor not serve your needs? While, relatively easy to pick-up, I can see the learning curve being a big issue for both non tech savvy, and tourists. It's a lot of information thrown at you, and it can get confusing. Do you like the CUTGroup? Yes Did you like this CUTGroup test? Yes Anything else you want to add?

2014-01-22 18:27:53

Page 30: CUTGroup 6 OpenStreetMap.org Final Report

Tester #: 7

Tester Profile (given by tester): Bakunzi

Was this form filled out by a Proctor? No What browser are you using? Chrome How do you use maps? For directions and to explore places of interest Review the homepage. What do you think this site does? Something navigational Without looking back at the Web site, what are three things you noticed on the homepage? 1) How large and simple the map was 2) How simple it appeared (not a lot of navigation buttons OpenStreetMap allows users to modify and edit the map. Would you want to edit this map?

No

Why or why not?

I personally would but I would not want others to have the same access as I would due to the lack of restrictions.

Click “Start Mapping” – did you decide to register or use OpenID? Used OpenID

Tell us more.

I tried "Open ID" but when I discovered what that was I had to sign up because I do not have an "Open ID".

After logging in, this site brings you to a welcome page. Did the welcome page give you helpful information? Yes

Tell us more.

Click “Start Mapping” at the bottom of this welcome page. Then choose “Start the walkthrough.” Tell us about this experience using the walkthrough. It was amazingly straight forward and easy to understand.

Page 31: CUTGroup 6 OpenStreetMap.org Final Report

Did this meeting your expectations? Yes Did you finish the walkthough? Yes

If not, when did you stop? Why? n/a

Did you like the walkthrough? Yes

Why or why not?

I did not know where the "point" was that it was referring to but after that it appeared okay.

Once you reach the map, what is the first thing you do?

� Moved the Map View Tell us more about the first thing you did. I wanted to explore the areas of the city that I recognized and fond an error though I need to research more but I am pretty sure that there isn't a McDonalds where it said there was one! Please find a school, store, community center, or restaurant. Edit the information or add it to the map, and then tell us about this experience. A little difficult but patience is required. I think rather than lines I would of preferred pre set shapes who sizes can be manipulated. Did you like the edit features? No Was it easy to find what you were looking for? Yes Please search for an address, and tell us about that experience. VERY cumbersome. There were many lists to the left side of the screen and the one I wanted was not there. Do you like the search feature? No Will you use the map editor again, on your own? Yes

Why or why not?

Out of sheer curiosity because it was fun being a part of something experimental but not something I would use.

Do you like this website?

Yes

Tell us more. Fun and developing. More of a "puzzle".

Page 32: CUTGroup 6 OpenStreetMap.org Final Report

In what ways would you improve this map editor to serve your needs? Or why does a map editor not serve your needs? I think a map editor gives too many people access to create useless, invasive and incorrect information on points of interest. Where someone died, lives, kissed, got engaged, the food (good or bad). etc etc. I think these things should be done by a qualified topograher. Do you like the CUTGroup? Yes Did you like this CUTGroup test? Yes Anything else you want to add? I enjoyed the experience. Made me think and process. And made me realize how influential one person could potentially be when it came to having access. And especially via the internet and the privacy of their own home.

2014-01-22 18:28:01

Page 33: CUTGroup 6 OpenStreetMap.org Final Report

Tester #: 8

Tester Profile (given by tester): slackerdiva

Was this form filled out by a Proctor? No What browser are you using? Chrome How do you use maps? Navigate my way on foot in different cities like NYC or to get places that I have no idea of the location. Review the homepage. What do you think this site does? Looks like a mash-up of mapquest and google maps but Chicago oriented. Without looking back at the Web site, what are three things you noticed on the homepage? The gray blob that is the United Center. Everything else is rather nondescipt. OpenStreetMap allows users to modify and edit the map. Would you want to edit this map?

Yes

Why or why not?

Fun and to see what this baby can do.

Click “Start Mapping” – did you decide to register or use OpenID? Click "Register Now"

Tell us more.

So far just navigating my way. Interested in topics.

After logging in, this site brings you to a welcome page. Did the welcome page give you helpful information? Yes

Tell us more.

It could be less bland. Less generic. More graphics that would instantly let someone who cant read english know what it does.

Click “Start Mapping” at the bottom of this welcome page. Then choose “Start the walkthrough.” Tell us about this experience using the walkthrough. i don't know couldn't find.

Page 34: CUTGroup 6 OpenStreetMap.org Final Report

Did this meeting your expectations? No Did you finish the walkthough? No

If not, when did you stop? Why? the button was supposed to appear.

Did you like the walkthrough? No

Why or why not?

couldn't navigate it.

Once you reach the map, what is the first thing you do?

� Click "Edit" Tell us more about the first thing you did. I'm trying to leave a comment on a "topic" and am unclear about how to do it. Please find a school, store, community center, or restaurant. Edit the information or add it to the map, and then tell us about this experience. Clicked the store macy's and the menu gave me several choices. Did you like the edit features? Yes Was it easy to find what you were looking for? No Please search for an address, and tell us about that experience. It was copastetic. Do you like the search feature? Yes Will you use the map editor again, on your own? Yes

Why or why not?

I don't know it how to navigate the site that well yet and I don't know how this technology will enable me to share what I want to with others. So I need to experience it and see how it serves others.

Do you like this website?

Yes

Tell us more. This is a hyper local thing that can definitely be utilized as a social and communicative tool in innumerable ways.

In what ways would you improve this map editor to serve your needs? Or why does a map

Page 35: CUTGroup 6 OpenStreetMap.org Final Report

editor not serve your needs? Make it more user intuitive. Like a kindergartner would understand. Not that we think like 5 year olds but just very intuitive so I don't have to second guess the lingo. Do you like the CUTGroup? Yes Did you like this CUTGroup test? Yes Anything else you want to add? I would love to be a beta tester!

2014-01-22 18:30:55

Page 36: CUTGroup 6 OpenStreetMap.org Final Report

Tester #: 9

Tester Profile (given by tester): Sweetie Pie24

Was this form filled out by a Proctor? No What browser are you using? Chrome How do you use maps? Shopping, long distance travel, First day of classes in a new school, new neighborhood Review the homepage. What do you think this site does? Similar to google maps, helps find locations, landmarks, for traveling. Without looking back at the Web site, what are three things you noticed on the homepage? Blue colors Map of USA search bar OpenStreetMap allows users to modify and edit the map. Would you want to edit this map?

No

Why or why not?

I have no reason to edit. The map should already be accurate.

Click “Start Mapping” – did you decide to register or use OpenID? Click "Register Now"

Tell us more.

Had to search for the register ID part. Very confusing. Did not understand Open url.

After logging in, this site brings you to a welcome page. Did the welcome page give you helpful information? Yes

Tell us more.

The welcome page should be up before I have to register my info.

Click “Start Mapping” at the bottom of this welcome page. Then choose “Start the walkthrough.” Tell us about this experience using the walkthrough. Walk through was too long. too many steps. A video would have been more interesting.

Page 37: CUTGroup 6 OpenStreetMap.org Final Report

Did this meeting your expectations? Yes Did you finish the walkthough? No

If not, when did you stop? Why? After the first three steps.

Did you like the walkthrough? No

Why or why not?

Time consuming and boring would have preferred a video where I could pause and watch again if I'm confused about something.

Once you reach the map, what is the first thing you do?

� Click "History" Tell us more about the first thing you did. Wanted to see what other users searched for and edited. was curious. Did not expect the site to be so boring. Expectations not met. Useless. Please find a school, store, community center, or restaurant. Edit the information or add it to the map, and then tell us about this experience. My old community College. Found my school but the information was not detailed. No need for me to use the info at all. Did you like the edit features? No Was it easy to find what you were looking for? Yes Please search for an address, and tell us about that experience. My neighborhood was easy to find. More detailed and streamlined information. Do you like the search feature? Yes Will you use the map editor again, on your own? No

Why or why not?

No need when I have google maps.

Do you like this website?

No

Tell us more. No. Make a website that is easier to use. More user friendly. Less steps.

Page 38: CUTGroup 6 OpenStreetMap.org Final Report

In what ways would you improve this map editor to serve your needs? Or why does a map editor not serve your needs? I have no need to edit the maps. An map that isnt accurate is useless in my opinion. Do you like the CUTGroup? Yes Did you like this CUTGroup test? Yes Anything else you want to add? Helpful instructors. Nice atmosphere. Horrid location. Need a location downtown.

2014-01-22 18:35:16

Page 39: CUTGroup 6 OpenStreetMap.org Final Report

Tester #: 10

Tester Profile (given by tester): jjohnson

Was this form filled out by a Proctor? No What browser are you using? Safari How do you use maps? Phone app Review the homepage. What do you think this site does? Search for specific places throughout the world Without looking back at the Web site, what are three things you noticed on the homepage? Links, search, users OpenStreetMap allows users to modify and edit the map. Would you want to edit this map?

Yes

Why or why not?

To add shortcuts, and cool places

Click “Start Mapping” – did you decide to register or use OpenID? Click "Register Now"

Tell us more.

Force of habit

After logging in, this site brings you to a welcome page. Did the welcome page give you helpful information? Yes

Tell us more.

Yes it let me know where to start searching for

Click “Start Mapping” at the bottom of this welcome page. Then choose “Start the walkthrough.” Tell us about this experience using the walkthrough. It was cool to learn about how to use this map and where the links are located.

Page 40: CUTGroup 6 OpenStreetMap.org Final Report

Did this meeting your expectations? Yes Did you finish the walkthough? Yes

If not, when did you stop? Why?

Did you like the walkthrough? Yes

Why or why not?

Informational

Once you reach the map, what is the first thing you do?

� Used the Search Feature Tell us more about the first thing you did. I looked for my house as well as friends houses Please find a school, store, community center, or restaurant. Edit the information or add it to the map, and then tell us about this experience. Tried it but it did not work for me Did you like the edit features? Yes Was it easy to find what you were looking for? Yes Please search for an address, and tell us about that experience. It popped right up but I had to put in all the details like direction and city Do you like the search feature? Yes Will you use the map editor again, on your own? Yes

Why or why not?

Pretty cool app like new apps always

Do you like this website?

Yes

Tell us more. Pretty much any start-up I am excited about.

In what ways would you improve this map editor to serve your needs? Or why does a map editor not serve your needs?

Page 41: CUTGroup 6 OpenStreetMap.org Final Report

Being better tablet friendly so I can switch between screens Do you like the CUTGroup? Yes Did you like this CUTGroup test? Yes Anything else you want to add?

2014-01-22 18:35:17

Page 42: CUTGroup 6 OpenStreetMap.org Final Report

Tester #: 11

Tester Profile (given by tester): Over-the-road tour guide

Was this form filled out by a Proctor? Yes What browser are you using? Firefox How do you use maps? Maps on the phone for directions, interested in maps in general. Review the homepage. What do you think this site does? Would probably click "start mapping" without "learning more". Spent time Without looking back at the Web site, what are three things you noticed on the homepage? - Lots of color, easy on the eye. Blue made it easier to see the highways. Easy to read. - Easy to navigate once I learned the mouse. OpenStreetMap allows users to modify and edit the map. Would you want to edit this map?

Yes

Why or why not?

Might get junked up if it had lots of stuff that I added. Want to simplify the map. "A little freaky" to make changes to the map.

Click “Start Mapping” – did you decide to register or use OpenID? Click "Register Now"

Tell us more.

After logging in, this site brings you to a welcome page. Did the welcome page give you helpful information? Yes

Tell us more.

It should say something about it being permanent and fixed.

Click “Start Mapping” at the bottom of this welcome page. Then choose “Start the walkthrough.” Tell us about this experience using the walkthrough.

Page 43: CUTGroup 6 OpenStreetMap.org Final Report

Difficult to see the "zoom in to start mapping" flag under the Edit link. We don't use cafe unless we're in paris. Did this meeting your expectations? No Did you finish the walkthough? No

If not, when did you stop? Why? Buggy/slow computer/missing mouse

Did you like the walkthrough? Yes

Why or why not?

Once you reach the map, what is the first thing you do?

� Click "Edit" Tell us more about the first thing you did. Found a building that contains a Salvation Army store. Please find a school, store, community center, or restaurant. Edit the information or add it to the map, and then tell us about this experience. It was kind of fun, the trackpad was troublesome. I think it would interesting to follow. It's so easy to go straight to google to find stuff. Having the stuff on the map is helpful. Did you like the edit features? Yes Was it easy to find what you were looking for? Yes Please search for an address, and tell us about that experience. A little spooky to have the house highlighted. Do you like the search feature? Yes Will you use the map editor again, on your own? Yes

Why or why not?

Curious to see what other people have done.

Do you like this website?

Yes

Tell us more. May use it more to look up locations. Not interested in editing very much or adding notes.

Page 44: CUTGroup 6 OpenStreetMap.org Final Report

In what ways would you improve this map editor to serve your needs? Or why does a map editor not serve your needs? Needed a mouse. Do you like the CUTGroup? Yes Did you like this CUTGroup test? Yes Anything else you want to add? First time, couldn't come to the last one.

2014-01-22 19:13:19

Page 45: CUTGroup 6 OpenStreetMap.org Final Report

Tester #: 12

Tester Profile (given by tester): cherub

Was this form filled out by a Proctor? No What browser are you using? Chrome How do you use maps? Mainly on a mobile device while trying to get myself from one place to another and occasionally I'll use a road atlas during the summer months and road trips Review the homepage. What do you think this site does? It's an interactive map that users can edit if they deem it necessary. It looks like a combination of google maps, yelp, twitter, foursquare, facebook, flickr, etc. Kind of an amalgamation of all the data you use throughout your days. If it works well, I would love this. Especially if it's available on smart phones. Without looking back at the Web site, what are three things you noticed on the homepage? Clean design which is such a welcome sight. There's an unfortunately large number of web sites that are hampered by poor design, rendering them nearly unusable. Because it's not like there's tons of young people with design degrees that are looking for jobs and would accept a pittance for a salary or anything... OpenStreetMap allows users to modify and edit the map. Would you want to edit this map?

Yes

Why or why not?

If I notice outdated information, I feel compelled to update services I use because I'd expect others to do the same

Click “Start Mapping” – did you decide to register or use OpenID? Click "Register Now"

Tell us more.

I registered because this has the potential to be incredibly useful for me. I used a common login because I'm boring.

After logging in, this site brings you to a welcome page. Did the welcome page give you helpful information?

Tell us more.

I'm immensely happy to see the site clearly stating that this sight is not for opinions. Comment sections are a great place to see the depth of human depravity. But I was a little bummed to see that it also mentioned there will not be historical data.

Page 46: CUTGroup 6 OpenStreetMap.org Final Report

Yes Click “Start Mapping” at the bottom of this welcome page. Then choose “Start the walkthrough.” Tell us about this experience using the walkthrough. It helped get me acquainted with the features and how exactly to use them. It was short and to the point. Some of the grammar or lingo tripped me up. One sentence in particular had a strange cadence to it-it used three similar words in a row and confused me as to what it was saying. Assigning special specific meanings to commonly used nouns where they mean one thing everywhere in the world except for this one specific website seems like a bad idea. Did this meeting your expectations? Yes Did you finish the walkthough? Yes

If not, when did you stop? Why?

Did you like the walkthrough? Yes

Why or why not?

Not too long and kept with just the basics.

Once you reach the map, what is the first thing you do?

� Used the Search Feature Tell us more about the first thing you did. Wanted to orient myself on the map and have a better idea of what I was looking at. Picked my hometown suburb thinking it'd be easier than the major metropolitan area of Chicago. Spent a little time getting used to the symbols and where to look to find all the different information available. The titles of whatever I had selected didn't stand out as much as I wanted, I found my eyes overlooking it pretty regularly. Please find a school, store, community center, or restaurant. Edit the information or add it to the map, and then tell us about this experience. I added the YMCA from my hometown since it wasn't labeled. Had some difficulty picking the right identifying tag, didn't find a "community center" one. I like that there's not a minimum amount of information you have to add, just whatever you know is okay. Think that allows for more up to date and accurate listings. Did you like the edit features? Yes Was it easy to find what you were looking for? Yes Please search for an address, and tell us about that experience.

Page 47: CUTGroup 6 OpenStreetMap.org Final Report

Wish the names and/or titles of the selected were more prominent on the left panel. Wish some of the buttons were labeled or included in the overview because I wasn't always certain what they did. Obviously the search is a must for any map. But I didn't like how I always had to click "search worldwide" because none of my search terms showed up in my visible map area. Do you like the search feature? Yes Will you use the map editor again, on your own? Yes

Why or why not?

I use maps often when traveling around the city and consider them one of the most important functions of my smart phone. The history nerd in me wishes I could use this to learn about areas or unique events that occurred in the past. I could also see myself constantly adding my own info to the map to share with others.

Do you like this website?

Yes

Tell us more. I'm excited to see how this develops and improves. Add a "community center" or public works tag for buildings. As a night owl, I'm also continually frustrated with the dearth of open late businesses. Having a way of quickly seeing what is still open would be great. Or convincing more businesses to switch to the 24 hour workday, if you don't mind.

In what ways would you improve this map editor to serve your needs? Or why does a map editor not serve your needs? As stated above, historical tidbits would be a fun addition. Open late establishments. Nice scenic walking routes. Places to go and play with puppies because your building has a no pets policy. Do you like the CUTGroup? Yes Did you like this CUTGroup test? Yes Anything else you want to add? Thanks!

2014-01-22 19:18:22

Page 48: CUTGroup 6 OpenStreetMap.org Final Report

Tester #: 13

Tester Profile (given by tester): tech educator

Was this form filled out by a Proctor? No What browser are you using? Chrome How do you use maps? I use maps to get around, to get to know my neighborhood and others, and to get a sense of where the young people I work with are coming from. Review the homepage. What do you think this site does? I think that OpenStreetMap is like a wiki of map information -- it allows local users with better, more applicable knowledge to make edits to maps for best use. This is definitely something I am interested in -- as someone who travels by foot, by public transit, by bike and by car, I have had multiple occasions where the directions provided to me by Google Maps (my map client of choice) have been confusing or even inaccurate. The idea of a map resource with real travelers' input is appealing because it might help me and others avoid frustrating situations where we can't find our way. Without looking back at the Web site, what are three things you noticed on the homepage? A button to get started mapping, a button to do GPS traces, a map of the United States OpenStreetMap allows users to modify and edit the map. Would you want to edit this map?

Yes

Why or why not?

I would add information about safe, passable pedestrian routes in neighborhoods, as well as information about transit station exits and entrances

Click “Start Mapping” – did you decide to register or use OpenID? Click "Register Now"

Tell us more.

I signed up because I might want to use this in the future -- as well as share the resource with others

After logging in, this site brings you to a welcome page. Did the welcome page give you helpful information?

Tell us more.

I saw it after confirming my email. I like the info -- I feel like it confirms what I thought the maps could do. Maybe an example of what "mapping" looks like?

Page 49: CUTGroup 6 OpenStreetMap.org Final Report

Yes Click “Start Mapping” at the bottom of this welcome page. Then choose “Start the walkthrough.” Tell us about this experience using the walkthrough. This is really helpful in teaching me how to use it. I'm not a fan of how the toolbar on the left flickered with mouse-over in the beginning of the tutorial, though. I'm having a lot of trouble with the Lines function -- I know I wasn't doing it right, but the directions weren't super clear about where to start, and then I managed to break it it asked me to select "Road" from the left but I couldn't type or see anything. Fixed it by clicking "Line" on the progress bar, though. It's interesting that there is no "Save" function before you close the editor -- that doesn't feel natural to me. But I don't see it as a problem as long as users complete the training. Did this meeting your expectations? Yes Did you finish the walkthough? Yes

If not, when did you stop? Why?

Did you like the walkthrough? Yes

Why or why not?

Once you reach the map, what is the first thing you do?

� Moved the Map View Tell us more about the first thing you did. I saw an area I was unfamiliar with, so I navigated to a part of Chicago where I used to live, which I am very familiar with. I was curious to see whether a pedestrian path I often would take but which appears as a dead-end on other maps was accounted for. It was not, and I added in a Line to mark it as a pathway. Please find a school, store, community center, or restaurant. Edit the information or add it to the map, and then tell us about this experience. I found a neighborhood bar I've been to that was unidentified so far. I added its name and its category. The ability to add information to a specific building is awesome -- I can see this being really useful to me when I am wondering what a building houses -- maybe someone has added information to it on OpenStreetMap and I can find out more! (I would love to contribute to that knowledge pool) Did you like the edit features? Yes Was it easy to find what you were looking for? Yes Please search for an address, and tell us about that experience.

Page 50: CUTGroup 6 OpenStreetMap.org Final Report

I tried searching an address but it wasn't in the viewable area of the map so it didn't find it. But then, when I tried to expand the visible area, it still didn't find the address. It turns out that OpenStreetMap lists the building under a different address (on a different street) from what is given elsewhere online. (?!) I also learned that I had to double-finger zoom out first to get the cursor to turn into a map-moving hand rather than a feature selector Do you like the search feature? No Will you use the map editor again, on your own? Yes

Why or why not?

It's super cool! I haven't seen any other geographic resource like this, and it's something I've often wanted.

Do you like this website?

Yes

Tell us more. I think it's pretty cool! I want to take full advantage of it in adding information about pedestrian pathways and accessing information about buildings. (Histories! What occupies there!)

In what ways would you improve this map editor to serve your needs? Or why does a map editor not serve your needs? I would use it when navigating an unfamiliar area -- where do I exit a train station? How do I walk to this bus stop? Do you like the CUTGroup? Yes Did you like this CUTGroup test? Yes Anything else you want to add? This is fun! Looking forward to see how this tool grows.

2014-01-22 19:19:23

Page 51: CUTGroup 6 OpenStreetMap.org Final Report

Tester #: 14

Tester Profile (given by tester): i like maps. i also like UI/UX

Was this form filled out by a Proctor? No What browser are you using? Chrome How do you use maps? To get directions to places, to estimate travel time on public transportation, to estimate distance in case i want to walk somewhere (or if i went on a run and want to see how far it was), to find places to eat or things to do within close to where i am Review the homepage. What do you think this site does? It's a map site. Just from the homepage I know that I can free-browse or I can search - but I'm not sure if I can get directions to/from places. The welcome/helper text implies that it's editable by anyone. I think this is a tool that works similarly to google maps, but borrows aspects of wikipedia or yelp (i.e. anyone can add "landmarks" or comments tied to a physical location). "history" "gps traces" "user diaries" these buttons in the nav menu are a bit unclear to me, but are also intriguing. Without looking back at the Web site, what are three things you noticed on the homepage? The map! The welcome/helper text! Nav bar on top + icons o n the right side. OpenStreetMap allows users to modify and edit the map. Would you want to edit this map?

No

Why or why not?

What am i editing? State borders? Would I edit the information that is overlayed on the map... maybe, but first i'd need to see what kind of information is already there or read some guidelines on what is acceptable or expected by other users

Click “Start Mapping” – did you decide to register or use OpenID? Click "Register Now"

Tell us more.

I personally don't have OpenID set up.. or if I do, I didn't know. When sites allow me to login with Google account i always elect that option. When it's facebook connect, 50/50 whether i do it.

After logging in, this site brings you to a welcome page. Did the welcome page give you helpful information?

Tell us more.

I think it gave me a good start [and guessing the walkthrough will clear things up] but for now i'm not sure what exactly i'd use this site for.

Page 52: CUTGroup 6 OpenStreetMap.org Final Report

No Click “Start Mapping” at the bottom of this welcome page. Then choose “Start the walkthrough.” Tell us about this experience using the walkthrough. There was no "start the walkthrough" Did this meeting your expectations? No Did you finish the walkthough? No

If not, when did you stop? Why? Never started... wanted to though!

Did you like the walkthrough? No

Why or why not?

Because it's hiding from me :(

Once you reach the map, what is the first thing you do?

� Click "Edit" Tell us more about the first thing you did. I didn't get to do the walkthrough so I wasn't really sure what to do now. As i moved my mouse around the browser, I noticed that when I moused over buildings that the sidebar on the left appeared. I was curious to explore the functionality of that so I clicked on a building. From there I clicked the "type of feature" to see what types i could choose from. I was a bit confused why we can add cafes, restaurants, or places of worship... but not retail stores, bars, or other similarly specific types of buildings. I see now that some of these are under "land use" but i'm not sure that the groupings of the types of features make sense to me. Please find a school, store, community center, or restaurant. Edit the information or add it to the map, and then tell us about this experience. I found my favorite coffee shop. I searched "filter coffee shop" and the results said "none in visible area" so i tried worldwide and still no luck. "filter cafe" didn't work either. Thus, I was surprise when i scrolled the map to the area where it's located, and saw that a node/tag already existed for Filter. I wasn't sure what to add, so I added information about the internet. The options here were a bit confusing. I know they have wifi.. so I put "yes" since it's not wired, not terminal [what's that?] and while wlan might mean wireless lan, i really wasn't sure if that's what it meant or not. p.s. tried searching "filter coffee lounge" after i saw that it was tagged as that, and it worked. Did you like the edit features? Yes Was it easy to find what you were looking for? No Please search for an address, and tell us about that experience.

Page 53: CUTGroup 6 OpenStreetMap.org Final Report

It was easy to find it. I would add though, that if I was for some reason in the mood to search up [and edit] many places that were not within one mapview, it would be really annoying that "world wide search" is not the default. Additional thought: I tried to change the field under "building" and it wasn't clear to me that i was changing the type of feature (i.e. didn't know it was same as if i clicked the first field/icon in editing dashboard). The yes/no through me off, and then i didn't know if i should choose house or residential (it's a house that was converted to a two flat and now about to be renovated back to a single family home). the ","s in the helper text imply I can choose multiple options? Do you like the search feature? Yes Will you use the map editor again, on your own? No

Why or why not?

I have rarely found other maps to be inaccurate when it comes to roads/buildings. I remember driving to Round Lake, IL all the time when I was 16 and being surprised that the roads in the new development my friend's family had moved to was already on the GPS... and that was 8 years ago. What I DO find inaccurate all of the time on Gmaps and other services is information about what is on the road.. what is in this building. and furthermore the address/time/website/etc data. I am not frustrated that a store went out of business or changed it's password.. but it's bothersome that i can't make an edit. I know that in the case of google, people can claim listings as their own and then only they can make changes... but also as a kid who's task as an intern was to go to every web directory, map ,etc and set up listings for the company i was working at at the time, that these listings are made and forgotten.

Do you like this website?

Yes

Tell us more. I think it's a really cool tool, nice design, works pretty smoothly. Does what it says it can do and then some.

In what ways would you improve this map editor to serve your needs? Or why does a map editor not serve your needs? It seems like a professional tool. Clicking "background" and seeing all these techy sounding options, being able to edit the map down to the shape of a building, etc... seems like it's built for grander needs than mine. Not sure what industry, but some sort of engineering/urban planning. If it were built for my needs, it would scrape all of the geographic data from gmaps, yelp, etc. and then let anyone make edits. I'd even be okay with objective-data only. Probably two different editing modes.. one for editing information (tags), one for editing actual geographic elements (notes, lines, areas). Probably renaming these types of features would help non-techies want to use it (pins vs. nodes, etc.) Do you like the CUTGroup? Yes Did you like this CUTGroup test? Yes

Page 54: CUTGroup 6 OpenStreetMap.org Final Report

Anything else you want to add? This was my first experience and I've enjoyed it. I'm a product developer / ui/ux designer [in training] at a software dev startup and so the more products i can play with, the better! And if someone values my opinions that's cool too :)

2014-01-22 19:27:42

Page 55: CUTGroup 6 OpenStreetMap.org Final Report

Tester #: 15

Tester Profile (given by tester): Snarky

Was this form filled out by a Proctor? No What browser are you using? Chrome How do you use maps? Mostly google maps, especially for transit directions, in a browser and on my phone. Review the homepage. What do you think this site does? Looks like a map site that anyone can edit or add to, like Wikipedia. Without looking back at the Web site, what are three things you noticed on the homepage? Well I noticed the map. I also saw links to register/login, edit, and a history link. OpenStreetMap allows users to modify and edit the map. Would you want to edit this map?

No

Why or why not?

Initially, no. If I were looking around and saw something missing, I'd add it.

Click “Start Mapping” – did you decide to register or use OpenID? Click "Register Now"

Tell us more.

I often register for sites I visit often

After logging in, this site brings you to a welcome page. Did the welcome page give you helpful information? Yes

Tell us more.

Good overview. I'm curious about editing vs just adding a note. Why one over the other? Are they substantially different?

Click “Start Mapping” at the bottom of this welcome page. Then choose “Start the walkthrough.” Tell us about this experience using the walkthrough. I'm using an iPad. I tried doing the walk through and it didn't load, and then when I came back to this tab

Page 56: CUTGroup 6 OpenStreetMap.org Final Report

wih the survey, it was blank and my progress was lost. This happened twice, and then I gave up Did this meeting your expectations? No Did you finish the walkthough? No

If not, when did you stop? Why? See above

Did you like the walkthrough? No

Why or why not?

Couldn't do it!

Once you reach the map, what is the first thing you do?

� Used the Search Feature Tell us more about the first thing you did. Im not looking for something specific, so I just typed in my home address and started looking around. Please find a school, store, community center, or restaurant. Edit the information or add it to the map, and then tell us about this experience. I wasn't able to edit. The page timed out while loading. Again, I'm using an iPad. Did you like the edit features? No Was it easy to find what you were looking for? No Please search for an address, and tell us about that experience. Search bar is very easy to use. Do you like the search feature? Yes Will you use the map editor again, on your own? Yes

Why or why not?

I'd really like the chance to explore the site on my own, using my laptop.

Do you like this website?

Yes

Tell us more. I like the concept, and I hope people will add useful information, such as walking routes or local businesses.

Page 57: CUTGroup 6 OpenStreetMap.org Final Report

In what ways would you improve this map editor to serve your needs? Or why does a map editor not serve your needs? Can't say. I'd like it not to crash! Do you like the CUTGroup? Yes Did you like this CUTGroup test? Yes Anything else you want to add? Super friendly staff/volunteers

2014-01-22 19:32:37

Page 58: CUTGroup 6 OpenStreetMap.org Final Report

Tester #: 16

Tester Profile (given by tester): Twinnie Mommie

Was this form filled out by a Proctor? No What browser are you using? Safari How do you use maps? maps on car navigation, maps on phone navigation, hard copy of maps for traveling Review the homepage. What do you think this site does? This site shows maps on various locations around the world. I think it allows individuals to access street maps from various countries. Quite interested.....especially when traveling outside of the country.... Without looking back at the Web site, what are three things you noticed on the homepage? I remember the color blue, map of country with counties, name of page OpenStreetMap allows users to modify and edit the map. Would you want to edit this map?

Yes

Why or why not?

When I use my car navigation map it will at times ask me to do something which is not possible. Like make a right turn when the street is one way the other way or continue straight ahead when there is nowhere to go.

Click “Start Mapping” – did you decide to register or use OpenID? Click "Register Now"

Tell us more.

I registered.....thought it might track what I contributed to the map.

After logging in, this site brings you to a welcome page. Did the welcome page give you helpful information? Yes

Tell us more.

It explained the items we might see....but when I went to the welcome page it

Click “Start Mapping” at the bottom of this welcome page. Then choose “Start the walkthrough.” Tell us about this experience using the walkthrough.

Page 59: CUTGroup 6 OpenStreetMap.org Final Report

Could not find what you were asking for......it showed a map I hit the find me icon but there was an error and it did not locate me. I tried looking for "start the walkthrough" did not see it. It walked me through the purpose of each area....line, point, etc. Did this meeting your expectations? No Did you finish the walkthough? Yes

If not, when did you stop? Why?

Did you like the walkthrough? No

Why or why not?

I felt it should allow the users to play around with adding points, lines, etc before actually doing it on a map

Once you reach the map, what is the first thing you do?

� Click "Edit" Tell us more about the first thing you did. Just clicked around the page......I felt a bit overwhelmed looking at the page with all the items on it. I expected to see the map and surprised to see the easy ability to add to it. Being that communities change at such a rapid pace, what was once there may not be. Please find a school, store, community center, or restaurant. Edit the information or add it to the map, and then tell us about this experience. typed in brentano school, chicago, il system did not find it Did you like the edit features? No Was it easy to find what you were looking for? No Please search for an address, and tell us about that experience. I hit the search icon and typed 1924 n spaulding but computer did not find anything Do you like the search feature? No Will you use the map editor again, on your own? No

Why or why not?

Since I was unable to access and use the search function I did not see any use of it.

Do you like this website? Tell us more.

Page 60: CUTGroup 6 OpenStreetMap.org Final Report

No

If it would function to what it is expected to do then it would be something I would use.

In what ways would you improve this map editor to serve your needs? Or why does a map editor not serve your needs? Unable to provide input due to my limited accessibility of the site. Do you like the CUTGroup? Yes Did you like this CUTGroup test? No Anything else you want to add? I typically do enjoy providing input into new sites but this time I was unable to use the site properly.

2014-01-22 19:42:23

Page 61: CUTGroup 6 OpenStreetMap.org Final Report
Page 62: CUTGroup 6 OpenStreetMap.org Final Report
Page 63: CUTGroup 6 OpenStreetMap.org Final Report
Page 64: CUTGroup 6 OpenStreetMap.org Final Report
Page 65: CUTGroup 6 OpenStreetMap.org Final Report
Page 66: CUTGroup 6 OpenStreetMap.org Final Report