Research MethodologyResearch Methodology

Paul WagnerPaul Wagner

(Student ACM Meeting, Fall 2003)(Student ACM Meeting, Fall 2003)

MessagesMessages

Research:Research: Should be about some problem that Should be about some problem that

encourages enthusiasm (for you) and interest encourages enthusiasm (for you) and interest (for others)(for others)

Is often generated from the thought “what Is often generated from the thought “what we’ve got now/from the past isn’t quite we’ve got now/from the past isn’t quite right/good enough – we can do better…”right/good enough – we can do better…”

Consists of work that leads to a meaningful Consists of work that leads to a meaningful contributioncontribution

Generates, in some way, a better solution to Generates, in some way, a better solution to the problemthe problem

What Is Research?What Is Research?

Merriam-Webster’s definition:Merriam-Webster’s definition:

11 :: careful or diligent search careful or diligent search22 :: studious inquiry or examination; studious inquiry or examination; especiallyespecially :: investigation or experimentation aimed at the investigation or experimentation aimed at the discovery and interpretation of facts, revision of discovery and interpretation of facts, revision of accepted theories or laws in the light of new accepted theories or laws in the light of new facts, or practical application of such new or facts, or practical application of such new or revised theories or lawsrevised theories or laws33 :: the collecting of information about a particular the collecting of information about a particular subject subject

What Is Research? (2)What Is Research? (2)

““A combination of investigation of past work and A combination of investigation of past work and effort in the present that will help others in the effort in the present that will help others in the future”future”

A set of oppositesA set of opposites Fun and frustrationFun and frustration Small steps and large insightsSmall steps and large insights Building on others’ work and contributing your own Building on others’ work and contributing your own

workwork

Finding or developing something new that Finding or developing something new that changes the world….changes the world….

What is Research? (3)What is Research? (3)

Quantitative vs. Qualitative ResearchQuantitative vs. Qualitative Research Quantitative – use of statistical, formulaic or Quantitative – use of statistical, formulaic or

numerical analysis to generate resultsnumerical analysis to generate resultsMain approach: analysis; causal determination, Main approach: analysis; causal determination, prediction, generalization of findingsprediction, generalization of findingsResults: “This solution is N% better”Results: “This solution is N% better”

Qualitative – not quantitative; use of non-Qualitative – not quantitative; use of non-numeric techniquesnumeric techniques

Main approach: discovery; illumination, Main approach: discovery; illumination, understanding, extrapolation to similar understanding, extrapolation to similar circumstancescircumstancesResults: “This is a new way of solving our problem”Results: “This is a new way of solving our problem”

Scope of ResearchScope of Research

Varies by level of workVaries by level of work Ph.D. students – contribution expected at Ph.D. students – contribution expected at

world level; e.g.world level; e.g.background investigation on all past workbackground investigation on all past workmake meaningful addition to world knowledgemake meaningful addition to world knowledge

Undergraduate students – contribution can be Undergraduate students – contribution can be at local to national to world level; e.g.at local to national to world level; e.g.

background investigation at university up to world background investigation at university up to world levellevelmake meaningful addition to university up to world make meaningful addition to university up to world level of knowledgelevel of knowledge

What Isn’t ResearchWhat Isn’t Research

Playing with technologyPlaying with technology

Book reportBook report

Programming projectProgramming project

Doing what others have already doneDoing what others have already done

However, each of these can be done as However, each of these can be done as part of researchpart of research

Who Does Research?Who Does Research?

Graduate StudentsGraduate Students Masters Degree (lower standard)Masters Degree (lower standard) Ph.D. Degree (higher standard)Ph.D. Degree (higher standard)

Researchers at universitiesResearchers at universities Post-Doctoral studentsPost-Doctoral students Faculty membersFaculty members

Researchers in industryResearchers in industry Research scientistsResearch scientists Many other technical workersMany other technical workers

Undergraduate students (like you)Undergraduate students (like you)

Who Does Research? (2)Who Does Research? (2)

IndividualsIndividuals

TeamsTeams

Teams almost always make the process Teams almost always make the process easiereasier Division of laborDivision of labor Feedback from team membersFeedback from team members Each member can work to own strengthsEach member can work to own strengths

Research Process (Methodology)Research Process (Methodology)

Initial IdeaInitial IdeaBackground InvestigationBackground InvestigationRefinement of IdeaRefinement of IdeaCore WorkCore Work Investigation and DevelopmentInvestigation and Development DocumentationDocumentation Prototype (if appropriate)Prototype (if appropriate)

EvaluationEvaluationIdentification of Future WorkIdentification of Future WorkPresentationPresentation

Research Process – Initial IdeaResearch Process – Initial Idea

Stems from critical thinkingStems from critical thinkingBe on the lookout for and open to seeing problemsBe on the lookout for and open to seeing problems

Gaps in frameworkGaps in framework Repetitive behavior that’s slightly different (and can be Repetitive behavior that’s slightly different (and can be

generalized)generalized) Manual solutions (that can be automated)Manual solutions (that can be automated) Inelegant solutionsInelegant solutions

Ask questionsAsk questions ““Is something missing here?”Is something missing here?” ““Can this be done in a better way?”Can this be done in a better way?” ““Is there a need for a new approach?”Is there a need for a new approach?”

Should be an area you’re interested in, as:Should be an area you’re interested in, as: You’ll be spending a lot of time with itYou’ll be spending a lot of time with it It won’t always be easy/fun to continue…It won’t always be easy/fun to continue…

Research Process – Research Process – Background InvestigationBackground Investigation

Given an idea, need to determine:Given an idea, need to determine: Has this work been done previously?Has this work been done previously? What similar work has been done leading up to this What similar work has been done leading up to this

point?point? How is any previous work distinguished from what I’m How is any previous work distinguished from what I’m

planning to do?planning to do? What group of people will be positively impacted by What group of people will be positively impacted by

the research?the research?

ToolsTools Literature Review using library resources (e.g. online Literature Review using library resources (e.g. online

databases such as ACM and IEEE, popular databases such as ACM and IEEE, popular magazines)magazines)

WWW searchWWW search

Research Process – Research Process – Refinement of IdeaRefinement of Idea

Based on background investigation, need Based on background investigation, need to refine ideato refine ideaIssues:Issues: Precision – focus on precisely identifying:Precision – focus on precisely identifying:

ProblemProblem Possible solutions (plural!)Possible solutions (plural!)

Scope – need to “build fences”Scope – need to “build fences”What’s an essential part of this work? (fence in)What’s an essential part of this work? (fence in)What’s tangential, additional, or for any other What’s tangential, additional, or for any other reason best left for later/someone else? (fence out)reason best left for later/someone else? (fence out)

Research Process – Core Work, Research Process – Core Work, Investigation and DevelopmentInvestigation and Development

Provide yourself with infrastructureProvide yourself with infrastructure equipment / softwareequipment / software additional knowledge (“get up to speed”)additional knowledge (“get up to speed”)

Do the workDo the work Experimentation (scientific process)Experimentation (scientific process) Develop opinionsDevelop opinions Look for better ways of solving problemLook for better ways of solving problem

Can you generalize?Can you generalize?Can you develop a framework?Can you develop a framework?

Discuss, brainstormDiscuss, brainstorm Reevaluate as you proceedReevaluate as you proceed

Look for improvements, changes to your original ideasLook for improvements, changes to your original ideas

Research Process – Core Work, Research Process – Core Work, Investigation and Development (2)Investigation and Development (2)

ProcessProcess Work regularlyWork regularly

Easier to keep going if have a commitment to a Easier to keep going if have a commitment to a regular work timeregular work time

Helps you keep your past work in mindHelps you keep your past work in mind Allocate large block of time for researchAllocate large block of time for research

Takes time to get going/back to speedTakes time to get going/back to speed

Make sure can do something significant each work Make sure can do something significant each work sessionsession

Research Process – Research Process – Core Work, DocumentationCore Work, Documentation

Need to document as you goNeed to document as you go Don’t want to lose any informationDon’t want to lose any information

1) Maintain a journal for day-to-day thoughts1) Maintain a journal for day-to-day thoughts Can be paper, electronic, ...Can be paper, electronic, ... Keep it with you at all timesKeep it with you at all times

Never know when good ideas will hitNever know when good ideas will hit

2) Keep an updated task list2) Keep an updated task list Focus on accomplishing something each work sessionFocus on accomplishing something each work session

3) Write up your work3) Write up your work Periodically, write a few pages on a subset of your workPeriodically, write a few pages on a subset of your work

Summarize work, accomplishments, problemsSummarize work, accomplishments, problems At end, write up a summary documentAt end, write up a summary document

Can be based on steps discussed hereCan be based on steps discussed here

Research Process – Research Process – Core Work, PrototypeCore Work, Prototype

Need to demonstrate the merit of your Need to demonstrate the merit of your ideasideas

If work is non-theoretical, do this through a If work is non-theoretical, do this through a developed systemdeveloped system No need to build the entire systemNo need to build the entire system Just need to demonstrate the value of the Just need to demonstrate the value of the

core ideascore ideas

Research Process - EvaluationResearch Process - Evaluation

Perhaps the most difficult part….Perhaps the most difficult part…. Best if can show others are already using your workBest if can show others are already using your work

QuantitativeQuantitative Test your prototypeTest your prototype What improvements exist over currently available What improvements exist over currently available

alternative?alternative? How much of an improvement do you see?How much of an improvement do you see?

QualitativeQualitative What can you do now that couldn’t be done before?What can you do now that couldn’t be done before? What are the benefits of your solution?What are the benefits of your solution?

Research Process – Research Process – Identification of Future WorkIdentification of Future Work

Helps you organize any future effortsHelps you organize any future efforts

Helps others build on your workHelps others build on your work

Sources:Sources: What you excluded in your idea refinementWhat you excluded in your idea refinement New problems that have surfaced during your New problems that have surfaced during your

workwork

Research Process - PresentationResearch Process - Presentation

It’s not a contribution to the field if no one It’s not a contribution to the field if no one knows about it or can use itknows about it or can use it

Presentation/DisseminationPresentation/Dissemination Conferences, Journals, WebConferences, Journals, Web

e.g. National Undergraduate Research conferencee.g. National Undergraduate Research conference Papers, Talks, Poster SessionsPapers, Talks, Poster Sessions

e.g. UWEC and UW System Research Dayse.g. UWEC and UW System Research Days

ExampleExample

my Master’s projectmy Master’s project

an example for each of youan example for each of you choose a CS subject you’re interested inchoose a CS subject you’re interested in think of a problem or issue you see in that areathink of a problem or issue you see in that area refine your interest to a possible project that involves refine your interest to a possible project that involves

one or more ways of solving that problemone or more ways of solving that problem outline the steps you’d take to do the project work and outline the steps you’d take to do the project work and

test your ideastest your ideas what is your hypothetical conclusion?what is your hypothetical conclusion? how would you evaluate the quality of your solution?how would you evaluate the quality of your solution?

Research Opportunities in the Research Opportunities in the Computer Science Department at Computer Science Department at

UW-Eau ClaireUW-Eau Claire

Research on ownResearch on ownCollaborative faculty-student research Collaborative faculty-student research projectsprojects funded by Research Office and Departmentfunded by Research Office and Department possibly for credit: CS 493possibly for credit: CS 493

Supervised student research projectsSupervised student research projects CS 482 (Research I), CS 492 (Research II)CS 482 (Research I), CS 492 (Research II)

SIG-ResearchSIG-Research

ResourcesResources

http://www.cs.indiana.edu/mit.research.hohttp://www.cs.indiana.edu/mit.research.how.to/mit.research.how.to.htmlw.to/mit.research.how.to.html

http://www-2.cs.cmu.edu/afs/cs.cmu.edu/uhttp://www-2.cs.cmu.edu/afs/cs.cmu.edu/user/mleone/web/how-to.htmlser/mleone/web/how-to.html

http://www.honors.ucr.edu/research.htmhttp://www.honors.ucr.edu/research.htm

http://www.utexas.edu/research/eureka/rehttp://www.utexas.edu/research/eureka/resources/why/index.phpsources/why/index.php