diversity-aware search for people, content, events and diversity-aware hiring and evaluation

Trusting Differently: Diversity-aware search for people, content, events

Trusting Differently: Diversity-aware search for people, content, events

Judith Simon, Institut Nicod, CNRS

Aliaksandr Birukou, University of Trento, Italy

[Insert header here][Insert footer]

1

Motivation

o Information overload

o Paradoxically - Narrowing the scope

o People tend to (implicitly) trust known content, people, events

“See only what you want to see, hear only what you want to hear, read only what you want to read” Cass Sunstein

"It's what you don't know that can kill you” J. Mullins

“The scarce resource now is the attention” Bernardo Huberman

[Insert header here][Insert footer]

2

Question 1 - What is your discipline?

o Computer Science: 24

o Social sciences: 2

o Philosophy: 3

o Sociology of science: 1

o Physical systems: 1

o Unknown: 2

[Insert header here][Insert footer]

3

Question 2

o How many of you met people from another discipline working on trust before?

[Insert header here][Insert footer]

4

Scientific entities

o People: researchers, readers

o Content: papers, articles, datasets, blogs,

o Events: conferences, workshops, summer schools

o …plus publication venues: journals, newspapers, magazines, open repositories

[Insert header here][Insert footer]

5/13

Dimensions of content

oRelevance

oReputation

o…

[Insert header here][Insert footer]

6/13

One more dimension - diversity

[Insert header here][Insert footer]

7

Roadmap

o Fix two out of three dimensions: o Relevance – metrics from information retrievalo Reputation – based on links or citations

o Design diversity metrics:o Existing research on diversity in web searcho Community network of scientific entities

o Apply resultso To discover hidden links between scientific entitieso To analyze and avoid conflicts of interest

[Insert header here][Insert footer]

8

Desired outcome

o A recommender system thato Recommends content, events, people to researchers

o Matches papers with reviewerso To get diverse viewpoints on the same paper

o Assigns papers to panels/sessions with different degrees of similarity/diversityo To increase homogeneity or have more vivid discussion

[Insert header here][Insert footer]

9/13

What we need

o Topic discoveryo … e.g., by keyphrase extraction

o Trust and reputation metricso … but we are probably in the right place

[Insert header here][Insert footer]

10/13

Thanks for your attentionThanks for your attention

Contact me at birukou@gmail.com

[Insert header here][Insert footer]

11

Diversity-aware hiring in scienceDiversity-aware hiring in science

Aliaksandr Birukou, University of Trento, Italy

Fabio Casati, University of Trento, Italy

[Insert header here][Insert footer]

12

Motivation

o You’ve seen that already…

o Now, consider hiring committees

o Same problems – select people similar to you/group/department

[Insert header here][Insert footer]

13/13

Argument

o Hiring people different from the ones already working in the research group, department, or university can bring new contacts, viewpoints and communitieso But only if the person has all required competences

[Insert header here][Insert footer]

14/13

o Culture includes:o experienceo [patterns of] behavioro knowledgeo beliefso normso …

o Culture is:o sharedo accummulated o learned o socially transmittedo socially acquiredo …

Defining culture. Content vs. its properties

Aliaksandr Birukou - Implicit Culture Framework for behavior transfer

15

that are

and

TraitsTraits

transmittedtransmitted

sharedshared

CultureCultureCultureCulture

=

Metrics on scientific/cultural difference

o Scientific traits: where publish, research interests, …

o Culture traits: experience, patterns of behaviors, beliefs, knowledge, …

o Metrics can be based on the differences between “the culture” of an individual and the research group/department:o Common culture (culture overlap) is the set of traits that is present in

both cultureso Culture similarity is the degree to which two cultures are similar, i.e.

how much they have in commono Culture fit is the ratio between the culture overlap and the number of

traits in the other culture

[Insert header here][Insert footer]

16/13

Judging people from other communities

o Improve the reputation of a stranger by showing where she stays in her community (top 5%/bottom 10%)

[Insert header here][Insert footer]

17/13

But…

o How do you define “top 5%” or “bottom 10%”?

[Insert header here][Insert footer]

18/13

uCount

o Community-defined index

o The goal is to put in place a merit-based, objective, transparent system for assessing people, contributions, and events, one that does not simply focus on "impact" but focuses on the wide range of contributions that can be made

o Will be maintained by ICST and EAI

o Please volunteer to become a member of the uCount council

[Insert header here][Insert footer]

19/13

Call for members of uCount council

o What is requiredo Willingness to help your community to design better metrics,

metrics that mattero Some spare time to define selection procedures, tools for

community interactiono Some spare time for involving your community in finding what

matters for them (see Dumas et al – correlation between metrics)

o Timelineo Expression of interest: by January 4th

o Involving your community: by January 30th

[Insert header here][Insert footer]

20/13

More

o The LiquidPub project. http://project.liquidpub.org

o Google liquidpub-announce and subscribe if you are interested (VERY low traffic): http://disi.unitn.it/mailman/listinfo/liquidpub-announce

o Or, subscribe to our blog: http://liquidpub.wordpress.com

o Or, follow us on twitter: http://twitter.com/liquidpub