from millions of photos world-wide clothing styles

18
StreetStyle: Exploring world-wide clothing styles from millions of photos Kevin Matzen, Kavita Bala, and Noah Snavely Experiments by: Angela Lin and Lakshay Narula

Upload: others

Post on 03-Jun-2022

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: from millions of photos world-wide clothing styles

StreetStyle: Exploring world-wide clothing styles from millions of photosKevin Matzen, Kavita Bala, and Noah SnavelyExperiments by: Angela Lin and Lakshay Narula

Page 2: from millions of photos world-wide clothing styles

StreetStyle Dataset Statistics

Size:● Total: 27084 entries● 23908 Distinct Instagram Posts

Fields Associated With Each Image:● City ID● Month ID● Upload Time● Upload Location● Bounding Box Coordinates● Image Size● Attribute Annotations Original Image Cropped Image

Page 3: from millions of photos world-wide clothing styles

Cities in the dataset

● Bangkok● Beijing● Berlin● Bogotá● Budapest● Buenos Aires● Cairo● Delhi● Dhaka● Guangzhou● Istanbul● Jakarta● Karachi● Kiev● Kolkata● Lagos● London

● Los Angeles● Madrid● Manila● Mexico City● Milan● Moscow● Mumbai● New York City● Osaka● Paris● Rio de Janeiro● Rome● São Paulo● Seoul● Shanghai● Sofia● Sydney

● Tianjin● Tokyo

Missing Cities:● Austin● Chicago● Johannesburg● Nairobi● Seattle● Singapore● Toronto● Vancouver

Number of Samples in Each City

Median: 755 Samples

Page 4: from millions of photos world-wide clothing styles

Examples from the dataset

Clothing Category T-shirt Tank topShirt Outerwear Dress SweaterSuit

Neckline Shape Round Folded V-shape Sleeve Length Long Sleeve Short Sleeve No Sleeve

Page 5: from millions of photos world-wide clothing styles

Style In The Wild

Varying Image QualityMultiple People & Occlusions Variation in Pose

Cultural Holidays Variety of Sources

Page 6: from millions of photos world-wide clothing styles

Co-occurrence Trends Using Conditional Probabilities

Style based Functionality based Reasonable Dependencies

Page 7: from millions of photos world-wide clothing styles

Attributes Occur Outside of Bounding Boxes

Sleeve Length: Long Sleeve

Sleeve Length: Short Sleeve Label: Dress Category

Label: Floral Clothing Pattern

Page 8: from millions of photos world-wide clothing styles

Purpose

The paper has the following theme:1. Need large data to find trends2. Large data tough to label3. Label 27K images4. Train a CNN to generate features, cluster to find trends

However…1. We don’t have access to code2. We don’t have access to the large dataset (>10 million images)3. We do have access to the labeled 27K images

These set of experiments attempt to expose possible interesting trends in the dataset that could be explored!

Page 9: from millions of photos world-wide clothing styles

Image Upload Trends

Slight increase in uploads on weekends!

We normalize all results by the average upload frequency to observe true trends.

Page 10: from millions of photos world-wide clothing styles

Daily Trends

Higher fraction of glasses during day time might suggest about 3% presence of sunglasses!

Black color appears to be more popular at night.

Page 11: from millions of photos world-wide clothing styles

Weekly Trends

Slight preference for round neckline on weekends!

Page 12: from millions of photos world-wide clothing styles

Instagram and Demographics (NYC)

Instagram uploads, population density, and median income are all positively correlated.

Page 13: from millions of photos world-wide clothing styles

Instagram and Demographics (LA)

Instagram uploads and population density are positively correlated, but the median income is negatively correlated!

Page 14: from millions of photos world-wide clothing styles

Intra-city Trends (NYC)

● Black dominates the Manhattan region● White and multiple colors comparatively more trendy elsewhere

Page 15: from millions of photos world-wide clothing styles

Intra-city Trends (LA)

● Black and white predominant in downtown region● Blue comparatively more popular elsewhere

Page 16: from millions of photos world-wide clothing styles

Intra-city Trends (NYC)

● T-shirts more popular elsewhere, as compared to Manhattan

Page 17: from millions of photos world-wide clothing styles

Intra-city Trends (LA)

● T-shirts more popular elsewhere, as compared to downtown area

Page 18: from millions of photos world-wide clothing styles

Thanks for listening!Check out our code at: https://github.com/angelaslin/streetstyle-experiment