FindSimilarTM Results

Objectives of the Test

• Test 110 Images against the Shopstyle Inventory using no crop and crop feature

• Demonstrate results with a subset of chosen images showing varying viewpoints and scale

• Demonstrate examples of ideal vs. non-ideal query images and why

• Look at the query images based on the inspiration they provide and relevance of results on perceived inspiration

Overview of Best Practices for FindSimiliar

• Results for FindSimiliar are as good as the inventory to be queried, in this case ShopStyle

• Search Criteria and Weight should be decided before processing of the images. Color & Pattern vs Shape & Color

• A minimum image size of 800x600 is required, high-quality compression, no resizing of small images

• Avoid cluttered background if possible

• Point of Interest should take up to 80% of the image

• Viewpoint & Scale are very important

Demo Environment Specs I

• Chrome plugin is used for testing

• ShopStyle US inventory is used• 450K images in Men’s category• 1.6M images in Women’s category

• Test images criteria• Images with cluttered backgrounds vs non-

cluttered backgrounds are tested• Images with different Viewpoints are tested• All images are tested with and without Cropping

Test Image Complex Pattern & Shape: No Crop C:60 P:40

Test Image Complex Pattern & Shape: Crop, C:60 P:40

Test Image Complex Pattern & Shape: Crop, C:100

Test Image: Example of an Overwhelming Background

Test Image Overwhelming Background: Crop, C:60 P:40

Crop the image

Test Image Overwhelming Background: Crop

Test Image Cluttered Background: No Crop, C:60 P:40

Test Image Cluttered Background: Crop, C:60 P:40

Test Image Side View: No Crop, C:60, P:40

Test Image Side View: Crop, C:60 P:40

Test Image Back View: No Crop C:60 P:40

Test Image Back View: Crop C:60 P:40

Test Image Print Skirt: No Crop C:60 P:40

Test Image Print Skirt: Crop C:60 P:40

Test Image Bathing Suit: No Crop, C:60 P:40

Test Image Bathing Suit: Crop C:60 P:40

Test Image Embellish: No Crop C:60 C:40

Test Image Embellish: Crop C:60 P:40

Test Image Complex Viewpoint: No Crop C:60 P40

Test Image Complex Viewpoint: Crop C:60 P40

Test Image Striped Sweater: No Crop C:60 P:40

Test Image Stripe Sweater: Crop C:60 P:40

Test Image Monochromatic: No Crop C:60 P:40

Test Image Monochromatic: Crop C:60 P:40

Test Image Handbag: No Crop C:60 P:40

Test Image Monochromatic: No Crop C:60 P:40

Test Image Monochromatic: Crop C:60 P:40

Examples of less than ideal query images

• Images that do not produce good results when cropping is not used

• Images where the background color overwhelms the point of interest even when cropping is used

• Images with not enough key points of interest to enable viable search results

• Images with too many key points of interest, hence results are confused

Test Image Complex Background: No Crop C:60 P:40

Test Image Complex Background: Crop C:60 P:40

Test Image Filter, Not Enough KPs: No Crop C:60 P:40

Test Image Not Enough KPs, Strong Back Color: Crop C:60 P:40

Test Image Filter, Complex light: Crop C:60 P:40

Summary of Results and Next Features

• Only about 10% of the 110 images produced less than ideal results

• Approximately 90% of images produced good results when cropping feature was used

• Approximately 50% of images produced good results without cropping

• Next version of FindSimiliar will incorporate an auto-cropping feature for body and face

• Next version of FindSimiliar will also auto-categorize, recognizing the difference between a top and pants, etc.

Cortexica

Thank you.