Manycore Designs Presentation by

Gabr iel Smith and John Cowan

Today’s Plan ● What is a Manycore?

● Manycore vs. Mult i-core

● Example Manycore

● Types of Manycore designs

● Examples

What is a Manycore?

What is a Manycore?

● Has many cores

What is a Manycore?

● Has many cores ○ 10s to 100s to 1000s of cores

Hold up, then what’s a Mult i-core?

Manycore vs Multi- core ● Parallel computat ion vs. Single threaded performance

● Design origins

What is a Manycore?

● Has many cores ○ 10s to 100s to 1000s of cores

What is a Manycore?

● Has many cores ○ 10s to 100s to 1000s of cores

● Designed for parallel computing

Example Manycore: GPU

Manycore Types and Differences ● Cache Hierarchy

● Inter-core communicat ion

● Homogeneous vs Heterogeneous

Cache Hierarchy ● Two Levels per Tile, Three in total.

● Dynamic Distributed Caching (DDC)

Inter - core Communication ● Network on Chip

● Wireless

● Optical

Homogeneous vs Heterogeneous ● Types of cores used

● Choosing which gives better performance

● At what cost?

Homogenous ● All the same core

● Fill whatever core is empty

● Ex. Tile-Gx72

Mellanox Ti le- Gx72 ● 72 ident ical processor cores interconnected with the iMesh™ on-chip network

connected with non-blocking Terabit /sec switch

● Split 32KB Each Level 1 Cache

● 256KB Level 2 Cache

● 18MB Coherent Level 3 Cache

Where’s Ti lera? ● And who’s this Mellanox.

Heterogenous ● Cores with specializat ion

● Centralized Vs Distributed Management

Nvidia GP100 ● Different units/cores have

different specialt ies

● Control System: ○ Nvidia Magic

Wrapping i t up ● Many core and Mult i-core are different.

● Designed for parallel computat ions.

● Using Network-On-Chip allows for very high speed data transfer avoiding

bott lenecks.

References ● Nvidia GTX1080 Organization https:/ / international.download.nvidia.com/geforce-

com/international/pdfs/GeForce_GTX_1080_Whitepaper_FINAL.pdf

● Nvidia GP100 SM Organization https:/ / images.nvidia.com/content/pdf/tesla/whitepaper/pascal-architecture-whitepaper.pdf

● Tilera Image http:/ /www.mellanox.com/related-docs/prod_mult i_core/PB_TILE-Gx72.pdf

● Tile Interconnection https:/ /venturebeat.com/wp-content/uploads/2011/06/t ilera-1.jpg?fit=630%2C373&strip=all

● Tilera Cache Image http:/ /www.mellanox.com/repository/solut ions/t ile-scm/docs/UG130-ArchOverview-TILE-Gx.pdf

● Optical Transfer Interchip http:/ / ieeexplore.ieee.org/document/6815717/

● Demystifying GPU Microarchitecture through Microbenchmarking http:/ /citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.189.5309&rep=rep1&type=pdf

● Gravidy: Parallel Computing http:/ /gravidy.xyz/ include/parallel-computing.html

Questions?