qct data warehouse fast track (dwft) solution for...

QCT Data Warehouse Fast Track (DWFT) Solution for Microsoft SQL Server 2016 – 50 TB

Executive Summary:

Solution to Large Database Challenges

Today’s ever-changing business world relies more than ever on the

generation, collection, and analysis of data. While enterprises had a

limited time window to load large quantities of data, were routinely

querying large data volumes that often required full table scans and

multi-pass queries, the performance of the data warehouse to reduce

query execution times became the most critical topic for IT.

The QCT Data Warehouse Fast Track (DWFT) Solution for Microsoft SQL

Server 2016 configured by the high performance system Quanta Grid

D51B-2U server with S3610 1.6TB SSD enterprise grade flash storage

built for SQL data warehouse demand up to 50 TB in size.

This solution can solve large database challenges with a good price-to-

performance ratio, reduced maintenance and ensured high

performance to address business analytics on growing data volumes.

This solution features the following highlights:

• Pre-tuned, fast query performance that is optimized running intensive query workloads and validated by Microsoft

• Ease of deployment and scalability through pre-integration and modular architecture design

• Built-in high availability through hardware + software design

The configuration by QCT has a Row Store rated I/O: 5,649 Mbps

Column Store throughput: 1,637Queries/Hr/TB

TABLE OF CONTENT

1. Executive Summary

2. SQL DWFT Program

3. D51B-2U Server

4. Solution Config.

5. RA Certification

SOLUTION HIGHLIGHTS

Certified 50 TB SQL DWFT solution by QCT

Pre-tuned DW with fast queries and less integration effort

Best-in-class HW with both WS2016 SDDC and SQL DWFT validated

2


Microsoft Data Warehouse Fast Track

Microsoft Data Warehouse Fast Track is a joint effort between Microsoft and its

hardware partners, QCT for instance, to deliver validated, pre-configured solutions

that reduce the complexity and risk of implementing an SMP data warehouse based

on SQL Server Enterprise Edition. The Fast Track program provides flexibility of

solutions and customer choice across hardware vendors’ technologies, and uses the

core capabilities of the Windows Server operating system and SQL Server to deliver a

balanced SMP data warehouse with optimized performance.

QCT QuantaGrid D51B-2U Server

Full-Featured Energy Efficient 2-Socket Server

QuantaGrid D51B-2U is a general-purpose rackmount server designed for optimal

performance and power efficiency. It supports up to 1.5 TB highly scalable memory

capacity and up to twelve 3.5” or twenty-four 2.5” hot-swappable HDD for complex

and demanding workloads, such as mail-server, database, e-commerce and high-

performance computing (HPC).

Greener and More Powerful

Powered by the Intel® Xeon® processor E5-2600 v3, v4 product family and DDR4

memory technology, the QuantaGrid D51B-2U allows owners to upgrade computing

performance without overextending power consumption. With QCT’s enhanced

thermal design, the server can operate under ambient temperatures as high as 40˚C.

This allows owners to save unnecessary costs associated with datacenter cooling

needs and achieve higher data center infrastructure efficiency (DCIE) value.

3


Full-Featured Design for Demanding Storage and Computing Workload

With 24 dual in-line memory (DIMM) slots, QuantaGrid D51B-2U offers non-latency

support to virtualization environments that require the maximum memory capacity.

In addition to twelve 3.5” or twenty-four 2.5” front-access, hot-swappable HDDs, the

D51B-2U also has two optional 2.5” PCIe (NVMe) SSD bays and two optional 2.5”

SATA HDD bays on the rear side for extra caching or OS support without sacrificing

storage capacity.

Flexible and Scalable I/O Options

QuantaGrid D51B-2U provides flexible I/O scalability for today’s diverse data center

application requirements. It features OCP LAN mezzanine card solutions in addition

to dual GbE or 10GbE LAN on Motherboard (LoM). With various controller vendors

and different speed and technology options, customers can choose from GbE to

56GbE bandwidth, copper to fiber-optic cabling, basic Ethernet function to FCoE and

iSCSI SAN connectivity. The on-board SAS controller offers multiple QCT SAS

mezzanine card options, with different RAID levels, and data transfer bandwidth, so

customers can tailor the SAS controller for specific application needs.

4


Solution Configuration

QuantaGrid D51B-2U Server

The server used in this Reference Architecture is QCT’s QuantaGrid D51B-2U model

with below hardware configuration:

QuantaGrid D51B-2U

Server

Processors Intel® Xeon® E5-2695 v4 (2.1Ghz, 18 cores)

Total sockets 2

Total Physical Cores 36

Total RAM 768GB (24 * 32GB RDIMM)

RAM Type DDR4-2133MHz

Internal (OS) Storage 2 * 480GB SATA SSD (Raid 1)

Host bus adapters LSI 3108-8i R6 Mezz Card (12Gbps)

Storage

Network adapters Mellanox ConnectX-3 Pro (Dual-Port, SFP+, 10GbE)

Storage Array In-Server

Disk Drives 24 * 1.6TB SATA SSDs for SQL database storage

Storage Information

Option 1: 24 * 1.6TB SATA SSD for Data, TempDB and Log (Raid 10)

Option 2: 4 * 1.6TB SATA SSD for Log (Raid 10); 20 * 1.6TB SATA SSD for Data and TempDB (Raid 5)

Table1: Hardware Configuration

Microsoft Windows Server 2016

- Enable .NET Framework 3.5 & 4.6

- Set Powershell ExecutionPolicy as “Unrestricted”.

5


- Change Power Options to “High Performance”

- Format SQL Storage as NTFS and create a path/mount point under C: drive, e.g.

C:\mounthead

6


Microsoft SQL Server 2016 During Microsoft SQL Server 2016 installation, update default directories to SQL Storage mountpoint/path (e.g. C:\mounthead) for Data, Log and TempDB.

7


Below settings are used in running Microsoft Data Warehouse Fast Track tests:

2-Socket 4-Socket Comments

Hyper Threading ON ON

Fast Trace DB size 1 TB 2 TB

SQL Max memory 118 GB 236 GB

Startup Parameter -E –T1117 -E –T1117

Startup Parameters (optional)

-T834 -T834 Enable large pages

# of Session for IO and CPU stress test

12,24* 12,24*,48 *By default, this will be used for certification.

Row Store Setting

Resource Governor (RG)

12% 12%

Degree Of Parallelism (DOP)

0 0 Setting of zero in the tool is same as setting it to # of logical processor per socket.

Column Store Setting

RG 12% 25%

DOP System LP

count System LP

count

Total # of logical processors (double the # of cores if HT is ON).

A run with DOP = 0 is also suggested.

8


Resource Governor RG setting:

SQL Max Server Memory setting:

9


To add Startup Parameters, open SQL Server Configuration Manager, click on SQL Server Services and select Properties:

Add parameters: -E, -T1117 and -T834

Restart SQL Server after new startup parameters applied.

10


Reference Architecture Certification

11


United States

China

QCT LLC., Silicon Valley office 1010 Rincon Circle, San Jose, CA 95131 TOLL-FREE: 1-855-QCT-MUST TEL: +1-510-270-6111 FAX: +1-510-270-6161 Support: +1-510-270-6216 QCT LLC., Seattle office 13810 SE Eastgate Way, Suite 190, Building 1, Bellevue, WA 98005 TEL: +1-425-633-1620 FAX: +1-425-633-1621

云达科技, 北京办公室（Quanta Cloud Technology）

北京市朝阳区东大桥路 12 号润诚中心 2 号楼 TEL: +86-10-5920-7600 FAX: +86-10-5981-7958

云达科技, 杭州办公室（Quanta Cloud Technology）

浙江省杭州市西湖区古墩路浙商财富中心 4 号楼 303 室

Room 303，Building No.4，ZheShang Wealth Center No. 83 GuDun Road, Xihu District, Hangzhou, Zhejiang , China TEL: +86-571-2819-8660

Japan

Taiwan

Germany

Other regions

Quanta Cloud Technology Japan 株式会社

日本国東京都港区芝大門二丁目五番八号

牧田ビル３階 Makita Building 3F, 2-5-8, Shibadaimon , Minato-ku, Tokyo 105-0012, Japan TEL: +81-3-5777-0818 FAX: +81-3-5777-0819

雲達科技（Quanta Cloud Technology）

桃園市龜山區文化二路 211 號 1 樓 1F, No. 211 Wenhua 2nd Rd., Guishan Dist., Taoyuan City 33377, Taiwan TEL: +886-3-286-0707 FAX: +886-3-327-0001 Quanta Cloud Technology Germany GmbH Hamborner Str. 55, 40472 Düsseldorf , Germany TEL: + 492405-4083-1300 Quanta Cloud Technology No. 211 Wenhua 2nd Rd., Guishan Dist., Taoyuan City 33377, Taiwan TEL: +886-3-327-2345 FAX: +886-3-397-4770

About QCT

Quanta Cloud Technology (QCT) is a global datacenter solution provider. We combine the efficiency of hyperscale hardware with infrastructure software from a diversity of industry leaders to solve next-generation datacenter design and operation challenges. QCT serves cloud service providers, telecoms and enterprises running public, hybrid and private clouds.

Product lines include hyper-converged and software-defined datacenter solutions as well as servers, storage, switches, integrated racks with a diverse ecosystem of hardware component and software partners. QCT designs, manufactures, integrates and services cutting edge offerings via its own global network. The parent of QCT is Quanta Computer, Inc., a Fortune Global 500 corporation.

www.QCT.io

All specifications and figures are subject to change without prior notice. Actual products may look different from the photos.

QCT, the QCT logo, Rackgo, Quanta, and the Quanta logo are trademarks or registered trademarks of Quanta Computer Inc.

All trademarks and logos are the properties of their respective holders.

Copyright © 2017 Quanta Computer Inc. All rights reserved.

http://www.qct.io/

qct data warehouse fast track (dwft) solution for...

Documents