performance testing of storage stack for cloud (openstack) · performance testing of storage stack...
TRANSCRIPT
![Page 1: Performance Testing of Storage Stack for Cloud (OpenStack) · Performance Testing of Storage Stack for Cloud (OpenStack) Venkata Krishna Vedams Inc. Agenda Storage stack components](https://reader037.vdocuments.site/reader037/viewer/2022110112/5af437037f8b9a8d1c8bddc9/html5/thumbnails/1.jpg)
Performance Testing of Storage Stack for Cloud (OpenStack)
Venkata Krishna Vedams Inc.
![Page 2: Performance Testing of Storage Stack for Cloud (OpenStack) · Performance Testing of Storage Stack for Cloud (OpenStack) Venkata Krishna Vedams Inc. Agenda Storage stack components](https://reader037.vdocuments.site/reader037/viewer/2022110112/5af437037f8b9a8d1c8bddc9/html5/thumbnails/2.jpg)
Agenda
Storage stack components involved
How to attach volumes to vm’s in Cloud
Performance Testing in cloud
Different ways of running FIO on Linux distributions
StorPerf Features
StorPerf introduction and work flow
ELK stack Work flow
Summary
![Page 3: Performance Testing of Storage Stack for Cloud (OpenStack) · Performance Testing of Storage Stack for Cloud (OpenStack) Venkata Krishna Vedams Inc. Agenda Storage stack components](https://reader037.vdocuments.site/reader037/viewer/2022110112/5af437037f8b9a8d1c8bddc9/html5/thumbnails/3.jpg)
Storage stack components
![Page 4: Performance Testing of Storage Stack for Cloud (OpenStack) · Performance Testing of Storage Stack for Cloud (OpenStack) Venkata Krishna Vedams Inc. Agenda Storage stack components](https://reader037.vdocuments.site/reader037/viewer/2022110112/5af437037f8b9a8d1c8bddc9/html5/thumbnails/4.jpg)
Storage array
Switch
Volume server Controller server
Compute server
VM
VM
VM
Attach volumes to instances in a Cloud Environment
![Page 5: Performance Testing of Storage Stack for Cloud (OpenStack) · Performance Testing of Storage Stack for Cloud (OpenStack) Venkata Krishna Vedams Inc. Agenda Storage stack components](https://reader037.vdocuments.site/reader037/viewer/2022110112/5af437037f8b9a8d1c8bddc9/html5/thumbnails/5.jpg)
What is Performance testing in cloud
Process of determining the speed or effectiveness of a computer, network, software program or device.
![Page 6: Performance Testing of Storage Stack for Cloud (OpenStack) · Performance Testing of Storage Stack for Cloud (OpenStack) Venkata Krishna Vedams Inc. Agenda Storage stack components](https://reader037.vdocuments.site/reader037/viewer/2022110112/5af437037f8b9a8d1c8bddc9/html5/thumbnails/6.jpg)
name rw iodepth group_reporting numjobs time_based_filename ioengine size direct fsync_on_close runtime invalidate
bs
Run FIO in different ways
Command for a single job FIO test configuration fio –name=sqread --rw=read --bs=512b --ioengine=libaio --iodepth=16 --numjobs=64 - -runtime=60 --size=100m --direct=1 --invalidate=1 --group_reporting --fsync_on_close=1 --time_based --filename=/dev/vdb
Run single test configuration FIO parameters
name rw iodepth group_reporting numjobs time_based bs
ioengine size direct fsync_on_close runtime invalidate
Run multiple jobs using job file Create a job file with fio parameters. Run the below command # fio <jobfile>
![Page 7: Performance Testing of Storage Stack for Cloud (OpenStack) · Performance Testing of Storage Stack for Cloud (OpenStack) Venkata Krishna Vedams Inc. Agenda Storage stack components](https://reader037.vdocuments.site/reader037/viewer/2022110112/5af437037f8b9a8d1c8bddc9/html5/thumbnails/7.jpg)
Run FIO in different ways
Client-Server Model Allows to run FIO test on single client/multiple clients at a time. Setup client-server model Client machine Run the fio server(listen on 8765 port) by running below command # fio –server Server machine Run fio by providing client details # fio –client <client Ip1> <job file1> --client <client ip2> <job file 1> …
![Page 8: Performance Testing of Storage Stack for Cloud (OpenStack) · Performance Testing of Storage Stack for Cloud (OpenStack) Venkata Krishna Vedams Inc. Agenda Storage stack components](https://reader037.vdocuments.site/reader037/viewer/2022110112/5af437037f8b9a8d1c8bddc9/html5/thumbnails/8.jpg)
FIO test output for a single test configuration
![Page 9: Performance Testing of Storage Stack for Cloud (OpenStack) · Performance Testing of Storage Stack for Cloud (OpenStack) Venkata Krishna Vedams Inc. Agenda Storage stack components](https://reader037.vdocuments.site/reader037/viewer/2022110112/5af437037f8b9a8d1c8bddc9/html5/thumbnails/9.jpg)
StorPerf – Storage performance testing for the cloud
![Page 10: Performance Testing of Storage Stack for Cloud (OpenStack) · Performance Testing of Storage Stack for Cloud (OpenStack) Venkata Krishna Vedams Inc. Agenda Storage stack components](https://reader037.vdocuments.site/reader037/viewer/2022110112/5af437037f8b9a8d1c8bddc9/html5/thumbnails/10.jpg)
StorPerf workflow
Instance1
Instance 2
Instance 3 Run StorPerf UI Instance 4
LINUX Machine
fio
fio
fio
fio
FIO Output Directory ELK Stack
FIO Output
Indexing & Save FIO Output
Visualize the data in Graphs
![Page 11: Performance Testing of Storage Stack for Cloud (OpenStack) · Performance Testing of Storage Stack for Cloud (OpenStack) Venkata Krishna Vedams Inc. Agenda Storage stack components](https://reader037.vdocuments.site/reader037/viewer/2022110112/5af437037f8b9a8d1c8bddc9/html5/thumbnails/11.jpg)
StorPerf – Features
Simple UI to setup tests
Allows to provide multiple Instance login details as inputs
Allows to choose FIO parameters using check boxes
Easily setup single or multiple FIO Job configurations
Provides multiple visualization graphs/charts (Area chart, line chart)
Visualize single or multiple graphs in the same pane/tab/dashboard
![Page 12: Performance Testing of Storage Stack for Cloud (OpenStack) · Performance Testing of Storage Stack for Cloud (OpenStack) Venkata Krishna Vedams Inc. Agenda Storage stack components](https://reader037.vdocuments.site/reader037/viewer/2022110112/5af437037f8b9a8d1c8bddc9/html5/thumbnails/12.jpg)
StorPerf - FIO parameters selection
![Page 13: Performance Testing of Storage Stack for Cloud (OpenStack) · Performance Testing of Storage Stack for Cloud (OpenStack) Venkata Krishna Vedams Inc. Agenda Storage stack components](https://reader037.vdocuments.site/reader037/viewer/2022110112/5af437037f8b9a8d1c8bddc9/html5/thumbnails/13.jpg)
StorPerf – Visualization parameters selection
![Page 14: Performance Testing of Storage Stack for Cloud (OpenStack) · Performance Testing of Storage Stack for Cloud (OpenStack) Venkata Krishna Vedams Inc. Agenda Storage stack components](https://reader037.vdocuments.site/reader037/viewer/2022110112/5af437037f8b9a8d1c8bddc9/html5/thumbnails/14.jpg)
ELK stack – Work Flow
GS Logs (FIO output)
Log stash Elastic search
Kibana
Process the data through filters
Store the data and can do search and analyze
Build dashboards for data visualization
![Page 15: Performance Testing of Storage Stack for Cloud (OpenStack) · Performance Testing of Storage Stack for Cloud (OpenStack) Venkata Krishna Vedams Inc. Agenda Storage stack components](https://reader037.vdocuments.site/reader037/viewer/2022110112/5af437037f8b9a8d1c8bddc9/html5/thumbnails/15.jpg)
StorPerf – Visualization through Kibana graphs
![Page 16: Performance Testing of Storage Stack for Cloud (OpenStack) · Performance Testing of Storage Stack for Cloud (OpenStack) Venkata Krishna Vedams Inc. Agenda Storage stack components](https://reader037.vdocuments.site/reader037/viewer/2022110112/5af437037f8b9a8d1c8bddc9/html5/thumbnails/16.jpg)
Summary : StorPerf – Value-Add
Easy to scale test runs on compute instances - using “+ button“
Multiple checkboxes allows users to select tests with more granularity
Graph parameters are customizable, allows for various comparative graphs
Allows user to visualize data in multiple graphs with different parameters
Easily re-run tests after changing any component in the storage stack
![Page 17: Performance Testing of Storage Stack for Cloud (OpenStack) · Performance Testing of Storage Stack for Cloud (OpenStack) Venkata Krishna Vedams Inc. Agenda Storage stack components](https://reader037.vdocuments.site/reader037/viewer/2022110112/5af437037f8b9a8d1c8bddc9/html5/thumbnails/17.jpg)
Thank You Questions ?