data on azure details
DESCRIPTION
Azure, Microsoft Cloud offers to store DATA. SQL\ NoSQL \Hadoop ectTRANSCRIPT
![Page 1: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/1.jpg)
Believe it or not !! Database on cloud !!
Pini Krisher DBA TL at etoro (www.etoro.com)@krisherpi
![Page 2: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/2.jpg)
Agenda:What is the Cloud Computing?DATA on the cloud - Pros and consWhat DATA can we put on the cloud?What forms of DATA Services Azure can offer?What DATA can we take from Azure?Other Cloud Solutions
I will work a lot on the portal during the presentation….
![Page 3: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/3.jpg)
Cloud is not 1 huge machine
What is the Cloud Computing?
![Page 4: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/4.jpg)
• Types• SAAS – Software as a service• PAAS – Platform as a service• IAAS – Infrastructure as a service
![Page 5: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/5.jpg)
• Vendors• AWS-Amazon Web Services• Rackspace• Google• HP Cloud• VM Cloud• Microsoft Azure• בזק• Etc….
![Page 6: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/6.jpg)
Azure DATA Centers
6 Data CentersNice movie at:http://www.youtube.com/watch?v=JJ44hEr5DFE
![Page 7: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/7.jpg)
• DATA on the cloud - Pros and cons (in short)• PROS
• Unlimited resources (unlimited!!!!), Data is biggest storage /IO Consumer• Easy to manage• Pay as you go• Scale – UP/DOWN - OUT/IN• Backups• Auto Upgrades• Access from any where • SLA• No Bottlenecks at IT, Finance etc.
• CONS• Compliance• Performance – next slide
• Not pros, not cons :Security, Costs
![Page 8: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/8.jpg)
From PASS Summit 2012 – Main Problems in DB on Cloud
![Page 9: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/9.jpg)
What DATA can we put on the cloud?All data or storage you want!!!
DB’sFilesBI systems
Problems:Compliance Security – is the most important issue – but…Manage Costs – about costs we will show at the end…
![Page 10: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/10.jpg)
• Security on Cloud-security is the primary concern • SSL• IP protection• Isolation of Customer Access• Multi-factor Authentication• Regular Authentication in DB• Internal VPN
FROM AWS Security manager“Security is not just one thing. It’s both an art and a science.” The art he refers to is being able to balance the needs of customers to access information to get business done…with the desire to make sure you protect that which is really important.”You Can Be More Secure In The Cloud Than You Can Be On Premise.
![Page 11: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/11.jpg)
• What forms of DATA Services Azure can offer?
Windows Azure SQL DatabasesSQL Server on VM – RDS in AWSWindows Azure StorageReporting - misleadingHadoop on AzureRecovery
![Page 12: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/12.jpg)
![Page 13: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/13.jpg)
•DATABASES on AZURE
•Windows Azure SQL Databases – PAAS•SQL Server on VM – IAAS•Windows Azure Storage - NoSQL
![Page 14: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/14.jpg)
• SO… When should we use DB’s on Cloud ?• Hybrid – some on private cloud and some on
public.• The high point after IPO• Elections• Shared Data/storage costs/IT costs• No MSFT agreements
![Page 15: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/15.jpg)
SQL Azure (PAAS) :Windows Azure SQL DatabasesWASD
SQL Azure (PAAS)
![Page 16: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/16.jpg)
What is PAAS in DB world?
You can not connect to the serverYou can not manage hardwareYou can not control hardwareNo clusters etc.…So… what DBA’s can do?
Nothing in infrastructure - there are 3 replicas…Applicative work: adding Indexes, short transaction etc.…Performance tuningHigh queries by CPU ,IO etc.…
SQL Azure (PAAS)
![Page 17: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/17.jpg)
Some Usages with SQL AzureLogsRegular DB –has PCILots of small DB’sScale up – increase DB sizeScale out – federationDevops
SQL Azure (PAAS)
![Page 18: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/18.jpg)
Logical structure of SQL Azure Subscription servers DataBasesThey can not talk with each other!!!!!!(Not Serverinstanses DataBases)
Creation of New DBSecurityConnect via SSMSSSMS differencesLimitations
SQL Azure (PAAS)
![Page 19: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/19.jpg)
SO – we have DB what's next?Start working – build tables, insert data, create SP’sCopy DBModify sizeBACKUPS only to blobs!Migrate existing data – how?
WAMW – tool from MSFT – free toolScripts in SSMSDeploy from SSMSBCP’sBacpac – Data Tier Application – to storage and to azureTools like red gate etc.Sync
Queries from SSMS about tuning
MWSSMS
Portal
SQL Azure (PAAS)
![Page 20: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/20.jpg)
Access to SQL Azure - Azure Portal
Create ServerCreate DB – 3 ways (from portal, ssms, vs2012)LocationSize – 1-150 GBSecurityBasic monitoring (monitoring in other tools like Quest)Connection strings from the portalBackups to BLOB Go to
Portal
SQL Azure (PAAS)
![Page 21: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/21.jpg)
Access to SQL Azure - Web Portal
Connect – silver light – to 1 DB or to serverRun T-sqlBasic monitoringQuery plansAdd indexesSee DATAChange schema SQL
Portal
SQL Azure (PAAS)
![Page 22: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/22.jpg)
Features that Supported/not Supported in SQL Azure
Supported:New syntaxAuto UpdatesCopy DBLinked server from local DB’s
Not Supported:Service brokerJobsprofilerCLRReplicationConnections between DB’s in server
SSMS
SQL Azure (PAAS)
![Page 23: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/23.jpg)
• Monitoring – SQL AZURE• Tools• Portals
SQL Azure (PAAS)
![Page 24: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/24.jpg)
DEMO
![Page 25: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/25.jpg)
SQL Server on VM (IAAS)CreateAttach DiskConnect via RDP
Can control the serverCan monitor the server
MonitoringReduce costs
SQL Server on VM (IAAS)
![Page 26: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/26.jpg)
SQL Server on VM (IAAS)
![Page 27: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/27.jpg)
SQL Server on VM (IAAS)
![Page 28: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/28.jpg)
• Monitoring in VM• Via portal
SQL Server on VM (IAAS)
![Page 29: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/29.jpg)
• Inside machine in RDP
SQL Server on VM (IAAS)
![Page 30: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/30.jpg)
DEMO
![Page 31: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/31.jpg)
Azure Storage
Blob – can store any type of file:BackupsImagesVHDAny Files you want – can be secured
MonitoringGeo-Replication
Main portalAzure storage explorer
VS2012
![Page 32: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/32.jpg)
Azure Storage
Q – messagingMonitoring
Main portalAzure storage explorer
VS2012
![Page 33: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/33.jpg)
Azure Storage
Tables Nosql– tools and manage (Azure Storage explorer, VS2012)Store NON relational DATA – no Group by – no JOINSMonitoringGeo-Replication
Main portalAzure storage explorer
VS2012
![Page 34: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/34.jpg)
DEMO
![Page 35: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/35.jpg)
HDINSIGHT – Hadoop on Azure
Any files sitting on ClustersCan be query by PowerShell
Map ReduceHive
Main portal
![Page 36: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/36.jpg)
HDINSIGHT – Hadoop on Azure
![Page 37: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/37.jpg)
• Backup Vault• Hyper-V Recovery manager Vault
Recovery Services
![Page 38: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/38.jpg)
Reduce costs
![Page 39: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/39.jpg)
Price ???Start workingMigrate existing data
![Page 40: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/40.jpg)
DEMO
![Page 41: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/41.jpg)
MarketPlace DATAMarket
Getting a lot of raw dataGetting application to manage dataUse application to see dataHas a lot of API’s
https://datamarket.azure.com/
SOME ARE FREE!!!!
![Page 42: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/42.jpg)
![Page 43: Data on azure details](https://reader033.vdocuments.site/reader033/viewer/2022061223/54c675824a7959b6298b4571/html5/thumbnails/43.jpg)
DEMO