brett johnson [email protected] architecture acapella
TRANSCRIPT
Email – it’s more addictive Xbox ??!!
“The average corporate user generates and receives about 84 e-mails per day which require about 10 MB of storage on a daily basis. And by 2008, e-mails will require about 15.8 MB of space daily.”
- Radicati Group, 2006
• Email now mission critical• Ubiquitous & increasingly mobile• Encourages bad practice..?
– Information overload– Use as a file share– Users “Hide behind email”
Trends in email deployment• Consolidation & Centralisation
– Clustering, server scalability, pervasive reliable bandwidth, Outlook cached mode
– Commoditisation of storage technology• Role of Disaster Recovery
– Cost of backup/DR reducing (from Ex2003)– Requirements for site resilience increasing
• Flexible Working for end-users– Easy remote access now the norm– Mobility, voice integration
Enterprise NetworkOtherSMTP
Servers
Mailbox
Routing Hygiene Routing Policy
Voice Messaging
Client Access
PBX or VoIP
Public Folders
Fax
ApplicationsOWA
ProtocolsActiveSync, POP, IMAP,
RPC / HTTP …
ProgrammabilityWeb services,
Web parts
Unified Messaging
EdgeTransport
HubTransport
Mailbox
INTERNET
Enterprise Topology
Messaging at Microsoft• 3 Locations worldwide – US, EMEA, APAC• 16.5m msgs/day arrive from the internet
(115m/week)– 12.6m filtered as spam by Connection Filtering– 350,000 messages were rejected by the IMF – ~66,000 messages were routed to user Junk Email Folders
• 1.3m messages were delivered to user Inboxes– 91.92% spam– 2.4 million internal messages received– 2.5 million internal messages sent
• Moving to 2Gb mailbox quota for everyonehttp://www.microsoft.com/itshowcase
Edge Spec• 6 servers handling inbound internet traffic and
the majority of our outbound traffic for ~130K MBX’s
• 4 servers in regional locations – (2 in Dublin and 2 in Singapore).
• 10 x: 2 dual core 2.2 GHz proc with 8GB RAM. • 6 spindles
– 2 spindle mirror for OS, page file, and transaction logs– 4 spindle raid 10 which contains the transport
database along with message tracking and protocol logs.
What happened on a “Snow Day” in Nov 06
Impact of 64 Bit “Storage makes up roughly 40% of our hardware cost for Exchange today. Because of the 64-bit optimizations in Exchange 2007 we are able to get the performance and stability needed out of a low cost iSCSI solution. With a full deployment we anticipate saving 30% on storage with Exchange Server 2007.” - Petr Grachev, CIO, SOK Group
“With the 32-bit systems in place today, we are only able to use approximately 20 per cent of the space on our storage area networks. We expect the move to 64-bit server to increase utilization significantly, resulting in tremendous cost savings”
- Dan Wills, Vice President of Operations, USA.NET Inc.
Jon Minnik Manager Technical Develop SE&A Siemens
“64-bit will facilitate further cost improvements meeting our needs for greater number of users/server, larger inboxes, increased user local stores, and most importantly enhanced security.”
Reads/sec/user Writes/sec/user IOPS/user
Exchange 2003
0.6250.625 0.410.41 1.0351.035
Exchange 2007
0.0780.078 0.1960.196 0.2740.274
1.21.2
11
0.80.8
0.60.6
0.40.4
0.20.2
00
0.25 1 25 4.5 60.25 1 25 4.5 6
IOPSIOPSEffect of RAM on IOsEffect of RAM on IOs
RAM user (MB)RAM user (MB)
1 GB mailbox size20 KB Checkpoint/userUltra-heavy user profile
Writes/sec/userWrites/sec/user
Reads/sec/userReads/sec/user
IOPS/userIOPS/user
64 Bit – Brett’s ExampleHere’s my rough and dirty “point making” exercise
(it’s full of technical pitfalls, but makes the point)
Ex2003:– 900MB x 1024 = 921,600KB– 921,600 \ 1900 users = 485KB per user
Ex2007: – (32GB x 1024) x 1024 = 33,554,432KB– 33,554,432 \ 1900 users (like for like) = 17,660KB or
17MB per user
Your users CAN have a bigger mailbox• Exchange 2007 uses storage less intensively
– IOPS requirements lower, shared storage not required– Therefore, you can store more data online for the same ££
• Backups no longer a bottleneck– Replication means there’s another copy (or copies) nearby– Snapshot technology (VSS) more mature, less expensive
• Content management– Get rid of stuff you don’t need, keep online the stuff you
do• Everyone’s got a PST nightmare...
Built-In Protection : Now In Three Flavours!
DB
DB
Log
s
Log
s
FileShare
DB
DB
Log
s
Log
s
New
Replication to a standby server Replication to a second disk set
Replication within a cluster
Designed for site resilienceReplicated on per-storage group basisSource can be standalone server or cluster Destination can be standalone server or standby clusterManual activation
DB/
Logs
D
B/Lo
gs
Standby Continuous Replication
DB
Lo
gs
DB
DB
Lo
gs
Lo
gs
FileShare
• One database per storage group• Same database and log file paths at source and target• 50 storage group targets per standby machine• /m:RecoverServer or /RecoverCms• Database portability
Reducing TCO @ Microsoft• $5 million a year savings on high availability
– Cluster Continuous Replication replaces tape backups
• 50% reduction in storage costs with 64-bit• 10 fold increase in user’s quota• User migration in a quarter of the time
““Cluster Continuous Replication allows us to maintain our high service Cluster Continuous Replication allows us to maintain our high service level agreements on lower cost hardware, removes our dependency level agreements on lower cost hardware, removes our dependency on expensive tape backups and eliminates the single point of failure. on expensive tape backups and eliminates the single point of failure.
It’s availability based on software, not dependent on hardware.”It’s availability based on software, not dependent on hardware.”– – Kyryl Perederiy, Senior Systems Engineer, Microsoft ITKyryl Perederiy, Senior Systems Engineer, Microsoft IT
http://www.microsoft.com/technet/itshowcase/content/64bitexchange2007.mspx
The Paradox of Mailbox quotas
Messaging Records Management
New
New
New
New
SP1 : Anywhere Access• Enabling a high-quality voice and UM experience• Ensuring a “better together” story between Exchange Server
2007 and OCS 2007• Allowing end-users a secure connection to corporate
networks
Improved caller ID resolutionFax tone detectionSecure RTPSimplified TLS/TCP configuration for UMOffice Communicator access behind firewallsVoicemail improvements
SP1 : Operational Efficiency• Ensuring Exchange 2007 compatibility with internet standards• Make life easier for administrators performing common or
complex tasks• Allow Exchange 2007 to run on the next generation server
platform
SP1 : Built-In Protection• Enable all users to securely send and receive encrypted mail• Speed up user access to files protected by IRM• Advanced scenarios for government and military deployments
What you need to know : SP1• SCR• Windows Server 2008 and Vista support• Exchange ActiveSync policies• Schema changes• Public Folder access & SMIME in OWA• Powershell to PST export• Management console improvements (clustering)• Integration with Office Communications Server
2007
Some related technologies...• System Center ...
– Data Protection Manager (DPM)– Configuration Manager (as was SMS)– Operations Manager (as was MOM)– Capacity Planner
• Exchange Hosted Services• Forefront for Exchange• Office Sharepoint Server• ISA Server• OCS
– more later
“Microsoft Native Support for Microsoft Applications”
DPM: Exchange 2003 & 2007 ClusterSCC Cluster• Traditional cluster configuration,
two servers - one Exchange dataset
• Automatic Failover to new server name
• Protection continues seamlessly in failover and failback scenarios, no user intervention needed
• DPM detects cluster configuration and associated server names when protection is setup
DPM
MSCS Exchange Cluster
ExchangePassive-node
ExchangeActive-node
DPM: Exchange 2007 – CCR (NEW in BETA-2 for DPM)(NEW in BETA-2 for DPM)
Cluster Continuous Replication
• Redundant exchange servers and redundant databases
• Databases logs are replicated
• Passive Node Preferred Passive Node Preferred backupbackup
Exchange 2007 CCR
Exch2007Active
DPM
Exch2007Passive
It backs up....• Exchange 2007 and 2003• SQL 2000 and 2005 (2008)• SPS \ MOSS • Virtual Server 2005 R2 SP1• Clients: XP and Vista• DC \ GC’s (System State)• Windows 2003 and 2008• OCS• Anything Clustered..!
www.microsoft.com/DPM
© 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries.
The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after
the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.