Survey
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Storage Virtualisatie Sjef van Ham Storage Support Meerheide 101 5521 DZ Eersel [email protected] 26-maart-2009 1 Storage Opslag DAS Direct Attached Storage NAS Network Attached Storage SAN Storage Area Network 2 Wat is een SAN ? 1) Gecentraliseerde opslag op basis van een extern schijvencabinet voor verschillende typen servers « alles in één doos » gecentraliseerd beheer hoge schaalbaarheid door veel schijfruimte hogere hardware redundantie en databeveiligingsfuncties : RAID, spare disks 2) Speciaal storage netwerk Fibre-Channel grote afstand (optische kabels ) hoge bandbreedte (4Gb) iSCSI ethernet direct toepasbaar en flexibel lage TCO en infrastructuurkosten 3 Voordelen van gecentraliseerde opslag • Flexibel en eenvoudig toewijzen van capaciteit • Gemiddelde benutting in een DAS-omgeving is < 50% (SAN = 85%) • Schijf en tape in hetzelfde opslag netwerk (50-75% minder tape drives) • Minder LAN-verkeer • Gecentraliseerd beheer • Beheer met minder mensen (efficiency stijgt met factor 10) • Opslag, switches en tape toevoegen zonder applicaties stop te zetten • Zo veel redundantie als gewenst 4 iSCSI Storage • iSCSI staat voor Internet SCSI (Small Computer System Interface). Dit is een op het Internet Protocol (IP) gebaseerde standaard voor IP netwerken. Deze technologie is een versmelting van twee technieken die zich in de industrie bewezen hebben. Het gaat om de technologie die ontwikkeld is voor communicatie (ip netwerken) en de technologie bedoeld voor dataopslag , SCSI opslag. Door deze te combineren werd het mogelijk zowel de data als de dataopslagcommando's over ip-netwerken te versturen. • Een netwerk protocol voor storage netwerken • Gebruikt de standaard ethernet tcp/ip netwerktechnologie eb hardware 5 Fibre Channel SAN • Fibre Channels work on a single popular storage networking protocol that offer compatibility to all common storage and database servers. • Fibre Channels use the FCP protocol ( Fibre Channel Protocol) which is simply a serial bus SCSI protocol. • This FCP (Fiber Channel protocol) works really well in networks with a high bandwidth requirement. • Fibre Channel is een protocol dat voornamelijk wordt gebruik om data binnen storage netwerken te transporteren. Vaak wordt Fibre Channel geassocieerd met alleen glasverbindingen, maar het protocol kan zowel over glas als koperverbindingen worden gebruikt. 6 iSCSI voordelen door Eenvoud Geen noodzaak meer om te investeren in FC technologie of FC kennis Ethernet is bekende technologie Ethernet heeft een lagere TCO en infrastructuur Geen noodzaak meer om te investeren in FC technolog of FC kosten Geen FC HBAs meer nodig, optionele iSCSI ethernet kaarten voor hogere prestaties 7 IP based versus FC based FC HBA’s 2-4-8 GB Standaard Netwerk ip-kaarten 1GBe-10GBe • Fibre Kabels UTP kabels • Fibre Switches Ethernet Switches 2-4-8 GB 1-10 GBe 8 De markt Fibre - iSCSI Revenue Forecast by Installation Environment GB/$ $14B $40 DAS $35 $12B $/GB $30 $10B FC SAN $25 $8B $20 $6B $15 iSCSI SAN $4B $2B $10 NAS $5 Other SAN $0 2009 2008 2007 2006 2005 2004 2003 2002 $0B 9 Storage Requirements for the Traditional Data Center Performance Supports current workloads. No performance degradation Scalability Scale capacity and performance without disruption Availability Data stays online during a site failure, recover from disaster Manageability Simple to admister 10 Typical Storage Array Architecture • Monolithic Array Not scalable • Controller head becomes bottleneck • Scales capacity only Single point of failure Forklift upgrades 11 WHICH CAN BE COMBINED IN OUR FRAMELESS ARCHITECTURE Performance Scale when you need, as large as you need it, but view as a single SAN Number of disks 12 Typical iSCSI SAN Exchange SQL Archive Switched Gb Ethernet Exchange Archive SQL Storage Pool 1 2 Pages RAID RAID 10, 50 or 5 Disks N PS Series Array 1 13 Exchange SQL Archive Switched Gb Ethernet Exchange Archive SQL Storage Pool 1 2 Pages 3 RAID 4 N RAID 10, 50 or 5 RAID 10, 50 or 5 PS Series Array 1 PS Series Array 2 Disks Automatic and transparent load balancing across arrays 14 The LeftHand Difference 15 SAN/iQ Storage Clustering • Storage cluster • Aggregates all components for performance Data is load balanced across all nodes Predictable scalability Grow on your terms • Non-disruptive scalability No forklift upgrades Scale everything Throttle bandwidth Create tiers of storage • SAS SATA Each optimized for type of data Online volume migration Simple centralized management Provisioning Monitoring Security Centralized Management Console 16 SAN/iQ Network RAID • Beyond component redundancy Protects data from array failure Synchronous replication Configure on a per-volume basis Configure on-the-fly, no down time • High availability Multiple disks, controllers, or arrays Zero disruption of data access Ensures “high availability” for data SAN/iQ Cluster A D A D A B A B C B C B C D C D 17 SAN/iQ Multi-site SAN • Protect Storage By: Rack Room Floor Building Site • SAN/iQ ClusterSAN/iQ Multi-site SAN A D A D A B A B C B C B C D C D Keep Data Online During: Facility disruption Natural disaster Site maintenance Volumes Remain Online 18 SAN/iQ Thin Provisioning • Eliminate Initial Over-Purchasing No Wasted and/or over-allocated capacity Purchase what you need today • SAN/iQ Cluster Delay Future Storage Purchases Grow capacity as warranted • Simple to Manage Enable/Disable with radio button on per-volume basis Allocate only as data is written to the volume No Reserve necessary Full Provisioned Thin Provisioned Allocated 200GB Available 0GB Used 0GB 50GB 100GB Wasted 200GB 150GB 100GB Allocated 100GB 0GB 50GB 50 GB written 50 GB written 50 GB written 50 GB written 200 GB Volume 200 GB Volume Available 100GB 200GB 150GB Used 0GB 50GB 100GB Wasted 0GB 0GB SAN/iQ Snapshots • Simplified Backup and Recovery • Point-in-time volume copies Scheduled, Ad Hoc or Scripted Functional • Volume rollback Recover granular data Backup Integration • Microsoft VSS • VMware VCB Space Efficient Thin provisioned always Delta changes only No snap reservation SAN/iQ Cluster 1:00 1:00 2:00 3:00 20 SAN/iQ Remote Copy Asynchronous Replication • Simple to Manage SAN 1 SAN 2 Vol_1 (Remote (Primar y) ) Per volume basis Scheduled or manual Thin provisioned No reserve space required Vol_1 (Primary) • Recovery Server Bandwidth management Failover / Failback Wizard 1:00 1:00 2:00 2:00 3:00 3:00 Baseline Copy Incremental Copy Incremental Copy 21 Network Storage Server (NSS) Intelligent Storage Virtualization • True heterogeneous intelligent storage virtualization • Application-aware data protection • WAN optimized disaster recovery services protect operations and save on WAN costs • Increased storage efficiency through Thin Provisioning of resources • Your Storage, Your Infrastructure, Your Solution 22 TOTALLY Open Storage Virtualization Platform Exchange Oracle Windows SQL Linux iSCSI VMware Solaris Notes DB2 HP-UX AIX SAP Netware InfiniBand FC Any application Any storage protocol Any operating system Any disk array Virtual Physical Data Existing SAN volumes via Storage Service Enabler Virtualized SAN volumes Thin provisioned SAN volumes 23 Control storage management cost and complexity • Consolidate heterogeneous storage management through virtualization • Minimize storage costs with thin provisioning • Centralized management of client systems simplifies operations 24 The Solution Starts with Consolidation Critical Applications SAN File Servers Application Servers Backup Severs SAN • Enhanced storage utilization • Consolidated storage management • Opens the door for a host of solutions and innovations 25 How storage virtualization works • Quickly create virtual volumes from across or within any physical disk resources - Simple wizard interface - Physical LUN and virtual devices up to 16TB - Expand volumes as needed • Securely assign volumes to servers through NSS interface Virtual disks Physical disks 26 Storage abstraction layer • Move the storage intelligence and security into the SAN fabric Hosts NSS creates a storage abstraction layer • • Fabric Storage services no longer dependent on vendor-exclusive disk functionality Consolidates services and operations Storage abstraction layer Disk 27 Thin Provisioning: Better Storage Utilization • Create a virtual volume to match size of data provisioning request • Allocate a smaller amount of actual physical disk space • Additional physical space allocated automatically as needed • Reduces wasteful over provisioning of storage • Saves disk space and power consumption “800 GB” Application server sees virtual volume size Virtual 800 GB Physical Data 200 GB Thin provisioned SAN volume 28 Minimize downtime • Highly available systems ensure continuous operation • • Cross-array mirroring for ultimate data protection • Seamless, zero-downtime data migration 29 NSS high availability deployment model Shared Storage Failover • NSS appliances deployed in failover pairs • Each NSS server supports its own set of client servers during normal operations SAN • If one devices fails, the second device takes over servicing clients 30 Data mirroring, zero downtime migration • Any-to-any storage array synchronous data mirroring • Ultimate data protection across arrays • Seamless data migration across storage devices. Writes acknowledged from both arrays to ensure integrity Create mirror Switch primary/mirror status without any break in application processing Remove mirror (old array) Primary Mirror Mirror Primary 31 Ensure comprehensive data protection • Application-aware snapshots provide rapid data recovery • WAN optimized data replication for disaster recovery and failback • Host-free, accelerated backup eliminates all backup windows 32 Application aware snapshots • Up to 256 snapshots per volume • Instant recovery to any captured MS Exchange Oracle VMware DB2 Informix SAP MS SQL Sybase Notes/Domino Progress Pervasive SQL point in time • Fully mountable as read/write volumes • Each volume has its own snapshot schedule Application agents and consistency groups for 100% transactional integrity 1:00 1:30 2:00 1:00 5:00 9:00 8:00 9:00 10:00 2:30 11:00 33 WAN Optimized Disaster Recovery • Easily configured any-to-any remote replication • Continuous or periodic modes … … DR Site Full replicas • WAN optimized out of the box • Includes WAN data encryption, compression and QoS Snapshots Copy to tape 34 WAN Optimized Data Replication • • Applications and file systems write far more data to disk than actual changes NSS scans the changes at a 512 byte level and replicates only the changed data - Avoids constant resending of duplicate data 512 byte = empty disk sector = data written by application or file system = sector with actual data change 512 byte Disk sectors A typical 8k write of data. Many systems send all 8k or more. CDP sends only the 35 truly changed sectors. VMware Advanced Features • Because continuous uptime is so critical, VMware has created several advanced features designed to help system uptime - VMware High Availability - VMotion - VMware Distributed Resource Scheduler 36 VMware High Availability/Vmotion/Scheduler • VMware High Availability automatically restarts virtual machines affected by physical server failure X Shared storage pool 37 The Power of the Virtual SAN • The FalconStor Network Storage Server Virtual Appliance transforms internal disk storage into an iSCSI SAN - No additional storage network investment needed • Enables VMware advanced features • Cost effective, highly available infrastructure for the SMB and ROBO 38 FalconStor NSS Virtual Appliance Architecture Virtual Machines VMFS Volume Virtual Machines VMFS Volume FalconStor NSS VA IP Network Physical Ethernet Adapter Virtual Switch Virtual LUN for VMDK files Server Internal RAID 39 High Availability via NSS VA Cross-Mirror Virtual Infrastructure HA supported without SAN storage To client Standby NSS VA Same size virtual LUN Cross-over Gigabit connection Active Access Point Passive Access Point 40