* Your assessment is very important for improving the workof artificial intelligence, which forms the content of this project
Download Storage Decisions 2003
Expense and cost recovery system (ECRS) wikipedia , lookup
Design of the FAT file system wikipedia , lookup
Asynchronous I/O wikipedia , lookup
Object storage wikipedia , lookup
Lustre (file system) wikipedia , lookup
File system wikipedia , lookup
File Allocation Table wikipedia , lookup
Disk formatting wikipedia , lookup
Computer file wikipedia , lookup
Hosted by NAS and Gateways Considerations for File Storage Randy Kerns Copyright © 2003 - All Rights Reserved Evaluator Group, Inc . 7720 E. Belleview Avenue • Suite 210 • Greenwood Village, CO 80111 (303) 221-7867 • Fax: (303) 221-1615 www.evaluatorgroup.com Hosted by Agenda Structure of I/O File Storage Applications – file vs. block NAS storage • Structure • NAS Gateways • Considerations • Evaluation NAS Management Hosted by Structure of I/O All Open Systems use a similar I/O method • minor variations • some terminology differences • includes all flavors of Unix • includes NT/2000/XP/2003 Server Structure is for a “Layered I/O” • elements in each layer has different capability • layers may come from different vendors • system may contain different elements at each layer depending on device or usage Hosted by Layered I/O Structure Application / Database Operating System File System Device Driver Interface Hardware Device Hosted by File Storage File System • • • / file and directory structure on logical disk (typically single) contains metadata to describe information (size, location, dates, etc.) on the disk. Ex: superblock, inode different types of file systems with different methods of access • file system handled by software in program stack of operating system • multiple file systems may be present at one time • “mounted” file systems or “shares” are remote file systems bin dev aps etc test passwd usr Mounted file system hosts Hosted by File Systems VFS FFS UFS AFS NFS RFS S5FS VxFS JFS CFS EXT2/EXT3 GFS ReiserFS XFS CXFS QFS HFS NTFS FATxx Virtual File System Fast File System UNIX File System – used interchangeably with FFS Andrew File System – also Distributed File System Network File System – developed by Sun Remote File System – developed by AT&T Original System V file system Veritas Journaling File System Journaled File System – AIX Cluster file system – Tru64 2nd/3rd Extended File System – Linux systems Global File System – Linux Journaling file system – Linux Extended File System – SGI and others Clustered Extended File System – SGI 64-bit very large file system – Sun Solaris Hierarchical File System – S/390 UNIX Windows NT/2000/2003 Windows – several versions Hosted by Applications May be written to do file I/O or block I/O • File I/O Uses the file system driver Caching done by system Typically system utilities for management I/O done to FILE HANDLE: Offset • Block I/O Used to bypass file system – performance reasons and overhead in capacity Buffering/caching done by application (ie database) Called RAW I/O I/O typically done to blocks – linear address space Special utilities for management Hosted by Network Attached Storage Workstation Workstation Host Tower box LAN I/O Requests for for File I/O using NFS, CIFS Server Server owns storage device and does block level I/O NAS Storage Disk array Hosted by NAS Device NAS File Access Handler Application File I/O Access File I/O Operating System I/O Redirector Operating System NAS I/O Structure Client Computer System Network File Protocol (NFS, CIFS) TCP/IP Stack NIC Driver File System TCP/IP Stack Volume Manager NIC Driver Disk System Device Driver Network Interface Card Network Interface Card Remote File I/O Access Across the Network Network File Protocol (NFS, CIFS) Disk Controller/ HBA Block I/O LAN Disk System Hosted by NAS Gateways Network Attached Storage with SAN Storage Application The controller function of NAS with the storage decoupled • Connected to a SAN – fibre channel • • • typically May be separate product or a version of a standard NAS product can utilize SAN capabilities does introduce a different management scheme – adds the SAN storage management as well as the NAS administration File Redirector Computer System Local Area Network Remote File System NAS Device SAN Disk System Hosted by NAS Gateways Typical usage profile • Enterprise data center environments with existing SAN Requirement for file storage Consolidation of existing, independent NAS devices Centralized administration and purchasing Storage system partitioned for NAS filesystems (LUNs) • Administration cost Target is to reduce overall storage administration costs Hosted by NAS Considerations FIRST: What are your requirements? • Part of overall storage strategy Future needs Timeframe for deployment Cost structures • Understand needs for users, applications, business Does application require file or block access? What environment will it used in? • Enterprise data center • Small to Mid-Size Business (SMB) • Departmental • Workgroup Hosted by NAS Considerations Who will administer • Dictates tools and capabilities • Organizational tension Usage considerations • Protocols – CIFS, NFS, HTTP, FTP, NCP • Data sharing – locking requirements • Connectivity – number and type of connections • Security – IP/Ethernet usage, data at rest • Performance Types of data - bandwidth or response time sensitive • OLTP • Large Block – video, etc. Responsiveness – guarantees, application requirements Hosted by NAS Considerations Advanced services • Part of consideration • Requirements dictate which are of concern Remote copy for disaster tolerance: Technology used, distance, cost, currency of data, recovery process, time to recovery Point-in-Time copy functions: Local and remote, capacity consumed, ability to restore versions, make available read/write Backup: LAN-free, use of SAN devices, NDMP support, favorite backup software usage Management: incorporation into overall storage management strategy, aggregation Hosted by NAS Considerations Capacity required • Today and tomorrow • Scaling issues Additional NAS devices vs. additional disks Performance scaling Management Is a NAS Gateway the best option ? • Usually environment specific Enterprise data center with existing SAN Storage professionals managing storage Hosted by NAS Evaluation Develop a set of criteria • Put in elements that are part of your requirements • Give little weight to extraneous items (So What?) Evaluator Group workbook • As example • EG_NAS_Workbook.pdf Hosted by NAS Management Evolution • NAS devices each individually managed Installed and administered as unique devices • Management does not scale Additive costs for additional NAS devices • Few sophisticated tools Expectation for capacity planning, performance monitoring and reporting, and SLA adherence didn’t exist • Changes are underway for NAS management Hosted by NAS Management Aggregation • Management software to manage multiple NAS devices • Two methods Individual devices with information accumulated • Statistics, capacity information • Controls, status Multiple devices managed as single entity • Dynamic allocation of capacity – adding of capacity (units) • Data protection dynamically spread among devices • Performance tuning by distributing data Hosted by NAS Management NAS Aggregation Example • Software to collect information • • about NAS appliances Same vendor Unified view to monitor and control Status and events Capacity Appliances, OS versions Volumes Disk devices Addresses admin costs in homogeneous environment Servers Hosted by NAS Management NAS Aggregation Example • Data accessed as if single NAS Servers appliance – NAS array • For increased capacity, add appliances • Data is redistributed across appliances • Clients see additional capacity with no required changes • Management as a single entity NAS Appliances Hosted by NAS Management Summary • NAS Management is maturing • Economics of management / administration cost is now becoming important Necessary with expanded use of NAS Capacity growth accentuate the problem • Need to integrate with SRM tools Must include NAS devices from different vendors Still a long way to go to have enterprise tools Hosted by NAS Summary Choice of NAS is an easy answer in some environments • Traditional NAS usage in departmental and workgroups • More difficult in enterprise data center environments Where the requirements are understood and the attributes of NAS answer them Where the overall storage strategy can incorporate NAS into existing environment • Includes management tools • Infrastructure • Costs – separate IP network, NIC changes Hosted by www.evaluatorgroup.com