IBM存储ppt详细介绍.ppt

1、存储虚拟化及异构存储管理,金 微 J IBM资深存储系统专员,议 题,存储系统的挑战 “虚拟存储”的方方面面 虚拟控制器SVC SAN文件系统,数据迅速膨胀!,指数级的扩容。一级存储逼近PB级 所有信息都在数字化 数据访问要求 24/7 数据安全保存的时间要求越来越长,存储系统战略,技术,产品,解决方式,Disk,Tape,SAN,NAS,Software,Infrastructure Simplification,Business Continuity,ILM,Architecture,Virtualisation,Common Building Blocks,Open Standards,

2、存储系统功能架构,Orchestration,Storage Infrastructure Management,Hierarchical Storage Management,Archive Management,Recovery Management,Storage Virtualization,Advanced Replication Services,Hardware Infrastructure,Tape,Disk,Storage Networking,Content Management,存储虚拟化,VE Console,Productivity Center,Virtual Re

3、source Access,Workload & performance managers Resource management, modeling, mapping,Virtual Resource Management,Virtual Resources,Resource virtualisers Partitioning, virtual machines, I/O, networks, VTS,IBM Server & Storage Systems,Virtual Planning Tools,System z9 zSeries,pSeries,xSeries,BladeCente

4、r,TotalStorage,OpenPower,iSeries ,Enterprise Workload Manager,VE Console,IBM Director 5.10,Resource Dependency Service 2.1,IBM TotalStorage Productivity Center,虚拟化的概念,Efficient utilisation of physical resources Dynamic changes to virtual resources,Horizontal growth Investment protection,Enhanced fun

5、ction Improved availability,Non-disruptive maintenance Non-disruptive upgrades,存储虚拟化的方方面面,DS / TS,Storage Subsystem,SAN Volume Controller,SAN Filesystem NAS,Storage Network,p5 Hypervisor,AIX,LVM,Server,Operating System,VIOS,p5 虚拟化I/O,POWER5 Hypervisor,文件系统虚拟化,DS / TS,Storage Subsystem,SAN Volume Con

6、troller,SAN Filesystem NAS,Storage Network,p5 Hypervisor,AIX,LVM,Server,Operating System,VIOS,SAN 文件系统,DS,Legacy,Windows Server,C:,Linux Server,/filesystem,AIX Server,/filesystem,Storage Network,TotalStorage SAN 文件系统: 异构文件共享 策略驱动的文件管理 灵活性和伸缩性,当前的SAN: 本地文件系统，没有共享 基于服务器的分散式管理,SAN磁盘卷的虚拟化,DS / TS,Storag

7、e Subsystem,SAN Volume Controller,SAN Filesystem NAS,Storage Network,p5 Hypervisor,AIX,LVM,Server,Operating System,VIOS,SAN Volume Controller SAN 卷控制器,SAN,SVC,Virtual Disk,Virtual Disk,Server,Virtual Disk,Server,Virtual Disk,Continuous Data Replication,SVC 异构存储的灾备,Server,Server,Storage Network,Serve

8、r,Server,SVC,Storage Network,SVC,Continuous Data Replication,Continuous Data Replication,Site A,Site B,SVC 数据迁移,Storage Network,Server,将SVC植入SAN 部署新的存储系统 透明的将数据从旧存储迁移到新存储上,存储设备的虚拟化,DS,Storage Subsystem,SAN Volume Controller,SAN Filesystem NAS,Storage Network,p5 Hypervisor,AIX,LVM,Server,Operating Sy

9、stem,VIOS,DS8000 设计目标,支持数据持续化无中断访问 确保数据一致性 支持广泛的操作系统平台 在各种苛刻条件下，保持平衡的高性能 (持续传输率和IO响应时间) 无中断地性能和容量升级 提供本地和远程保持数据完整性的复制功能,DS8000 结构,N-way SMP,N-way SMP,Fault Tolerant Switch Fabric,Host Adapters,Host Adapters,Host Adapters,Host Adapters,Host Adapters,Host Adapters,Read Cache,Write Cache,Read Cache,Wri

10、te Cache,Device Adapters,Device Adapters,DS8000 LPAR,DS8300 LPAR,Host Adapters,Host Adapters,Host Adapters,Host Adapters,Host Adapters,Host Adapters,N-way SMP,N-way SMP,Fault Tolerant Switch Fabric,Host Adapters,Host Adapters,Host Adapters,Read Cache,Write Cache,Read Cache,Write Cache,Device Adapter

11、s,Device Adapters,LUN/卷虚拟化,LUN 虚拟扩展 LUN 可以在不影响RAID阵列上其他LUN的情况下进行创建和删除 LUN可以跨多个RAID阵列进行分配 最大的 LUN 可以增加到 2 TB LUN 的大小可以调整 (产品正式推出后) CKD 卷扩展 64K 柱面卷,扩展池,IBM NAS 的虚拟化 :,物理设备池,Disks,Disks,Disks,控制器： 虚拟卷,NAS虚拟化提供: 隔绝存储物理设备 提高资源利用率 提供多种连接方式 提供多种使用数据的方式,与应用界面: NAS文件、iSCSI 磁盘,IBM 虚拟磁带库TS7510虚拟带库控制器,作用： 缩短备份窗

12、口（每秒600MB） 提高备份数据的可用性 虚拟技术： 可扩至46TB的带库缓存 虚拟至多128个带库、1024驱动器和8192卷磁带 网络远程复制、数据压缩和加密 支持开放和主机平台,IBM TotalStorage SAN 卷控制器详解,RAID controller 2,RAID controller 1,LUN 4,LUN 3,LUN 2,LUN 1,LUN 4,LUN 3,LUN 2,LUN 1,MD 4,MD 3,MD 2,MD 1,MD 8,MD 7,MD 6,MD 5,物理设备配置的改变直接影响到主机和应用的可用性,Managed disks,SCSI LUNs,SCSI LU

13、Ns 仍然沿用 1-to-1 映射方式，它们仍然认为映射到服务器了 但其实是映射到了 SAN Volume Controller的 Managed disk,VD 4,VD 3,VD 2,VD 1,VD 7,VD 6,VD 5,Virtual disks,Hosts 仍然采用映射 LUNs 的方式，仍然仍然以为是物理磁盘 其实是符合应用需要的容量和性能的虚拟磁盘卷,Storage Software,The SVC storage software controls the mapping of Virtual disks to Managed disks,High Perf,Low Cost,

14、Managed disks 集中到 Managed Disk Groups ，以分类不同的存储设备,The SAN Volume Controller “隔绝” 存储设备改变对服务器的影响,映射选项 跨多个Managed disks条带化 在一个或多个 Managed disk上顺序存放 Image mode 一对一的映射,SANVolume Controller,SVC 4.1 支持平台不断更新中,SAN with 4Gbps fabric,HitachiThunder 9200 95xxV 9520V,HPEVA 3000/5000 4000/6000 8000,IBMDS DS4K /

15、6K DS8000 DS4800,HitachiLightning 9980V 9970V 9910/9960,HPMA/EMA 8000 12000 16000,EMCSymm 8000 DMX,EMC/DellCLARiiON FC4700 CX2/3/4/5/6/700,MicrosoftMSCS MPIO, VSS, GDS x64,IBM AIXHACMP/XD GPFS / VIO,SunSolaris 10 VCS Clustering SUN Cluster,HP/UX 11iV2 TRU64 OpenVMS ServiceGuard Clustering,Linux(Inte

16、l/Power/zLinux) RHEL/SUSE W / LVM RHEL AS 4 Ia32, x64, System p,IBMBladeCenter Win/Linux/VMWare/AIX OPM/FCS/IBS,SAN,SANVolume Controller,Continuous Copy Metro Mirror Global Mirror,VMWare Win / NW guests,Point-in-time Copy Full volume Copy on write,IBMESS,FAStT,Novell NetWare Clustering,Sun 9910/9960

17、 9970/9980,HPXP 48, 128 512, 1024,. . .,1024 Hosts,Cisco McData,iSCSI to hosts Via Cisco IPS,New,New,New Engines,Array-based copy services,New,New,HitachiTagmaStore USP, NSC55,IBMN series 5200, 5500,New,NetApp FAS 3020, 3050,New,SAN Volume Controller,SAN Volume Controller,RAID controller 2,RAID cont

18、roller 1,LUN 4,LUN 3,LUN 2,LUN 1,LUN 4,LUN 3,LUN 2,LUN 1,TotalStorage SAN 卷控制器数据复制,RAID controller 4,RAID controller 3,LUN 4,LUN 3,LUN 2,LUN 1,LUN 4,LUN 3,LUN 2,LUN 1,SAN Metro Mirror “outside the box”,SAN 数据迁移 “跨箱子”,SAN 瞬间复制 “跨箱子”,SAN Volume Controller,SAN Volume Controller,RAID controller 2,RAID c

19、ontroller 1,LUN 4,LUN 3,LUN 2,LUN 1,LUN 4,LUN 3,LUN 2,LUN 1,TotalStorage SAN卷控制器数据复制,RAID controller 4,RAID controller 3,LUN 4,LUN 3,LUN 2,LUN 1,LUN 4,LUN 3,LUN 2,LUN 1,跨设备的数据一致性组设定,仍然想保留原有磁盘复制功能 ？ SVC可以,谁是存储性能测试SPC1的性能冠军 ？,IBM SVC 3.1高据榜首,IBM TotalStorage SAN File SystemDFSMS 在开放环境下的实现,1988年首先在 IBM

20、 大型机上实现 存储系统管理所有数据资产和存储资产 通过策略自动管理数据 z/OS 操作系统标准功能 知道 DFSMS吗? SAN File System 有类似的功能: 可管理性Manageability 高效性Efficiency 成本控制Cost 业务连续性Business Continuity,Metadata store,IP Network,Metadata Server,SAN File System详解,Appl,SFS Client,Storage Area Network,File Open request,MetaData request,MetaData,File Op

21、en Response,File Data I/O,Application makes “File Open” request. This is intercepted by SAN File System Client and directed to Metadata server.,Metadata server gets Meta Data (file location, permissions, locks, attributes) stored on system location on SAN,Metadata server verifies available locks and

22、 responds to “File Open” request,SAN File System Client verifies security permissions and provides access to file,Metadata Server,User data,VFS/IFS Interface,Application conducts direct I/O with storage device on SAN. Achieves near local file performance,Application is unaware that “File Open” reque

23、st was processed by the SAN File System Client and Metadata server,DS8000,DS4100S-ATA,IBM TotalStorage SAN 文件系统,SAN,SANFile System,存储池 容量池 按照业务要求分类 可恢复性要求 性能 成本 其他,IBM TotalStorage SAN 文件系统,SAN,SANFile System,数据生命周期管理策略 按照业务要求摆放文件,IBM TotalStorage SAN文件系统,SAN,SANFile System,数据生命周期管理策略 Disk-to-disk 分

24、层管理 (在存储池之间透明的移动数据) 文件过期 / 删除 文件碎片整理 (redistributes files across available space),IBM TotalStorage SAN文件系统,SAN,SANFile System,服务器集中 简化服务器集中 减少服务中断,Backup Server,IBM TotalStorage SAN文件系统,SAN,SANFile System,Bkupagent,Bkupagent,Bkupagent,Bkupagent,更好的效率 备份 病毒扫描 其他?,今天的存储“供给”流程,FileSystem,FileSystem,Fil

25、eSystem,FileSystem,Database,SAN,DatabaseAdministrator,SystemAdministrator,StorageAdministrator,Check for more spaceon the file system,ContactSystem admin,Observetablespace is full,Check for more space on server,ContactStorage admin,Find available LUN(s)If none exist,allocate new ones,Find the best L

26、UN(s)for the application,Assign the LUN(s)to the application server HBA(s),Adjust switchzones,Find availablePoint-in-time and Remote copy target(s),Match source / targetpairs,ContactSystem admin,Inform the server thatnew storageis available,Expand thevolume group,Expand thefile system,ContactDBA,Cre

27、ate a newdatafile,Expand thetablespace,IBM TotalStorage SAN文件系统简化存储供给,Database,SAN,DatabaseAdministrator,SFSAdministrator,Create a newdatafile,Observetablespace is full,Monitor storagepool utilization,Expand thetablespace,SANFile System,FileSystem,FileSystem,FileSystem,FileSystem,Apply quotasif necessary,当今SAN的利用率,每个服务器有自己独立的文件系统而且需要分别配置和管理 每个服务器要分配LUN资源 管理成堆的 LUNs 物