mdadm 软RAID管理工具使用指导.doc

什么是mdadm?mdadm是multiple devices admin的简称，它是Linux下的一款标准的软件 RAID 管理工具，作者是Neil Brown。为什么选择mdadm?我们知道raidtools是Linux下一款经典的用于管理软件 RAID 的工具，但是因为配置/etc/raidtab比较繁琐，而且其功能有限，所以现在越来越多的人选择mdadm。mdadm 和 raidtools 主要有以下几点不同： mdadm能够诊断、监控和收集详细的阵列信息 mdadm是一个单独集成化的程序而不是一些分散程序的集合，因此对不同RAID管理命令有共通的语法 mdadm能够执行几乎所有的功能而不需要配置文件(也没有默认的配置文件) 当然，如果需要一个配置文件，mdadm将帮助管理它的内容 准备工作QUOTE:首先我们在虚拟机中添加四块SCSI硬盘(我们仍然直接使用只有一个分区的硬盘(sdb、sdc、sdd、sde)来作为RAID设备的成员，每个盘大小为8G)并分区格式化，具体步骤可参考用raidtools创建Linux Soft RAID，这里从略下载、安装mdadm你可以到mdadm的官方网站(.au/neilb/source/mdadm/)下载最新的压缩包。目前最新的版本是mdadm-2.6.2(LATEST.tgz or mdadm-2.6.2.tgz)。 推荐下载tgz格式的压缩包自行编译然后安装mdadm和它的文档、手册和示例文件。安装步骤如下： login as: eric4evereric4ever0s password:Last login: Thu May 24 10:59:06 2007 from rootlocalhost eric4ever# ls -lhtotal 208K-rw-r-r- 1 root root 201K May 24 11:01 LATEST.tgzrootlocalhost eric4ever# tar zxvf LATEST.tgzmdadm-2.6.2/mdadm-2.6.2/mdadm.conf-examplemdadm-2.6.2/misc/mdadm-2.6.2/misc/syslog-eventsmdadm-2.6.2/md_u.hmdadm-2.6.2/TODOmdadm-2.6.2/ANNOUNCE-2.0mdadm-2.6.2/kernel-patch-2.6.18mdadm-2.6.2/Query.cmdadm-2.6.2/ReadMe.cmdadm-2.6.2/super0.cmdadm-2.6.2/SHA1.cmdadm-2.6.2/ANNOUNCE-2.6mdadm-2.6.2/ANNOUNCE-2.6.1mdadm-2.6.2/Monitor.cmdadm-2.6.2/md_p.hmdadm-2.6.2/mdassemble.cmdadm-2.6.2/mdadm.hmdadm-2.6.2/mdadm.specmdadm-2.6.2/mdadm.cmdadm-2.6.2/Assemble.cmdadm-2.6.2/Kill.cmdadm-2.6.2/ANNOUNCE-2.1mdadm-2.6.2/pwgr.cmdadm-2.6.2/Incremental.cmdadm-2.6.2/mapfile.cmdadm-2.6.2/Grow.cmdadm-2.6.2/tests/mdadm-2.6.2/tests/00raid4mdadm-2.6.2/tests/05r6-bitmapfilemdadm-2.6.2/tests/02r6growmdadm-2.6.2/tests/03r5assemmdadm-2.6.2/tests/07testreshape5mdadm-2.6.2/tests/05r1-internalbitmap-v1cmdadm-2.6.2/tests/02r5growmdadm-2.6.2/tests/05r1-re-addmdadm-2.6.2/tests/00raid6mdadm-2.6.2/tests/01r5failmdadm-2.6.2/tests/06update-uuidmdadm-2.6.2/tests/05r1-bitmapfilemdadm-2.6.2/tests/02r1growmdadm-2.6.2/tests/05r1-n3-bitmapfilemdadm-2.6.2/tests/06wrmostlymdadm-2.6.2/tests/05r1-re-add-nosupermdadm-2.6.2/tests/00raid5mdadm-2.6.2/tests/03r5assemV1mdadm-2.6.2/tests/00multipathmdadm-2.6.2/tests/05r1-internalbitmap-v1bmdadm-2.6.2/tests/06namemdadm-2.6.2/tests/05r1-grow-internal-1mdadm-2.6.2/tests/01r1failmdadm-2.6.2/tests/00raid0mdadm-2.6.2/tests/05r1-grow-externalmdadm-2.6.2/tests/06r5swapmdadm-2.6.2/tests/07autodetectmdadm-2.6.2/tests/05r1-internalbitmapmdadm-2.6.2/tests/02lineargrowmdadm-2.6.2/tests/00raid1mdadm-2.6.2/tests/testdevmdadm-2.6.2/tests/05r5-internalbitmapmdadm-2.6.2/tests/00raid10mdadm-2.6.2/tests/ToTestmdadm-2.6.2/tests/05r5-bitmapfilemdadm-2.6.2/tests/04r0updatemdadm-2.6.2/tests/02r1addmdadm-2.6.2/tests/03r0assemmdadm-2.6.2/tests/checkmdadm-2.6.2/tests/06sysfsmdadm-2.6.2/tests/05r1-grow-internalmdadm-2.6.2/tests/04r1updatemdadm-2.6.2/tests/00linearmdadm-2.6.2/tests/05r1-internalbitmap-v1amdadm-2.6.2/mdassemble.8mdadm-2.6.2/restripe.cmdadm-2.6.2/Manage.cmdadm-2.6.2/md.4mdadm-2.6.2/ANNOUNCE-2.5mdadm-2.6.2/ChangeLogmdadm-2.6.2/Examine.cmdadm-2.6.2/ANNOUNCE-2.5.1mdadm-2.6.2/sha1.hmdadm-2.6.2/inventorymdadm-2.6.2/ANNOUNCE-2.3mdadm-2.6.2/sha1.cmdadm-2.6.2/raid5extend.cmdadm-2.6.2/bitmap.cmdadm-2.6.2/ANNOUNCE-2.6.2mdadm-2.6.2/ANNOUNCE-2.5.3mdadm-2.6.2/dlink.cmdadm-2.6.2/md5.hmdadm-2.6.2/config.cmdadm-2.6.2/mdadm.conf.5mdadm-2.6.2/mkinitramfsmdadm-2.6.2/swap_super.cmdadm-2.6.2/bitmap.hmdadm-2.6.2/testmdadm-2.6.2/mdopen.cmdadm-2.6.2/ANNOUNCE-2.5.5mdadm-2.6.2/Create.cmdadm-2.6.2/kernel-patch-2.6.19mdadm-2.6.2/mdadm.8mdadm-2.6.2/ANNOUNCE-2.2mdadm-2.6.2/ANNOUNCE-2.5.4mdadm-2.6.2/COPYINGmdadm-2.6.2/sysfs.cmdadm-2.6.2/super1.cmdadm-2.6.2/Makefilemdadm-2.6.2/util.cmdadm-2.6.2/INSTALLmdadm-2.6.2/mdstat.cmdadm-2.6.2/ANNOUNCE-2.4.1mdadm-2.6.2/dlink.hmdadm-2.6.2/ANNOUNCE-2.5.6mdadm-2.6.2/ANNOUNCE-2.3.1mdadm-2.6.2/makedistmdadm-2.6.2/kernel-patch-mdadm-2.6.2/ANNOUNCE-2.5.2mdadm-2.6.2/ANNOUNCE-2.4-pre1mdadm-2.6.2/Detail.cmdadm-2.6.2/README.initramfsmdadm-2.6.2/ANNOUNCE-2.4mdadm-2.6.2/Build.crootlocalhost eric4ever# ls -lhtotal 212K-rw-r-r- 1 root root 201K May 24 11:01 LATEST.tgzdrwxr-xr-x 4 1000 1000 4.0K May 21 12:25 mdadm-2.6.2rootlocalhost eric4ever# cd mdadm-2.6.2/rootlocalhost mdadm-2.6.2# make installgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o mdadm.o mdadm.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o config.o config.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o mdstat.o mdstat.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o ReadMe.o ReadMe.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o util.o util.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o Manage.o Manage.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o Assemble.o Assemble.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o Build.o Build.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o Create.o Create.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o Detail.o Detail.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o Examine.o Examine.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o Grow.o Grow.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o Monitor.o Monitor.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o dlink.o dlink.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o Kill.o Kill.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o Query.o Query.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o Incremental.o Incremental.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o mdopen.o mdopen.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o super0.o super0.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o super1.o super1.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o bitmap.o bitmap.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o restripe.o restripe.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -c -o sysfs.o sysfs.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/ -DCONFFILE=/etc/mdadm.conf/ -DCONFFILE2=/etc/mdadm/mdadm.conf/ -DHAVE_STDINT_H -o sha1.o -c sha1.cgcc -Wall -Werror -Wstrict-prototypes -ggdb -DSendmail=/usr/sbin/sendmail -t/usr/bin/install -D -m 644 mdadm.8 /usr/share/man/man8/mdadm.8/usr/bin/install -D -m 644 md.4 /usr/share/man/man4/md.4/usr/bin/install -D -m 644 mdadm.conf.5 /usr/share/man/man5/mdadm.conf.5/usr/bin/install -D -m 755 mdadm /sbin/mdadmrootlocalhost mdadm-2.6.2#你也可以使用基于RPM的发布包，你可以从这里下载，不过最新的RPM为2.6-1版本：rootlocalhost mdadm-2.6.2# rpm -ihv mdadm-1.4.0-1.i386.rpm mdadm简介我们可以使用man mdadm命令来查看mdadm的帮助信息：rootlocalhost mdadm-2.6.2# man mdadmmdadm用法基本语法： mdadm mode options 目前支持： LINEAR, RAID0(striping), RAID1(mirroring), RAID4, RAID5, RAID6, RAID10, MULTIPATH和FAULTY模式(7种)： Assemble：加入一个以前定义的阵列 Build：创建一个没有超级块的阵列 Create：创建一个新的阵列，每个设备具有超级块 Manage： 管理阵列(如添加和删除) Misc：允许单独对阵列中的某个设备进行操作(如停止阵列) Follow or Monitor:监控RAID的状态 Grow：改变RAID的容量或阵列中的设备数目 选项：-A, -assemble：加入一个以前定义的阵列-B, -build：创建一个没有超级块的阵列(Build a legacy array without superblocks.)-C, -create：创建一个新的阵列-F, -follow, -monitor：选择监控(Monitor)模式-G, -grow：改变激活阵列的大小或形态-I, -incremental：添加一个单独的设备到合适的阵列，并可能启动阵列-auto-detect：请求内核启动任何自动检测到的阵列-h, -help：帮助信息，用在以上选项后，则显示该选项信息-help-options：显示更详细的帮助-V, -version：打印mdadm的版本信息-v, -verbose：显示细节-b, -brief：较少的细节。用于 -detail 和 -examine 选项-Q, -query：查看一个device，判断它为一个 md device 或是 一个 md 阵列的一部分-D, -detail：打印一个或多个 md device 的详细信息-E, -examine：打印 device 上的 md superblock 的内容-c, -config= ：指定配置文件，缺省为 /etc/mdadm.conf-s, -scan：扫描配置文件或 /proc/mdstat以搜寻丢失的信息。配置文件/etc/mdadm.conf使用mdadm创建RAID5Create (mdadm -create)模式用来创建一个新的阵列。 在这里我们首先使用mdadm -create -help查看一下帮助：rootlocalhost mdadm-2.6.2# mdadm -create -helpUsage: mdadm -create device -chunk=X -level=Y -raid-devices=Z devicesThis usage will initialise a new md array, associate somedevices with it, and activate the array. In order to create anarray with some devices missing, use the special word missing inplace of the relevant device name.Before devices are added, they are checked to see if they already containraid superblocks or filesystems. They are also checked to see ifthe variance in device size exceeds 1%.If any discrepancy is found, the user will be prompted for confirmationbefore the array is created. The presence of a -run can override thiscaution.If the -size option is given then only that many kilobytes of eachdevice is used, no matter how big each device is.If no -size is given, the apparent size of the smallest drive givenis used for raid level 1 and greater, and the full device is used forother levels.Options that are valid with -create (-C) are:-bitmap= : Create a bitmap for the array with the given filename-chunk= -c : chunk size of kibibytes-rounding= : rounding factor for linear array (=chunk size)-level= -l : raid level: 0,1,4,5,6,linear,multipath and synonyms-parity= -p : raid5/6 parity algorithm: left,right-,asymmetric-layout= : same as -parity-raid-devices= -n : number of active devices in array-spare-devices= -x: number of spares (eXtras) devices in initial array-size= -z : Size (in K) of each drive in RAID1/4/5/6/10 - optional-force -f : Honour devices as listed on command line. Dont : insert a missing drive for RAID5.-run -R : insist of running the array even if not all : devices are present or some look odd.-readonly -o : start the array readonly - not supported yet.-name= -N : Textual name for array - max 32 characters-bitmap-chunk= : bitmap chunksize in Kilobytes.-delay= -d : bitmap update delay in seconds.接下来我们使用mdadm创建在/dev/md0上创建一个由sdb、sdc、sdd3块盘组成(另外1块盘sde为热备)的RAID5：rootlocalhost mdadm-2.6.2# mdadm -create -verbose /dev/md0 -level=raid5 -raid-devices=3 /dev/sdb /dev/sdc /dev/sdd -spare-devices=1 /dev/sdemdadm: layout defaults to left-symmetricmdadm: chunk size defaults to 64Kmdadm: size set to 8388544Kmdadm: array /dev/md0 started.每个mdadm的选项都有一个缩写的形式，例如，上面我们创建RAID 5的命令可以使用下列的缩写形式：rootlocalhost mdadm-2.6.2# mdadm -Cv /dev/md0 -l5 -n3 /dev/sdb /dev/sdc /dev/sdd -x1 /dev/sde二者的效果是相同的。查看RAID状态接下来我们使用cat /proc/mdstat命令来查看一下RAID的状态，我们也可以利用watch命令来每隔一段时间刷新/proc/mdstat的输出。使用CTRL+C可以取消。rootlocalhost mdadm-2.6.2# watch -n 10 cat /proc/mdstatEvery 10s: cat /proc/mdstat Thu May 24 11:53:46 2007Personalities : raid5read_ahead 1024 sectorsmd0 : active raid5 sdd4 sde3 sdc1 sdb0 16777088 blocks level 5, 64k chunk, algorithm 2 3/2 UU_ =. recovery = 24.0% (2016364/8388544) finish=10.2minspeed=10324K/secunused devices: rootlocalhost mdadm-2.6.2#接下来我们为阵列创建文件系统：rootlocalhost mdadm-2.6.2# mkfs.ext3 /dev/md0mke2fs 1.34 (25-Jul-2003)Filesystem label=OS type: LinuxBlock size=4096 (log=2)Fragment size=4096 (log=2)2097152 inodes, 4194272 blocks209713 blocks (5.00%) reserved for the super userFirst data block=0128 block groups32768 blocks per group, 32768 fragments per group16384 inodes per groupSuperblock backups stored on blocks: 32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208, 4096000Writing inode tables: doneCreating journal (8192 blocks): doneWriting superblocks and filesystem accounting information: doneThis filesystem will be automatically checked every 34 mounts or180 days, whichever comes first. Use tune2fs -c or -i to override.You have new mail in /var/spool/mail/root我们尝试向RAID中写入一个test2文件：rootlocalhost eric4ever# vi test2copy succeed!erictlfurl/urldone!rootlocalhost eric4ever# lsLATEST.tgz mdadm-2.6.2 test2rootlocalhost eric4ever# mount /dev/md0 /mnt/md0rootlocalhost eric4ever# df -lhFilesystem Size Used Avail Use% Mounted on/dev/sda1 2.9G 1.8G 1.1G 63% /dev/sda3 4.6G 33M 4.3G 1% /optnone 125M 0 125M 0% /dev/shm/dev/md0 16G 33M 15G 1% /mnt/md0rootlocalhost eric4ever# ls /mnt/md0lost+foundrootlocalhost eric4ever# cp ./test2 /mnt/md0rootlocalhost eric4ever# ls /mnt/md0lost+found test2rootlocalhost eric4ever# ls -lh /mnt/md0total 20Kdrwx- 2 root root 16K May 24 11:55 lost+found-rw-r-r- 1 root root 63 May 24 11:56 test2使用mdadm -detail /dev/md0(或mdadm -D /dev/md0)命令以及cat /proc/mdstat命令可以查看RAID设备的状态：rootlocalhost eric4ever# mdadm -D /dev/md0 (或mdadm -detail /dev/md0)/dev/md0: Version : 00.90.00Creation Time : Thu May 24 13:45:35 2007 Raid Level : raid5 Array Size : 16777088 (16.00 GiB 17.18 GB)Used Dev Size : 8388544 (8.00 GiB 8.59 GB) Raid Devices : 3Total Devices : 5Preferred Minor : 0 Persistence : Superblock is persistent Update Time : Thu May 24 13:45:36 2007 State : active, degraded, recoveringActive Devices : 2Working Devices : 4Failed Devices : 1Spare Devices : 2 Layout : left-symmetric Chunk Size : 64KRebuild Status : 16% complete UUID : 4b15050e:7d0c477d:98ed7d00:0f3c29e4 Events : 0.2 Number Major Minor RaidDevice State 0 8 16 0 active sync /dev/sdb 1 8 32 1 active sync /dev/sdc 2 0 0 2 removed 3 8 64 3 spare /dev/sde 4 8 48 4 spare /dev/sdd通过mdadm -D命令，我们可以查看RAID的版本、创建的时间、RAID级别、阵列容量、可用空间、设备数量、超级块、更新时间、各个设备的状态、RAID算法以及块大小等信息，通过上面的信息我们可以看到目前RAID正处于重建过程之中，进度为16%，其中/dev/sdb和/dev/sdc两块盘已经同步。使用watch命令每个30秒刷新一下查看的进度：rootlocalhost eric4ever# watch -n 30 cat /proc/mdstatEvery 30s: cat /proc/mdstat Thu May 24 13:55:56 2007Personalities : raid5read_ahead 1024 sectorsmd0 : active raid5 sdd4 sde3 sdc1 sdb0 16777088 blocks level 5, 64k chunk, algorithm 2 3/2 UU_ =. recovery = 72.3% (6067444/8388544) finish=3.7minspeed=10324K/secunused devices: 当进度进行到100%时，显示如下：Every 30s: cat /proc/mdstat Thu May 24 14:00:57 2007Personalities : raid5read_ahead 1024 sectorsmd0 : active raid5 sdd2 sde3 sdc1 sdb0 16777088 blocks level 5, 64k chunk, algorithm 2 3/3 UUUunused devices: 这是我们再使用mdadm -D命令查看一下：rootlocalhost eric4ever# mdadm -D /dev/md0 (或mdadm -detail /dev/md0)/dev/md0: Version : 00.90.00Creation Time : Thu May 24 13:45:35 2007 Raid Level : raid5 Array Size : 16777088 (16.00 GiB 17.18 GB)Used Dev Size : 8388544 (8.00 GiB 8.59 GB) Raid Devices : 3Total Devices : 5Preferred Minor : 0 Pe