Ceph入门到精通- storcli安装

文章列表

storcli 是LSI公司官方提供的Raid卡管理工具，storcli已经基本代替了megacli，是一款比较简单易用的小工具。将命令写成一个个的小脚本，会将使用变得更方便。

安装简单，Windows系统下解压出来以后可以直接运行。

Linux系统默认位置在 /opt/MegaRAID/storcli下面，安装完成后可以按照个人使用习惯拷贝到/usr/bin和/usr/sbin下，也可以直接到安装目录运行。

下载地址

Broadcom官网：https://www.broadcom.com/site-search?q=storcli

百度云盘：

链接：https://pan.baidu.com/s/1c_PBmz5UoWSjT3h6cZG3Vw

提取码：long

安装步骤

[root@localhost~]#unzip 007.1715.0000.0000_Unified_StorCLI-PUL.zip
[root@localhost~]#cd Unified_storcli_all_os/
[root@localhost~]#cd Linuxrpm -ivhstorcli-007.1705.0000.0000-1.noarch.rpm
[root@localhost~]# rpm -ivh storcli-007.1704.0000.0000-1.noarch.rpm
warning:storcli-007.1704.0000.0000-1.noarch.rpm: Header V3 RSA/SHA256 Signature,
key ID cb529165: NOKEY Preparing... ################################# [100%] Updating /installing... 1:storcli-007.1704.0000.0000-1 ###############################[100%]
查看安装是否成功
[root@localhost storcli]# ls /opt/MegaRAID/storcli/
install.log storcli64 storcli.log
拷贝到可执行文件目录
cp/opt/MegaRAID/storcli/storcli64 /usr/bin/
cp/opt/MegaRAID/storcli/storcli64 /usr/sbin/

获取帮助

storcli64 -h

storcli64 show all

1.对更换完的硬盘进行划分raid0，并开启ssdcache功能

storcli64 /c1 add vd r0 size=all divers = 18:10 cached（storcli64 /c1 add vd r0 drives=18:10，storcli64 /c1/v9 set iopolicy=Cached）

storcli64 /c1/v9 set ssdcaching=on

2.确认ok后，在对应的存储节点进行盘的检查。

3.通知停响应节点监控

4.osd的添加，执行相应脚本内容。（具体情况）

parted_new_disk.sh

add_osd.sh

Linux使用storcli工具查看服务器硬盘和raid组信息

1、简介

MegaCli 是LSI公司官方提供的SCSI卡管理工具，由于LSI被收购变成了现在的Broadcom，所以现在想下载MegaCli，

需要去Broadcom官网查找Legacy产品支持，搜索MegaRAID即可。

现在官方有storcli，storcli已经基本代替了megacli，整合了LSI和3ware所有产品。

安装方面比较简单，megacli还要Lib_Utils的支持，而storcli只用一个rpm包就可以下载，

去Broadcom官网去找就行了：Search Results

storcli支持json格式输出，信息解析更加方便。

我个人推荐使用这个软件，因为megacli 工具需要安装额外的软件包，有些服务器客户不允许安装其他的软件包，所以比较麻烦。

这个工具直接安装了之后就可以用。

1.1服务器信息：

1.2系统信息：

[root@localhost storcli]# cat /etc/redhat-release

Red Hat Enterprise Linux Server release 6.4 (Santiago)

1.3 安装storcli

rpm -ivh storcli-1.03.11-1.noarch.rpm

目录： /opt/Mega/storcli

注意版本问题

我这台服务器是DELL R720xd，2012年上线的，所以我用的是storcli.1.03.11版本。

我用的新版本安装之后，执行命令没有输出，所以这一点需要注意。

1.4一些参数定义：

/cx = Controller ID

/vx = Virtual Drive Number.

/ex = Enclosure ID

/sx = Slot ID

1.5为了管理方便，建立软连接

ln -s /opt/MegaRAID/storcli/storcli64 /bin/storcli

ln -s /opt/MegaRAID/storcli/storcli64 /sbin/storcli

如果不想建立软连接，就在/opt/MegaRAID/storcli 目录下执行./storcli64 指令

2、查看当前设备raid控制器相关信息

[root@localhost storcli]# ./storcli64 show all 可以看到只有一个控制器

Status Code = 0

Status = Success

Description = None

Number of Controllers = 1

Host Name = localhost.localdomain

Operating System = Linux2.6.32-358.el6.x86_64

System Overview :

===============

------------------------------------------------------------

Ctl Model Ports PDs DGs DNOpt VDs VNOpt BBU sPR DS EHS ASOs

------------------------------------------------------------

0 Mini 8 14 3 0 3 0 Opt On 3 N 0 【只看到一个控制器】

------------------------------------------------------------

Ctl=Controller Index|DGs=Drive groups|VDs=Virtual drives|Fld=Failed

PDs=Physical drives|DNOpt=DG NotOptimal|VNOpt=VD NotOptimal|Opt=Optimal

Msng=Missing|Dgd=Degraded|NdAtn=Need Attention|Unkwn=Unknown

sPR=Scheduled Patrol Read|DS=DimmerSwitch|EHS=Emergency Hot Spare

Y=Yes|N=No|ASOs=Advanced Software Options|BBU=Battery backup unit

ASO :

===

----

Ctl

----

CR=CacheCade(Read)|RF=Reduced Feature Set|CO=Cache Offload

CW=CacheCade(Read/Write)|X=Not Available/Not Installed|U=Unlimited|T=Trial

3、查看控制器c0的相关信息

[root@localhost storcli]# ./storcli64 /c0 show

Controller = 0

Status = Success

Description = None

Product Name = PERC H710P Mini【控制器型号】

Serial Number = 26300UP

SAS Address = 5d4ae520a6bcbc00

Mfg. Date = 06/04/12

System Time = 05/22/2019 16:22:28

Controller Time = 05/22/2019 08:22:28

FW Package Build = 21.0.2-0001

BIOS Version = 5.30.00_4.12.05.00_0x05110000

FW Version = 3.130.05-1587

Driver Name = megaraid_sas

Driver Version = 06.504.01.00-rh1

Controller Bus Type = N/A

PCI Slot = N/A

PCI Bus Number = 2

PCI Device Number = 0

PCI Function Number = 0

Drive Groups = 3

TOPOLOGY :

========

--------------------------------------------------------------------------

DG Arr Row EID:Slot DID Type State BT Size PDC PI SED DS3 FSpace

--------------------------------------------------------------------------

0 - - - - RAID1 Optl N 278.875 GB dflt N N dflt N

0 0 - - - RAID1 Optl N 278.875 GB dflt N N dflt N

0 0 0 32:24 24 DRIVE Onln N 278.875 GB dflt N N dflt -

0 0 1 32:25 25 DRIVE Onln N 278.875 GB dflt N N dflt -

1 - - - - RAID5 Optl N 4.089 TB dflt N N dflt N

1 0 - - - RAID5 Optl N 4.089 TB dflt N N dflt N

1 0 0 32:0 0 DRIVE Onln N 837.75 GB dflt N N dflt -

1 0 1 32:1 1 DRIVE Onln N 837.75 GB dflt N N dflt -

1 0 2 32:2 2 DRIVE Onln N 837.75 GB dflt N N dflt -

1 0 3 32:3 3 DRIVE Onln N 837.75 GB dflt N N dflt -

1 0 4 32:4 4 DRIVE Onln N 837.75 GB dflt N N dflt -

1 0 5 32:5 5 DRIVE Onln N 837.75 GB dflt N N dflt -

2 - - - - RAID5 Optl N 4.089 TB dflt N N dflt N

2 0 - - - RAID5 Optl N 4.089 TB dflt N N dflt N

2 0 0 32:6 6 DRIVE Onln N 837.75 GB dflt N N dflt -

2 0 1 32:7 7 DRIVE Onln N 837.75 GB dflt N N dflt -

2 0 2 32:8 8 DRIVE Onln N 837.75 GB dflt N N dflt -

2 0 3 32:9 9 DRIVE Onln N 837.75 GB dflt N N dflt -

2 0 4 32:10 10 DRIVE Onln N 837.75 GB dflt N N dflt -

2 0 5 32:11 11 DRIVE Onln N 837.75 GB dflt N N dflt - 【可以看到服务器有几个RAID，每个RAID的级别和成员盘】

--------------------------------------------------------------------------

DG=Disk Group Index|Arr=Array Index|Row=Row Index|EID=Enclosure Device ID

DID=Device ID|Type=Drive Type|Onln=Online|Rbld=Rebuild|Dgrd=Degraded

Pdgd=Partially degraded|Offln=Offline|BT=Background Task Active

PDC=PD Cache|PI=Protection Info|SED=Self Encrypting Drive|Frgn=Foreign

DS3=Dimmer Switch 3|dflt=Default|Msng=Missing|FSpace=Free Space Present

Virtual Drives = 3【服务器有三个RAID，两个RAID5一个RAID1】

VD LIST :

=======

---------------------------------------------------------------

DG/VD TYPE State Access Consist Cache Cac sCC Size Name

---------------------------------------------------------------

0/0 RAID1 Optl RW Yes RaWBD R OFF 278.875 GB

1/1 RAID5 Optl RW Yes RaWBD R OFF 4.089 TB

2/2 RAID5 Optl RW Yes RaWBD R OFF 4.089 TB

---------------------------------------------------------------

Cac=CacheCade|Rec=Recovery|OfLn=OffLine|Pdgd=Partially Degraded|dgrd=Degraded

Ra=Read Ahead Adaptive|R=Read Ahead Always|NR=No Read Ahead|WB=WriteBack|

AWB=Always WriteBack|WT=WriteThrough|C=Cached IO|D=Direct IO|sCC=Scheduled

Check Consistency

Physical Drives = 14【十四个物理磁盘】

PD LIST :

=======

-------------------------------------------------------------------------

EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp

-------------------------------------------------------------------------

32:0 0 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:1 1 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:2 2 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:3 3 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:4 4 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:5 5 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:6 6 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:7 7 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:8 8 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:9 9 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:10 10 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:11 11 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:24 24 Onln 0 278.875 GB SAS HDD N N 512B ST9300603SS U

32:25 25 Onln 0 278.875 GB SAS HDD N N 512B ST9300605SS U

-------------------------------------------------------------------------

EID-Enclosure Device ID|Slt-Slot No.|DID-Device ID|DG-DriveGroup

DHS-Dedicated Hot Spare|UGood-Unconfigured Good|GHS-Global Hotspare

UBad-Unconfigured Bad|Onln-Online|Offln-Offline|Intf-Interface

Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info

BBU_Info :

========

------------------------------------------------------------

Model State RetentionTime Temp Mode MfgDate Next Learn

------------------------------------------------------------

BBU Optimal 0 hour(s) 30C 0 2011/07/18 None

------------------------------------------------------------

4、获取enclosure信息

硬盘大多是附在enclosure上不是直接附在controller上。

显示所有的enclosure信息，但是系统中只有一个enclosure ，EID:32.

[root@localhost storcli]# ./storcli64 /c0/eall show

Controller = 0

Status = Success

Description = None

Properties :

==========

-----------------------------------------------------------------------------

EID State Slots PD PS Fans TSs Alms SIM Port# ProdID VendorSpecific

-----------------------------------------------------------------------------

32 OK 26 14 0 0 0 0 0 Unavailable BP12G+EXP

-----------------------------------------------------------------------------

EID-Enclosure Device ID |PD-Physical drive count |PS-Power Supply count|

TSs-Temperature sensor count |Alms-Alarm count |SIM-SIM Count

获取单个enclosure ,e32详细信息

[root@localhost storcli]# ./storcli64 /c0/e32 show all

Controller = 0

Status = Success

Description = None

Enclosure /c0/e32 :

==================

Information :

===========

Device ID = 32

Position = 1

Connector Name = Unavailable

Enclosure Type = SES

Status = OK

FRU Part Number = N/A

Enclosure Serial Number = N/A

ESM Serial Number = N/A

Enclosure Zoning Mode = N/A

Partner Device ID = 65535

Inquiry Data :

============

Vendor Identification = DP

Product Identification = BP12G+EXP

Product Revision Level = 1.07

Properties :

==========

-----------------------------------------------------------------------------

EID State Slots PD PS Fans TSs Alms SIM Port# ProdID VendorSpecific

-----------------------------------------------------------------------------

32 OK 26 14 0 0 0 0 0 Unavailable BP12G+EXP

-----------------------------------------------------------------------------

EID-Enclosure Device ID |PD-Physical drive count |PS-Power Supply count|

TSs-Temperature sensor count |Alms-Alarm count |SIM-SIM Count

5、显示物理磁盘信息

语法：storcli64 /cx/eall/sall show　　显示所有物理磁盘信息

[root@localhost storcli]# ./storcli64 /c0/e32/sall show 【显示e32上的所有物理硬盘】

[root@localhost storcli]# ./storcli64 /c0/eall/sall show【显示所有enclosure下的所有物理硬盘】

Controller = 0

Status = Success

Description = Show Drive Information Succeeded.

Drive Information :

=================

-------------------------------------------------------------------------

EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp

-------------------------------------------------------------------------

32:0 0 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:1 1 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:2 2 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:3 3 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:4 4 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:5 5 Onln 1 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:6 6 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:7 7 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:8 8 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:9 9 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:10 10 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:11 11 Onln 2 837.75 GB SAS HDD N N 512B WD9001BKHG U

32:24 24 Onln 0 278.875 GB SAS HDD N N 512B ST9300603SS U

32:25 25 Onln 0 278.875 GB SAS HDD N N 512B ST9300605SS U

-------------------------------------------------------------------------

EID-Enclosure Device ID|Slt-Slot No.|DID-Device ID|DG-DriveGroup

DHS-Dedicated Hot Spare|UGood-Unconfigured Good|GHS-Global Hotspare【表示有热备盘，DHS专有热备，GHS全局热备】

UBad-Unconfigured Bad|Onln-Online|Offln-Offline|Intf-Interface

Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info

从上面信息，可以看出：

只有一个控制器，id 为 0
EID，Enclosure Device ID ：32
Slot Number，能看到 0,1,2,3,4,5,6,7,8,9,10,11,24,25
DG：disk group，0,1,2
size：容量，磁盘容量
intf：接口，SAS
Med：介质，ssd 或 hdd

6、查看raid组详细信息

查看系统里面有几个raid组：

[root@localhost storcli]# ./storcli64 /c0/vall show 【查看c0控制下的所有RAID信息】

Controller = 0

Status = Success

Description = None

Virtual Drives :

==============

---------------------------------------------------------------

DG/VD TYPE State Access Consist Cache Cac sCC Size Name

---------------------------------------------------------------

0/0 RAID1 Optl RW Yes RaWBD R OFF 278.875 GB

1/1 RAID5 Optl RW Yes RaWBD R OFF 4.089 TB

2/2 RAID5 Optl RW Yes RaWBD R OFF 4.089 TB 【显示系统有三个raid组】

---------------------------------------------------------------

Cac=CacheCade|Rec=Recovery|OfLn=OffLine|Pdgd=Partially Degraded|dgrd=Degraded

Ra=Read Ahead Adaptive|R=Read Ahead Always|NR=No Read Ahead|WB=WriteBack|

AWB=Always WriteBack|WT=WriteThrough|C=Cached IO|D=Direct IO|sCC=Scheduled

Check Consistency

查看V0 （虚拟磁盘0） raid的详细信息

[root@localhost storcli]# ./storcli64 /c0/v0 show all

Controller = 0

Status = Success

Description = None

/c0/v0 :

======

---------------------------------------------------------------

DG/VD TYPE State Access Consist Cache Cac sCC Size Name

---------------------------------------------------------------

0/0 RAID1 Optl RW Yes RaWBD R OFF 278.875 GB 【V0为RAID1】

---------------------------------------------------------------

Cac=CacheCade|Rec=Recovery|OfLn=OffLine|Pdgd=Partially Degraded|dgrd=Degraded

Ra=Read Ahead Adaptive|R=Read Ahead Always|NR=No Read Ahead|WB=WriteBack|

AWB=Always WriteBack|WT=WriteThrough|C=Cached IO|D=Direct IO|sCC=Scheduled

Check Consistency

PDs for VD 0 :

============

-------------------------------------------------------------------------

EID:Slt DID State DG Size Intf Med SED PI SeSz Model Sp

-------------------------------------------------------------------------

32:24 24 Onln 0 278.875 GB SAS HDD N N 512B ST9300603SS U

32:25 25 Onln 0 278.875 GB SAS HDD N N 512B ST9300605SS U 【可以看到24号和25号盘组成了raid1】

-------------------------------------------------------------------------

EID-Enclosure Device ID|Slt-Slot No.|DID-Device ID|DG-DriveGroup

DHS-Dedicated Hot Spare|UGood-Unconfigured Good|GHS-Global Hotspare

UBad-Unconfigured Bad|Onln-Online|Offln-Offline|Intf-Interface

Med-Media Type|SED-Self Encryptive Drive|PI-Protection Info

VD0 Properties :

==============

Strip Size = 64 KB

Span Depth = 1

Number of Drives Per Span = 2

Disk Cache Policy = Disk's Default

Encryption = None

Data Protection = None

Active Operations = None

Exposed to OS = Yes

Creation Date = 05-09-2012

Creation Time = 01:38:23 PM

Emulation type = None

7、磁盘状态设置

storcli64 /cx/ex/sx set good/offline/online/missing　　设置某块磁盘的状态

good　　　　　　　空闲

online/offline　　成员盘上下线

missing　　　　设置磁盘为missing状态

磁盘热备

storcli64 /cx/ex/sx add hotsparedrive dgs=x　　设置模块磁盘为diskgroup x 的热备盘

storcli64 /cx/ex/sx add hotsparedrive 设置全局热备

storcli64 /cx/ex/sx delete hotsparedrive

磁盘rebuild

storcli64 /cx/ex/sx show rebuild　　查看rebild

storcli64 /cx/ex/sx start rebuild

storcli64 /cx/ex/sx stop rebuild

磁盘点灯

storcli64 /cx/ex/sx start locate

storcli64 /cx/ex/sx stop locate

磁盘擦除

快速擦除：

storcli64 /cx/ex/sx set good

storcli64 /cx/fall del|delete [securityKey = xxx]

完全擦除：

storcli /cx[/ex]/sx secureerase [force]

storcli /cx[/ex]/sx stop erase

storcli /cx[/ex]/sx show erase

8、获取rebuild速率

[root@localhost storcli]# ./storcli64 /c0 show rebuildrate

Controller = 0

Status = Success

Description = None

Controller Properties :

=====================

------------------

Ctrl_Prop Value

------------------

Rebuildrate 30%

------------------

storcli64 /c0 set rebuildrate=60　　设置rebuild速率

9、清除缓存

清除raid卡，物理磁盘cache

storcli64 /c0 flushcache

Ceph入门到精通- storcli安装

Linux使用storcli工具查看服务器硬盘和raid组信息

公告

标签

Ceph入门到精通- storcli安装

Linux使用storcli工具查看服务器硬盘和raid组信息

相关问题

公告

标签