双网卡下安装配置OpenstackFolsomQu

1、双网卡下安装配置Openstack Folsom + Quantum + Openvswitch过程OpenstackFolsom发布好久了，但由于新的组件Quantum的加入，以及知识的跨度，比如同时需要系统管理及网络工程方面的知识，所以Folsom的安装还是挺费事的。经过几天的测试，参考各种文档，终于完成了Folsom基于双网卡的安装，总结至此。1.需求说明=:节点名称:NICs:控制节点:eth0(1),eth1(1):网络节点:eth0(2),eth2():计算节点:eth0(3)

2、*备注1:*本文为双网卡安装Folsom设计,根据官方说明，网络节点最好采用三块网卡控制节点可以和计算节点合二为一.*备注2：*本文安装指南环境为实现Folsom功能评估，力求简单方便，安全性差，不可用于生产环境。*备注3:*本文不适用于虚拟机环境.请使用物理计算机安装.2.控制节点=2.1.准备系统-*安装系统注意事项:-ubuntu-为Cinder服务预留独立分区例如:/dev/sda5-提前定义好各服务器主机名及，尽量别改，一定要改，请修改/etc/hosts中的对应关系*以下所有命令均在root权限下完成，所以在装好ubuntu后，请切换到root:sudopasswdsu*更新系统(

3、依据笔者经验，安装完Folsom环境后最好别再使用dist-upgrade,以免产生些许小问题，如虚拟机获得不了ip等.):apt-getupdateapt-getupgradeapt-getdist-upgrade*因为要更新和下载的软件比较多，可以在空闲时间一次更新系统并提前安装所需要软件，以后只需要配置就行了:也可以使用squid代理，这样，其它几台机器不用连外网更新软件了apt-getupdate&&apt-getdist-upgrade-y&&apt-getupdate-y&&apt-getdist-upgrade-y&&

4、;apt-getinstall-yrabbitmq-serverntpvlanbridge-utilskeystonecurlopensslglancequantum-serverquantum-plugin-openvswitchnova-apinova-certnovncnova-consoleauthnova-schedulernova-novncproxycinder-apicinder-schedulercinder-volumeiscsitargetopen-iscsiiscsitarget-dkmsopenstack-dashboardmemcachedpython-mysqld

5、bmysql-server2.2.配置网卡-*主控应该有一个外网网卡:#访问Openstackautoeth1ifaceeth1inetstatic#管理网络和虚拟机网络合二为一autoeth0ifaceeth0inetstatic*重启网络服务:servicenetworkingrestart.MySQL&RabbitMQ-*安装MySQL和RabbitMQ:apt-getinstallmysql-serverpython-mysqldbrabbitmq-server*配置Mysql监听所有地址:servicemysqlrestart*为了简化安装，以后所有连接mysql服务均使用r

6、oot:password登录,将root权限更改为所有主机可以访问(默认只能本机访问)mysql-uroot-ppasswordusemysql;updateusersethost='%'whereuser='root'andhost='localhost'flushprivileges;*创建所有必须的数据库:createdatabasekeystone;createdatabasenova;createdatabaseglance;createdatabasecinder;createdatabasequantum;2.4.节点时间同步-*安

7、装时间服务器,其它节点时间同此服务器同步:apt-getinstallntpservicentprestart.Others-*安装其它服务:apt-getinstallvlanbridge-utils*允许IP转发:net.ipv4.conf.all.rp_filter=0net.ipv4.conf.default.rp_filter=0sysctlnet.ipv4.ip_forward=1#检查一下sysctl-p.Keystone-*安装组件:apt-getinstallkeystone*编辑数据库连接:*重启keystone并初始化数据库:servicekeystonerestartk

8、eystone-managedb_sync*使用自动化脚本<执行一次，否则会创建多个service*创建/root/novarc文件，写入以下内容:exportOS_TENANT_NAME=adminexportOS_TENANT_ID=c7fb80d964a24ab1bc0fd370696c804eexportOS_USERNAME=adminexportOS_PASSWORD=passwordexportOS_AUTH_URL=":35357/v2.0"exportOS_REGION_NAME=RegionOneexportSERVI

9、CE_TOKEN=ADMINexportSERVICE_ENDPOINT=":35357/v2.0"各项值请根据实际情况替换keystonetenant-list将获取的tenant_id替换到novarcsource/root/novarcecho"source/root/novarc">>/.bashrc.Glance-*安装组件apt-getinstallglance*分别修改和/etc/glance/glance-registry-paste.ini:filter:authtokenpaste.filte

10、r_factory=keystone.middleware.auth_token:filter_factoryauth_port=35357auth_protocol=httpadmin_tenant_name=adminadmin_user=adminadmin_password=password*分别修改和/etc/glance/glance-registry.conf:paste_deployflavor=keystone*重启glance服务并同步glance数据库:serviceglance-apirestart;serviceglance-registryrestartglance

11、-managedb_sync*测试glance服务，不输出任何结果代表成功:glanceindex*上传个镜像:glanceimage-create-namemyFirstImage-is-publictrue-container-formatbare*再查看一下:glanceimage-list.Quantum-*安装组件:apt-getinstallquantum-serverquantum-plugin-openvswitch*修改/etc/quantum/plugins/openvswitch/ovs_quantum_plugin.ini,移动后文件最后，有模板:DATABASE#Un

12、dertheOVSsectionOVStenant_network_type=gretunnel_id_ranges=1:1000enable_tunneling=True*修改/etc/quantum/api-paste.ini:filter:authtokenpaste.filter_factory=keystone.middleware.auth_token:filter_factoryauth_port=35357auth_protocol=httpadmin_tenant_name=adminadmin_user=adminadmin_password=password*重启quan

13、tumserver:servicequantum-serverrestart.Nova-*安装组件:apt-getinstall-ynova-apinova-certnovncnova-consoleauthnova-schedulernova-novncproxy*修改/etc/nova/api-paste.ini:filter:authtokenpaste.filter_factory=keystone.middleware.auth_token:filter_factoryauth_port=35357auth_protocol=httpadmin_tenant_name=adminad

14、min_user=adminadmin_password=passwordsigning_dirname=/tmp/keystone-signing-nova:DEFAULTlogdir=/var/log/novastate_path=/var/lib/novalock_path=/run/lock/novaverbose=Trueec2_url=1:8773/services/Cloud#Authuse_deprecated_auth=falseauth_strategy=keystone#Imagingserviceglance_api_servers=1

15、01:9292#Vncconfigurationnovnc_enabled=truenovncproxy_port=6080#Networksettingsquantum_url=1:9696quantum_auth_strategy=keystonequantum_admin_tenant_name=adminquantum_admin_username=adminquantum_admin_password=password#Compute#Cinder#osapi_volume_listen_port=5900*初始化nova数据库:n

16、ova-managedbsync*重启所有nova服务:cd/etc/init.d/;foriin$(lsnova-*);dosudoservice$irestart;done*检查nova服务，有笑脸图标，证明服务正常:nova-manageservicelistBinaryHostZoneStatusStateUpdated_Atnova-certsm1u07novaenabled:-)2013-03-1512:08:31nova-consoleauthsm1u07novaenabled:-)2013-03-1512:08:30nova-schedulersm1u07novaenabled

17、:-)2013-03-1512:08:30.Cinder-*安装组件:apt-getinstallcinder-apicinder-schedulercinder-volumeiscsitargetopen-iscsiiscsitarget-dkms*打开iscsi服务:sed-i's/false/true/g'/etc/default/iscsitargetserviceiscsitargetstartserviceopen-iscsistart*修改认证信息:filter:authtokenpaste.filter_factory=keystone.middleware.a

18、uth_token:filter_factoryservice_protocol=httpservice_port=5000auth_port=35357auth_protocol=httpadmin_tenant_name=adminadmin_user=passwordadmin_password=password*修改the/etc/cinder/cinder.confto:DEFAULTiscsi_helper=ietadmvolume_name_template=volume-%svolume_group=cinder-volumesverbose=Trueauth_strategy

19、=keystone*初始化cinder数据库:cinder-managedbsync*创建cinder使用的物理卷及卷组:pvcreate/dev/sda5vgcreatecinder-volumes/dev/sda5servicecinder-volumerestartservicecinder-apirestart2.11.控制面板-*安装组件:apt-getinstallopenstack-dashboardmemcached*dashboard依赖apache和memcache:serviceapache2restart;servicememcachedrestart现在可以访问Das

20、hboard了*1/horizon*用户名密码*admin:password*.3.网络节点=3.1.准备系统-*安装ubuntu12.01:apt-getupdateapt-getupgradeapt-getdist-upgrade快速：apt-getupdate&&apt-getdist-upgrade-y&&apt-getinstall-yntpvlanbridge-utilsopenvswitch-switchopenvswitch-datapath-dkmsquantum-plugin-openvswitch-ag

21、entquantum-dhcp-agentquantum-l3-agent*安装配置基本服务ntp,vlan,bridge-utils:apt-getinstallntpvlanbridge-utilsservicentprestart*允许ip转发:net.ipv4.conf.all.rp_filter=0net.ipv4.conf.default.rp_filter=0sysctlnet.ipv4.ip_forward=13.2.配置网卡-*网络节点eth1网卡将做为虚拟机与互联网通讯端口，设置网卡为promiscmode:#虚拟机外网出口autoeth1ifaceeth1inetmanu

22、alupifconfig$upiplinkset$IFACEpromiscondowniplinkset$IFACEpromiscoffdownifconfig$IFACEdown#管理网络及内部通信autoeth0ifaceeth0inetstatic.OpenVSwitch-*安装虚拟交换机:apt-getinstall-yopenvswitch-switchopenvswitch-datapath-dkms*创建网桥:#br-intisusedforVMintegrationovs-vsctladd-brbr-int#br-exisusedforaccessinginternet.ovs

23、-vsctladd-brbr-exovs-vsctlbr-set-external-idbr-exbridge-idbr-exovs-vsctladd-portbr-exeth1启动br-exiplinksetbr-exup.Quantum-*安装quantum组件:apt-get-yinstallquantum-dhcp-agentquantum-l3-agentquantum-plugin-openvswitch-agent*编辑/etc/quantum/plugins/openvswitch/ovs_quantum_plugin.ini:#UnderthedatabasesectionD

24、ATABASE#UndertheOVSsectionOVStenant_network_type=gretunnel_id_ranges=1:1000integration_bridge=br-inttunnel_bridge=br-tunenable_tunneling=True*更新/etc/quantum/l3_agent.ini:auth_region=RegionOneadmin_tenant_name=adminadmin_user=adminadmin_password=passwordmetadata_port=8775use_namespaces=False*修改/etc/q

25、uantum/dhcp_agent.ini:use_namespaces=False*修改/etc/quantum/quantum.conf:*重启所有服务:servicequantum-dhcp-agentrestartservicequantum-l3-agentrestartservicequantum-plugin-openvswitch-agentrestart4.计算节点=4.1.准备系统-*更新升级:apt-getupdateapt-getupgradeapt-getdist-upgrade快速：apt-getupdate&&apt-getdist-upgrade

26、-y&&apt-getinstall-yntpvlanbridge-utilscpu-checkerkvmlibvirt-binpm-utilsopenvswitch-switchopenvswitch-datapath-dkmsquantum-plugin-openvswitch-agentnova-compute-kvm*安装ntpvlanbridge-utils:apt-getinstallntpvlanbridge-utilsservicentprestart*允许转发:net.ipv4.conf.all.rp_filter=0net.ipv4.conf.default

27、.rp_filter=0sysctlnet.ipv4.ip_forward=14.2.配置网卡-*vi/etc/network/interfaces:#管理网络和内部通讯网络autoeth0ifaceeth0inetstatic-*确认硬件支持虚拟化:apt-getinstallcpu-checkerkvm-ok*安装kvm组件:apt-getinstall-ykvmlibvirt-binpm-utils*编辑libvirt设备列表支持tun/etc/libvirt/qemu.conf:cgroup_device_acl="/dev/null","/dev/ful

28、l","/dev/zero","/dev/random","/dev/urandom","/dev/ptmx","/dev/kvm","/dev/kqemu","/dev/rtc","/dev/hpet","/dev/net/tun"*删除kvm默认网络配置:virshnet-destroydefaultvirshnet-undefinedefault*允许动态迁移:listen_tls=0listen_t

29、cp=1auth_tcp="none"envlibvirtd_opts="-d-l"vi/etc/default/libvirt-binlibvirtd_opts="-d-l"servicelibvirt-binrestart.OpenVSwitch-*安装openVSwitch:apt-getinstall-yopenvswitch-switchopenvswitch-datapath-dkms*创建网桥bridges:#br-intwillbeusedforVMintegrationovs-vsctladd-brbr-int.Qu

30、antum-*安装Quantumopenvswitchagent:apt-get-yinstallquantum-plugin-openvswitch-agent*编辑OVS配置/etc/quantum/plugins/openvswitch/ovs_quantum_plugin.ini:#UnderthedatabasesectionDATABASE#UndertheOVSsectionOVStenant_network_type=gretunnel_id_ranges=1:1000integration_bridge=br-inttunnel_bridge=br-tunenable_tun

31、neling=True*修改rabbitMQIP:*重启所有服务:servicequantum-plugin-openvswitch-agentrestart.Nova-*安装novacompute组件:apt-getinstallnova-compute-kvm*修改/etc/nova/api-paste.ini:filter:authtokenpaste.filter_factory=keystone.middleware.auth_token:filter_factoryauth_port=35357auth_protocol=httpadmin_tenant_name=adminadm

32、in_user=adminadmin_password=passwordsigning_dirname=/tmp/keystone-signing-nova*编辑/etc/nova/nova-compute.conf:DEFAULTlibvirt_type=kvmlibvirt_ovs_bridge=br-intlibvirt_vif_type=ethernetlibvirt_use_virtio_for_bridges=True*修改/etc/nova/nova.conf:DEFAULTlogdir=/var/log/novastate_path=/var/lib/novalock_path

33、=/run/lock/novaverbose=Trueec2_url=1:8773/services/Cloud#Authuse_deprecated_auth=falseauth_strategy=keystone#Imagingserviceglance_api_servers=1:9292#Vncconfigurationnovnc_enabled=truenovncproxy_port=6080#Networksettingsquantum_url=1:9696quantum_auth_strat

34、egy=keystonequantum_admin_tenant_name=adminquantum_admin_username=adminquantum_admin_password=password#Compute#Cinder#osapi_volume_listen_port=5900*Restartnova-*services:cd/etc/init.d/;foriin$(lsnova-*);dosudoservice$irestart;done*Checkforthesmilingfacesonnova-*servicestoconfirmyourinstallation:nova-manageservicelist5.创建虚拟机=*使用<