Nginx+keepalived+tomcat实现tomcat高可用性负载均衡.docx

Nginx+keepalived+tomcat实现tomcat高可用性负载均衡试验环境： CentOS5.4、pcre-8.12、nginx-upstream-jvm-route-0.1、nginx-1.0.10、apache-tomcat-7.0.23 、keepalived-1.1.17.tar.gz、jdk-7u2-linux-x64.tar.gz主nginx服务器地址：00 辅nginx服务器地址：01 tomcat1: 02 tomcat2: 03VIP: 88拓扑如下：1.分别在00和01上面安装nginxtar zxf pcre-8.12.tar.gz cd pcre-8.12 ./configure make;make install下载下面的插件安装，否则nginx无法识别tomcat中jvmRoute，从而无法达到session复制的效果。wget /LinuxSoft/nginx-upstream-jvm-route-0.1.tar.gz tar xzf nginx-upstream-jvm-route-0.1.tar.gz tar xzf nginx-1.0.10.tar.gz cd nginx-1.0.10 patch -p0 ./nginx_upstream_jvm_route/jvm_route.patch ./configure -prefix=/usr/local/nginx -with-http_stub_status_module -with-pcre=/root/pcre-8.12 -add-module=./nginx_upstream_jvm_route/ #-with-pcre=指向的是pcre的源码包 make;make install2.配置nginxvim /usr/local/nginx/conf/nginx.confuser www www;worker_processes 4;error_log /home/wwwlogs/nginx_error.log crit;pid /usr/local/nginx/logs/nginx.pid;#Specifies the value for maximum file descriptors that can be opened by this process.worker_rlimit_nofile 51200;events use epoll; worker_connections 51200; http upstream backend server 02:8080 srun_id=tomcat1; server 03:8080 srun_id=tomcat2; jvm_route $cookie_JSESSIONID|sessionid reverse; include mime.types;default_type application/octet-stream;server_names_hash_bucket_size 128;client_header_buffer_size 32k;large_client_header_buffers 4 32k;client_max_body_size 50m;sendfile on;tcp_nopush on;keepalive_timeout 60;tcp_nodelay on;fastcgi_connect_timeout 300;fastcgi_send_timeout 300;fastcgi_read_timeout 300;fastcgi_buffer_size 64k;fastcgi_buffers 4 64k;fastcgi_busy_buffers_size 128k;fastcgi_temp_file_write_size 256k;gzip on;gzip_min_length 1k;gzip_buffers 4 16k;charset UTF-8gzip_http_version 1.0;gzip_comp_level 2;gzip_types text/plain application/x-javascript text/css application/xml;gzip_vary on;#limit_zone crawler $binary_remote_addr 10m;server listen 80; server_name ; index index.jsp index.htm index.html; root /home/wwwroot/;location / proxy_pass http:/backend; proxy_redirect off; proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for; proxy_set_header X-Real-IP $remote_addr; proxy_set_header Host $http_host; location .*.(gif|jpg|jpeg|png|bmp|swf)$ expires 30d; location .*.(js|css)?$ expires 1h; location /Nginxstatus stub_status on; access_log off; log_format access $remote_addr - $remote_user $time_local $request $status $body_bytes_sent $http_referer $http_user_agent $http_x_forwarded_for;access_log /home/wwwlogs/access.log access; include vhost/*.conf; 3. 分别在两台nginx服务器上安装keepalivedtar zxvf keepalived-1.1.17.tar.gzcd keepalived-1.1.17./configure -prefix=/usr/local/keepalivedmake & make installcp /usr/local/keepalived/sbin/keepalived /usr/sbin/cp /usr/local/keepalived/etc/sysconfig/keepalived /etc/sysconfig/cp /usr/local/keepalived/etc/rc.d/init.d/keepalived /etc/init.d/mkdir /etc/keepalivedcd /etc/keepalived/主keepalived配置vim keepalived.confvrrp_script chk_http_port script /opt/nginx_pid.sh interval 2 weight 2vrrp_instance VI_1 state MASTER interface eth0 virtual_router_id 51 mcast_src_ip 00 priority 150 authentication auth_type PASS auth_pass track_script chk_http_port virtual_ipaddress 88 辅keepalived 配置vrrp_script chk_http_port script /opt/nginx_pid.sh interval 2 weight 2vrrp_instance VI_1 state BACKUP interface eth0 virtual_router_id 51 mcast_src_ip 01 priority 100 authentication auth_type PASS auth_pass track_script chk_http_port virtual_ipaddress 88 启动keepalived，检查虚拟IP是否邦定，在主keepalivedrootxenvps0 # /etc/init.d/keepalived start启动 keepalived： 确定rootxenvps0 # ip a1: lo: mtu 16436 qdisc noqueue link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet /8 scope host lo2: eth0: mtu 1500 qdisc pfifo_fast qlen 1000 link/ether 00:16:36:68:a4:fc brd ff:ff:ff:ff:ff:ff inet 00/24 brd 55 scope global eth0inet 88/32 scope global eth0在eth0上面我们已经看到虚拟IP88已经邦定成功4.安装tomcat 1）安装tomcat_1 tar zxvf apache-tomcat-7.0.23.tar.gz mv apache-tomcat-7.0.23 /usr/local/tomcat 2）安装tomcat_2，步骤同1）5.分别在tomcat服务器安装jdktar zxvf jdk-7u2-linux-x64.tar.gzmv jdk1.7.0_02 /usr/local/jdk1.7.0_02cat /etc/profile EOFexport JAVA_HOME=/usr/local/jdk1.7.0_02export CLASSPATH=$CLASSPATH:$JAVA_HOME/lib:$JAVA_HOME/jre/lib export PATH=$JAVA_HOME/bin:$JAVA_HOME/jre/bin:$PATH:$HOMR/binEOF;source /etc/profile /使环境变量立即生效5.tomcat集群配置 tomcat1配置： 修改conf/server.xml配置文件 在添加下面这句：tomcat2配置： 修改conf/server.xml配置文件 在添加下面这句：6.sess