HttpURLConnection, HttpClient机制分析.docx

HttpURLConnection, HttpClient机制分析 HttpClienthttpClient.execute(Method) 直接发送请求并读取响应，而 method.getResponseBody 其实只是从response缓存中进行读取HttpClient委托HttpConnectionManager管理连接，委托HttpMethodDirector执行方法，其本身是无状态线程安全的。connectManager分为：SimpleHttpConnectorManager为默认选项。会复用连接，但是如果host改变了，则会打开新的链接。MultiThreadedHttpConnectionManager 为每个host作了一个连接池，放在map中，keyhostConfig value = connectPool，每次根据host从池子中获取连接，并复用之DummyConnectionManager 则不管host，一律重新建立连接每次new HttpClient()会新建socket，可以通过 commons-pool，自行实现连接池：javaview plaincopy 1. publicclassPoolableHttpClientFactoryimplementsPoolableObjectFactory2. 3. privateinttimeout;4. publicPoolableHttpClientFactory(inttimeout)5. this.timeout=timeout;6. 7. 8. publicObjectmakeObject()throwsException9. HttpClienthttpClient=newHttpClient();10. HttpConnectionManagerParamsconfigParams=httpClient.getHttpConnectionManager().getParams();11. configParams.setConnectionTimeout(timeout);12. configParams.setSoTimeout(timeout);13. httpClient.getParams().setConnectionManagerTimeout(timeout);14. returnhttpClient;15. 16. 17. publicvoiddestroyObject(Objectobj)throwsException18. 19. 20. publicbooleanvalidateObject(Objectobj)21. returntrue;22. 23. 24. publicvoidactivateObject(Objectobj)throwsException25. 26. 27. publicvoidpassivateObject(Objectobj)throwsException28. 29. 30. javaview plaincopy 1. ExecutorServices=Executors.newFixedThreadPool(2);2. 3. finalObjectPoolpool=newGenericObjectPool(4. newPoolableHttpClientFactory(2000),5. 10,6. GenericObjectPool.WHEN_EXHAUSTED_FAIL,7. 3000,2,1,false,false,60000,10,60000,false);8. 9. for(inti=0;i2;+i)10. s.execute(newRunnable()11. publicvoidrun()12. while(true)13. try14. Thread.sleep(newRandom().nextInt(500);15. 16. PostMethodmethod=newPostMethod(:8080/index);17. HttpClienthc=(HttpClient)pool.borrowObject();18. hc.executeMethod(method);19. Stringresp=method.getResponseBodyAsString();20. if(resp.indexOf(jack)=-1)System.out.println(resp);21. 22. method.releaseConnection();23. pool.returnObject(hc);24. catch(Exceptione)25. e.printStackTrace();26. 27. 28. 29. );TIP =HttpMethod.setParams(HttpMethodParams)指的是“超时时间”这样的连接属性对于请求参数，PostMethod.addParameter(k,v) 而GetMethod则需要自行组装url了，记得作 URLEncoder.encode()HttpURLConnection1、new URL(http:/xx.xx).openConnection(); 会打开 tocol.http.HttpURLConnection, 其conn.connect()函数会从.www.http.HttpClient内部的静态连接缓冲池中获取HttpClient连接， 对应到一个Socket连接。静态连接池是一个HashTable, key = URL, value = HttpClient2、HttpURLConnection.getInputStream()会返回 tocol.http.HttpURLConnection$HttpInputStream，其 connection.getInputStream.close()函数并不关闭Socket，而是将连接还给连接池。HttpClienthttpClient.execute(Method) 直接发送请求并读取响应，而 method.getResponseBody 其实只是从response缓存中进行读取HttpClient委托HttpConnectionManager管理连接，委托HttpMethodDirector执行方法，其本身是无状态线程安全的。connectManager分为：SimpleHttpConnectorManager为默认选项。会复用连接，但是如果host改变了，则会打开新的链接。MultiThreadedHttpConnectionManager 为每个host作了一个连接池，放在map中，keyhostConfig value = connectPool，每次根据host从池子中获取连接，并复用之DummyConnectionManager 则不管host，一律重新建立连接每次new HttpClient()会新建socket，可以通过 commons-pool，自行实现连接池：javaview plaincopy 1. publicclassPoolableHttpClientFactoryimplementsPoolableObjectFactory2. 3. privateinttimeout;4. publicPoolableHttpClientFactory(inttimeout)5. this.timeout=timeout;6. 7. 8. publicObjectmakeObject()throwsException9. HttpClienthttpClient=newHttpClient();10. HttpConnectionManagerParamsconfigParams=httpClient.getHttpConnectionManager().getParams();11. configParams.setConnectionTimeout(timeout);12. configParams.setSoTimeout(timeout);13. httpClient.getParams().setConnectionManagerTimeout(timeout);14. returnhttpClient;15. 16. 17. publicvoiddestroyObject(Objectobj)throwsException18. 19. 20. publicbooleanvalidateObject(Objectobj)21. returntrue;22. 23. 24. publicvoidactivateObject(Objectobj)throwsException25. 26. 27. publicvoidpassivateObject(Objectobj)throwsException28. 29. 30. javaview plaincopy 1. ExecutorServices=Executors.newFixedThreadPool(2);2. 3. finalObjectPoolpool=newGenericObjectPool(4. newPoolableHttpClientFactory(2000),5. 10,6. GenericObjectPool.WHEN_EXHAUSTED_FAIL,7. 3000,2,1,false,false,60000,10,60000,false);8. 9. for(inti=0;i2;+i)10. s.execute(newRunnable()11. publicvoidrun()12. while(true)13. try14. Thread.sleep(newRandom().nextInt(500);15. 16. PostMethodmethod=newPostMethod(:8080/index);17. HttpClienthc=(HttpClient)pool.borrowObject();18. hc.executeMethod(method);19. Stringresp=method.getResponseBodyAsString();20. if(resp.indexOf(jack)=-1)System.out.println(resp);21. 22. method.releaseConnection();23. pool.returnObject(hc);24. catch(Exceptione)25. e.printStackTrace();26. 27. 28. 29. );TIP =HttpMethod.setParams(HttpMethodParams)指的是“超时时间”这样的连接属性对于请求参数，PostMethod.addParameter(k,v) 而GetMethod则需要自行组装url了，记得作 URLEncoder.encode()HttpURLConnection1、new URL(http:/xx.xx).openConnection(); 会打开 tocol.http.HttpURLConnection, 其conn.connect()函数会从.www.http.HttpClient内部的静态连接缓冲池中获取HttpClient连接， 对应到一个Socket连接。静态连接池是一个HashTable, key = URL, value = HttpClient2、HttpURLConnection.getInputStream()会返回 tocol.http.HttpURLConnection$HttpInputStream，其 connection.getInputStream.close()函数并不关闭Socket，而是将连接还给连接池。HttpClient httpClient.execute(Method) 直接发送请求并读取响应，而 method.getResponseBody 其实只是从response缓存中进行读取HttpClient委托HttpConnectionManager管理连接，委托HttpMethodDirector执行方法，其本身是无状态线程安全的。connectManager分为：SimpleHttpConnectorManager为默认选项。会复用连接，但是如果host改变了，则会打开新的链接。MultiThreadedHttpConnectionManager 为每个host作了一个连接池，放在map中，keyhostConfig value = connectPool，每次根据host从池子中获取连接，并复用之DummyConnectionManager 则不管host，一律重新建立连接每次new HttpClient()会新建socket，可以通过 commons-pool，自行实现连接池：javaview plaincopy 1. publicclassPoolableHttpClientFactoryimplementsPoolableObjectFactory2. 3. privateinttimeout;4. publicPoolableHttpClientFactory(inttimeout)5. this.timeout=timeout;6. 7. 8. publicObjectmakeObject()throwsException9. HttpClienthttpClient=newHttpClient();10. HttpConnectionManagerParamsconfigParams=httpClient.getHttpConnectionManager().getParams();11. configParams.setConnectionTimeout(timeout);12. configParams.setSoTimeout(timeout);13. httpClient.getParams().setConnectionManagerTimeout(timeout);14. returnhttpClient;15. 16. 17. publicvoiddestroyObject(Objectobj)throwsException18. 19. 20. publicbooleanvalidateObject(Objectobj)21. returntrue;22. 23. 24. publicvoidactivateObject(Objectobj)throwsException25. 26. 27. publicvoidpassivateObject(Objectobj)throwsException28. 29. 30. javaview plaincopy 1. ExecutorServices=Executors.newFixedThreadPool(2);2. 3. finalObjectPoolpool=newGenericObjectPool(4. newPoolableHttpClientFactory(2000),5. 10,6. GenericObjectPool.WHEN_EXHAUSTED_FAIL,7. 3000,2,1,false,false,60000,10,60000,false);8. 9. for(inti=0;i2;+i)10. s.execute(newRunnable()11. publicvoidrun()12. while(true)13. try14. Thread.sleep(newRandom().nextInt(500);15. 16. PostMethodmethod=newPostMethod(:8080/index);17. HttpClienthc=(HttpClient)pool.borrowObject();18. hc.executeMethod(method);19. Stringresp=method.getResponseBodyAsString();20. if(resp.indexOf(jack)=-1)System.out.println(resp);21. 22. method.releaseConnection();23. pool.returnObject(hc);24. catch(Exceptione)25. e.printStackTrace();26. 27. 28. 29. );TIP =HttpMethod.setParams(HttpMethodParams)指的是“超时时间”这样的连接属性对于请求参数，PostMethod.addParameter(k,v) 而GetMethod则需要自行组装url了，记得作 URLEncoder.encode()HttpURLConnection1、new URL(http:/xx.xx).openConnection(); 会打开 tocol.http.HttpURLConnection, 其conn.connect()函数会从.www.http.HttpClient内部的静态连接缓冲池中获取HttpClient连接， 对应到一个Socket连接。静态连接池是一个HashTable, key = URL, value = HttpClient2、HttpURLConnection.getInputStream()会返回 tocol.http.HttpURLConnection$HttpInputStream，其 connection.getInputStream.close()函数并不关闭Socket，而是将连接还给连接池。HttpClienthttpClient.execute(Method) 直接发送请求并读取响应，而 method.getResponseBody 其实只是从response缓存中进行读取HttpClient委托HttpConnectionManager管理连接，委托HttpMethodDirector执行方法，其本身是无状态线程安全的。connectManager分为：SimpleHttpConnectorManager为默认选项。会复用连接，但是如果host改变了，则会打开新的链接。MultiThreadedHttpConnectionManager 为每个host作了一个连接池，放在map中，keyhostConfig value = connectPool，每次根据host从池子中获取连接，并复用之DummyConnectionManager 则不管host，一律重新建立连接每次new HttpClient()会新建socket，可以通过 commons-pool，自行实现连接池：javaview plaincopy 1. publicclassPoolableHttpClientFactoryimplementsPoolableObjectFactory2. 3. privateinttimeout;4. publicPoolableHttpClientFactory(inttimeout)5. this.timeout=timeout;6. 7. 8. publicObjectmakeObject()throwsException9. HttpClienthttpClient=newHttpClient();10. HttpConnectionManagerParamsconfigParams=httpClient.getHttpConnectionManager().getParams();11. configParams.setConnectionTimeout(timeout);12. configParams.setSoTimeout(timeout);13. httpClient.getParams().setConnectionManagerTimeout(timeout);14. returnhttpClient;15. 16. 17. publicvoiddestroyObject(Objectobj)throwsException18. 19. 20. publicbooleanvalidateObject(Objectobj)21. returntrue;22. 23. 24. publicvoidactivateObject(Objectobj)throwsException25. 26. 27. publicvoidpassivateObject(Objectobj)throwsException28. 29. 30. javaview plaincopy 1. ExecutorServices=Executors.newFixedThreadPool(2);2. 3. finalObjectPoolpool=newGenericObjectPool(4. newPoolableHttpClientFactory(2000),5. 10,6. GenericObjectPool.WHEN_EXHAUSTED_FAIL,7. 3000,2,1,false,false,60000,10,60000,false);8. 9. for(inti=0;i2;+i)10. s.execute(newRunnable()11. publicvoidrun()12. while(true)13. try14. Thread.sleep(newRandom().nextInt(500);15. 16. PostMethodmethod=newPostMethod(:8080/index);17. HttpClienthc=(HttpClient)pool.borrowObject();18. hc.executeMethod(method);19. Stringresp=method.getResponseBodyAsString();20. if(resp.indexOf(jack)=-1)System.out.println(resp);21. 22. method.releaseConnection();23. pool.returnObject(hc);24. catch(Exceptione)25. e.printStackTrace();26. 27. 28. 29. );TIP =HttpMethod.setParams(HttpMethodParams)指的是“超时时间”这样的连接属性对于请求参数，PostMethod.addParameter(k,v) 而GetMethod则需要自行组装url了，记得作 URLEncoder.encode()HttpURLConnection1、new URL(http:/xx.xx).openConnection(); 会打开 tocol.http.HttpURLConnection, 其conn.connect()函数会从.www.http.HttpClient内部的静态连接缓冲池中获取HttpClient连接， 对应到一个Socket连接。静态连接池是一个HashTable, key = URL, value = HttpClient2、HttpURLConnection.getInputStream()会返回 tocol.http.HttpURLConnection$HttpInputStream，其 connection.getInputStream.close()函数并不关闭Socket，而是将连接还给连接池。HttpClient httpClient.execute(Method) 直接发送请求并读取响应，而 method.getResponseBody 其实只是从response缓存中进行读取HttpClient委托HttpConnectionManager管理连接，委托HttpMethodDirector执行方法，其本身是无状态线程安全的。connectManager分为：SimpleHttpConnectorManager为默认选项。会复用连接，但是如果host改变了，则会打开新的链接。MultiThreadedHttpConnectionManager 为每个host作了一个连接池，放在map中，keyhostConfig value = connectPool，每次根据host从池子中获取连接，并复用之DummyConnectionManager 则不管host，一律重新建立连接每次new HttpClient()会新建socket，可以通过 commons-pool，自行实现连接池：javaview plaincopy 1. publicclassPoolableHttpClientFactoryimplementsPoolableObjectFactory2. 3. privateinttimeout;4. publicPoolableHttpClientFactory(inttimeout)5. this.timeout=timeout;6. 7. 8. publicObjectmakeObject()throwsException9. HttpClienthttpClient=newHttpClient();10. HttpConnectionManagerParamsconfigParams=httpClient.getHttpConnectionManager().getParams();11. configParams.setConnectionTimeout(timeout);12. configParams.setSoTimeout(timeout);13. httpClient.getParams().setConnectionManagerTimeout(timeout);14. returnhttpClient;15. 16. 17. publicvoiddestroyObject(Objectobj)throwsException18. 19. 20. publicbooleanvalidateObject(Objectobj)21. returntrue;22. 23. 24. publicvoidactivateObject(Objectobj)throwsException25. 26. 27. publicvoidpassivateObject(Objectobj)throwsException28. 29. 30. javaview plaincopy 1. ExecutorServices=Executors.newFixedThreadPool(2);2. 3. finalObjectPoolpool=newGenericObjectPool(4. newPoolableHttpClientFactory(2000),5. 10,6. GenericObjectPool.WHEN_EXHAUSTED_FAIL,7. 3000,2,1,false,false,60000,10,60000,false);8. 9. for(inti=0;i2;+i)10. s.execute(newRunnable()11. publicvoidrun()12. while(true)13. try14. Thread.sleep(newRandom().nextInt(500);15. 16. PostMethodmethod=newPostMethod(:8080/index);17. HttpClienthc=(HttpClient)pool.borrowObject();18. hc.executeMethod(method);19. Stringresp=method.getResponseBodyAsString();20. if(resp.indexOf(jack)=-1)System.out.println(resp);21. 22. method.releaseConnection();23. pool.returnObject(hc);24. catch(Exceptione)25. e.printStackTrace();26. 27. 28. 29. );TIP =HttpMethod.setParams(HttpMethodParams)指的是“超时时间”这样的连接属性对于请求参数，PostMethod.addParameter(k,v) 而GetMethod则需要自行组装url了，记得作 URLEncoder.encode()HttpURLConnection1、new URL(http:/xx.xx).openConnection(); 会打开 tocol.http.HttpURLConnection, 其conn.connect()函数会从.www.http.HttpClient内部的静态连接缓冲池中获取HttpClient连接， 对应到一个Socket连接。静态连接池是一个HashTable, key = URL, value = HttpClient2、HttpURLConnection.getInputStream()会返回 tocol.http.HttpURLConnection$HttpInputStream，其 connection.getInputStream.close()函数并不关闭Socket，而是将连接还给连接池。HttpClienthttpClient.execute(Method) 直接发送请求并读取响应，而 method.getResponseBody 其实只是从response缓存中进行读取HttpClient委托HttpConnectionManager管理连接，委托HttpMethodDirector执行方法，其本身是无状态线程安全的。connectManager分为：SimpleHttpConnectorManager为默认选项。会复用连接，但是如果host改变了，则会打开新的链接。MultiThreadedHttpConnectionManager 为每个host作了一个连接池，放在map中，keyhostConfig value = connectPool，每次根据host从池子中获取连接，并复用之DummyConnectionManager 则不管host，一律重新建立连接每次new HttpClient()会新建socket，可以通过 commons-pool，自行实现连接池：javaview plaincopy 1. publicclassPoolableHttpClientFactoryimplementsPoolableObjectFactory2. 3. privateinttimeout;4. publicPoolableHttpClientFactory(inttimeout)5. this.timeout=timeout;6. 7. 8. publicObjectmakeObject()throwsException9. HttpClienthttpClient=newHttpClient();10. HttpConnectionMa