CERNET主干网运行汇报.ppt

1、CERNET主干网运行汇报,李星 2001-09-25,提纲,Internet Internet2 传输网 IP 网 NIC 服务 分担通信费 国际合作 计划,Internet,Backbone Node Topology & Definitions,Edge Router,Trunk Ports,Edge Router,Interconnect Ports,Edge Ports,Core Router,Trunk Ports,Core Router,Installed ISP Port Capacity,0,500,1,000,1,500,2,000,2,500,3,000,3,500,Ap

2、r 00,Oct 00,Apr 01,Total Gbps,19 Largest Tier 1 U.S. Internet Service Providers,Source: Roberts et al., 2001,Edge Ports,Trunk Ports,Internal Ports,Internet Traffic Measurement,ISPs,19 Largest Tier 1 U.S. Internet Service Providers,0.1,1,10,100,1000,Apr 00,Oct 00,Apr 01,Total Traffic,Gbps,240 Gbps,Tr

3、affic measurement is 95% peak rate,Source: Roberts et al., 2001,Why Has The Growth Rate Increased?,Most traffic is from corporations (80% estimated) Main growth is from corporations “Last mile” has been improving rapidly (1001000 Mbps) Corporate traffic is anti-recessionary Move from private network

4、s to Internet for cost reduction Corporate Internet use hit critical mass in 2000 Now need to use the Internet for all business Inter-corporate traffic is now mainly over the Internet Intra-corporate traffic is growing in size (email documents) Personal traffic is growing but broadband deployment is

5、 slow Internationally, traffic is still at the pre-2000 growth rate of 2.8/year International corporations have not hit critical mass yet,Share of IP Traffic by ISP,U.S. ISP Traffic Fraction,0.0%,5.0%,10.0%,15.0%,1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,Largest 4 ISPs Carry 50% of Traffic,Sou

6、rce: Roberts et al., 2001,Total U.S. Internet Traffic,U.S. Internet Traffic,Voice Crossover: August 2000,4/Year,2.8/Year,Limit of same % GDP as Voice,Projected at 4/Year,Source: Roberts et al., 2001,Global Routing Table Summary2001-08-08,AP Routing Table Summary2001-08-08,BGP Table Grows,Prefix size

7、 growth,Observations,Internet traffic growth rate increased from 2.8 to 4 per year in 2000 Traffic over measured period doubled every 6 months Internet traffic continued to grow at 4 per year through Q1 2001 The main traffic source, corporate traffic, is anti-recessionary Service providers have capi

8、tal problems They can only avoid equipment purchases for a short period They must buy equipment soon to hold market share Lit fibers at the IP layer are loaded as heavily as peaking permits Assuming traffic keeps doubling every 6 months: Optical and IP switching equipment purchases must also grow at

9、 4x If IP service prices continue to fall at 2x, service provider IP revenue will grow at 2x and IP service revenue will then exceed voice revenue in about 23 years,Internet2,The Time Line,1969ARPANET 1974First paper on packet switching 1983TCP/IP implementation 1985NSFNET 1986First router 1991WWW 1

10、995US commercial Internet 1996US Next Generation Internet 1997US Internet2,TeraGrid Wide Area Network,NCSA/UIUC,ANL,UIC,Multiple Carrier Hubs,Starlight / NW Univ,Ill Inst of Tech,Univ of Chicago,Indianapolis (Abilene NOC),St Louis GigaPoP,I-WIRE,StarLight International Optical Peering Point (see ),L

11、os Angeles,San Diego,DTF Backplane,Abilene,Chicago,Indianapolis,St. Louis,Urbana,OC-48 (2.5 Gb/s, Abilene),Multiple 10 GbE (Qwest),Multiple 10 GbE (I-WIRE Dark Fiber),Solid lines in place and/or available by October 2001 Dashed I-WIRE lines planned for Summer 2002,Charlie Catlett Argonne National La

12、boratory (),Global Crossing Wavelength Deployment (06/01),Optical Interconnectivity Architecture,Wavelength Scenarios,Vancouver,Calgary,Regina,Winnipeg,Toronto,Halifax,St. Johns,Seattle,Montreal,Workstation to Workstation Wavelength,University to University Wavelength,CWDM,BCnet,RI

13、SQ,GigaPOP to GigaPOP Wavelength,Campus OBGP switch,AG is peer to peer like the Web is peer to peer Anyone can run a server (“host” virtual spaces) Anyone can visit a space on the network Global topology links all spaces All of this modulo access restrictions, just as in the web Why have servers dis

14、tinct from clients? Persistence Simplicity (for clients) Weight (of servers) Groove model? (Synchronized shared spaces),Scalable Peer to Peer Virtual Venue Services for the Access Grid,Design goals,Extreme scalability 1 Million nodes Many Million virtual spaces Strong security Open architecture Mult

15、iple implementations Reference implementations available Closed implementations possible Community saturation Trivial to create new spaces,Architecture Sketch,Venue Server,Venue Server,Venue Server,Community Server,Community Server,Node,Node,Node,Node,Architecture Sketch: Venue Server,Venue Engine (

16、Apache + PHP + ),Database,XML Interface,HTML translator,Web client,AG Client,AG Protocols,Browsing HTTP (current) HTTP + XML document (richer interface) Custom clients? Multicast tool address SDP Voyager remote control RTSP Corba Multimedia streaming RTP Shared document control JSDT (current dppt) D

17、AV Corba Custom protocols,Navigation,Research question still How to handle very large and complex spaces User interfaces may or may not look like web pages Industry toying with 3D spaces: Blaxxun Interactive,CERNET传输网,大连,北京,郑州,石家庄,武汉,合肥,南京,上海,长沙,南昌,杭州,广州,福州,成都,昆明,重庆,厦门,海口,桂林,沈阳,哈尔滨,天津,济南,南宁,深圳,natio

18、nal dark fiber,太原,青岛,Optical IP,1550,1551,1552,1553,1554,1555,1556,1557,Transmit,Receive 3R,1550,1551,1552,1553,1554,1555,1556,1557,0,Transmit,Receive 3R,20 ppm,50 ppm,PLL,50 ppm,PLL,LOOP TIMING,DWDM/SDH,D W D M,S D H,D W D M,2.5GROUTER,155MROUTER,D W D M,S D H,S D H,S D H,D W D M,DWDM/SDH,DWDM,1,9,

19、2,9,1,9,1,3,2,9,1,3,9,CERNET IP网,1994,X.25,4500,2500,2500,2500,2.4K-9.6K,10 PoPs,1995,7010,64K,7010,10M,64K-10M,10 PoPs,1997,7206,512K-2M DDN,7507,100M,64K-100M,10 PoPs,7206,2M-3.7M sat,100M,Policy based routing,Policy based routing,R1a,100M FE OSPF bw 100000,100M FE OSPF bw 100000,100M FE static,DD

20、N 1984 OSPF bw 1024,SAT 2048 OSPF bw 2048,R7a,R7a,R1c,R7a,3,4,R6 2,R8 6,1999,7206,512K-2M DDN,7507,100M,64K-100M,38 PoPs,7206,2M-3.7M sat,100M,Policy based routing,512K-2M DDN/sat,7206,100M,64K-100M,7204,100M,Tunnel proxy,2001,北京,西安,成都,广州,武汉,南京,上海,沈阳,乌鲁木齐,

21、银川,兰州,西宁,昆明,贵阳,拉萨,重庆,桂林,南宁,海口,深圳,长沙,郑州,合肥,济南,青岛,南昌,杭州,福州,厦门,大连,长春,哈尔滨,呼和浩特,天津,石家庄,太原,CERNET Backbone,1,2,3,4,5,6,7,10,8,11,9,I,D,D,D,13,14,15,16,17,18,19,20,21,22,23,24,25,26,27,29,28,30,31,32,35,34,36,37,38,39,41,40,42,37,45,44,47,46,48,49,IP Address,Routing Architecture,EBGP used to exchange route

22、s with other ISPs and customers IBGP used to carry external routing in the backbone IBGP used to carry routes for all directly attached customers OSPF used to carry internal topology, eg link status BGP is used in a non synchronized configuration POP core routers acts as route reflectors. BGP commun

23、ities used to control policy such as transit,Backbone,NIC,IPv4 distribution,Situation,6.2 IPv4 Address Space currently allocated to the RIRs RIPE has 7 x /8s (62, 193, 194, 195, 212, 213, 217) ARIN has13 x /8s ( 63, 64, 65, 66, 199, 200, 204, 205, 206, 207, 208, 209, 216) APNIC has 6 x /8s (61, 202,

24、 203, 210, 211, 218) IANA still has many address blocks reserved and available for allocation to RIRs, namely: 1, 2, 5, 7, 23, 27, 31, 36, 37, 39, 41, 42, 49, 50, 58, 59, 60, 67-95, 96-126, 197, 201, 219-223, i.e. 84 /8s. In addition to this, the former Class B space is completely free from 173/8 to

25、 191/8, i.e. 19 /8s. This makes a total of 103 /8s available for allocation to the RIRs.,Likely,ASN allocations,IPv6 distribution,IPv6 Allocations,By country 19 JP (WIDE, NTT, INFOWEB, SINET, PANANET etc.) 1 AU (CONNECT) 8 KR (KOREN, ETRI, BORANET, KIX etc.) 1 SG (NUS) 2 TW (HINET, TANET) 1 CN (CERN

26、ET) 1 HK (HKNET) 6Bone experience 15 yes 18 no,CERNET IP地址分配情况,截至2001年9月1日， 已分配IP地址总数: 14,118 * /24 已分配IP地址的学校/单位数: 1310 45个大学第二轮分配地址 2个大学第三轮分配地址,CERNET IP 地址分配统计1994/09-2001/08,CERNET 服务,CERNET 服务,CCERT服务 Cache 服务 multicast 服务 SLA监测服务,CCERT 服务,Cache 服务 (1),CERNET,Internet,Layer-4 Switch,1Gbps,100Mb

27、ps,Cache Server Pool,CERNET国家中心Cache服务系统,VIP,.,CCERT 服务 (2),国家中心,ICP/multicast,CERNET Cache Mesh结构示意图,校园网,校园网,校园网,Total Bandwidth Saving: 30-50% Response time improved greatly,CCERT 服务 (3),组播服务 (1),There is nothing special with multicast We made the network support both multicast and unicast as part

28、 of normal operations,Simple No additional network equipment is needed Compatible with existing routers Scalable Can be used on dedicated and dial networks Interoperable Standards-based and hence can interoperate with other Standards-based deployments,组播服务 (2),Campus network uses CERNET RPs Static o

29、r MBGP for Routing PIM-SM for Signaling with CERNET RPs,H1,H2,H3,CERNET IP Network (MSDP Peering between RPs),CPE,组播服务 (3),ip multicast-routing interface Ethernet 0 ip address ip pim sparse-mode interface Ethernet 1 ip address ip pim sparse-mode interface Seri

30、al 0 ip address 52 ip pim sparse-mode ip pim rp-address 24,Really simple to configure Requires one additional command to configure the rendezvous point,组播服务 (4),组播服务 (5),组播服务 (6),SSM: in /8 Global static: based on AS4538: in /24 (pass to intern

31、et) Campus (organization-local scope): in /14 (filtered at cernet pop) CERNET wide dynamic: in /16 (filtered at cernet gateway),SLA 监测服务 (1)(IP core)(better than this is more expensive than traditional TDM to produce),Forwarding outage3s Packet loss0.05% Packet reordering1% RRT

32、 US100ms RTT World380ms Jitter30ms BW/Delay quota2.5G/350ms MTU4470B,SLA 监测服务 (2),SLA 监测服务 (3),SLA 监测服务 (4),SLA 监测服务 (5),SLA 监测服务 (6),分担通信费,CERNET,user,user,user,user,user,user,user,R,R,user,snmp server,实测带宽,在接入路由器每15min读取MIB值 snmp-server community abcd RO snmpget -v 1 $ipaddr $commun ..4.1.9

33、..8.$int 每月把从CERNET主干网到用户的数据排序，去掉最大的5%个数据点后，依此决定实测带宽 参考下2页的例子,建议,鼓励校园网选择包月制 校园网对用户包月 使用cache服务 可以申请仍然按流量计费的地址 校园网对用户仍然使用国际流量计费制 使用主干网提供的国际流量数据,国际合作,DRAGONTAP,APAN-CN10M ATM link (中国电信赞助) peering with APAN Tokyo-XP unicast, multicast (unicast, multicast, double stack IPv4/IPv6, diffserv) START

34、AP10M ATM link (中国网通和TelGlobe)赞助 peering with STARTAP and eBGP multihup peering with Abilene unicast (multicast, ),STARTAP & APAN,CERNET 4538,STARTAP,Abilene,APAN,Internet,JANET,HARNET,CN NAP 4789,DRAGONTAP 9406,NSFCNET 9407,CSTNET,MR,45M/45M,10M,45M/8M,512K,2M,10M,GE,OC48/OC3,GE,OC192/OC48,10M,35M/

35、35M,APAN-CN and STARTAP Links,APAN (1),APAN () 1997年6月成立 协会性质 亚太地区学术性网络组织 主要成员 中国 、日本、韩国、澳大利亚、新加坡和马来西亚 伙伴成员 泰国和美国,APAN (2),APAN工作组 技术领域 IPv6、Network Storage and Contend Distribution、Measurement、Multimedia、Satellite Internet、Television、QoS 应用领域 Agriculture、BioInformatics、Digital Library、Earth Monitor

36、ing、Education、Global Design & Manufacturing、GRID、Medical Informatics,STAR TAP,STAR TAP（美国的科技研究互联中心） 美国国家科学基金委（National Science Foundation）一直给予经费支持的网络基础设施，用于美国国际间高速网络的长期互联，以实现高速学术研究网络的全球互联。 ,APAN/STAR TAP国际链路使用原则与申请程序,链路情况 CERNET-APAN 10M / CERNET-STAR TAP 10M 使用原则 国际间学术研究与应用合作项目 申请程序和具体办法 联系人及联系方式 C

37、ERNET网络中心 安 捷,APNG - AP Next Generation,Future Internet leaders in Asia Pacific Region Advisory Board Formal APNG Chairs and current AP-STAR Chairs/Directors Acting VCs 1-2 from each economies,First APNG Camp,2002 in Bangkok (Apricot) 30 next generations + 10 advisors two days event Country reports AP-STAR report from next generation point of view New Working Groups,计划,CERNET Statistics,CERNET GigaPoP8 Provinces connected31 CERNET PoP38 Cities connected160+300+ CERNET Members 800+ 10,000 Users8M+320M,China Intern