Usenet News系统的运作与管理课程(ppt 44页).ppt

國立交通大學計算機中心陳昌盛E-mail:.tw,UsenetNews系統的運作與管理,UsenetNews系統的運作與管理,課程大綱Outline1.UsenetNews系統簡介2.NewssystemINN的相關操作設定3.其它類似Newssystem的簡介4.新近的Newssystem的發展趨勢,UsenetNews系統簡介(1),UsenetNews相關資訊/文件RFC977,1036977:傳送協定的規範1036:Usenet文件的規範(e.g.檔頭header)FAQ(e.g,INN,Dnews,)newsgroupsnews.admin.*,主要談行政管理性質.news.software.*,主要系統技術news,臺灣本地的技術討論區,本资料来源,UsenetNews系統簡介(2),UsenetNews系統簡介(3),UsenetNews是什麼?Usenet是一個邏輯型態的網路logicalvsphysicalnetwork傳統的8大分支comp,humanity,misc,news,rec,sci,soc,talk另類分支架構,e.g.alt.*區域性架構tw,hk,can,de,fj,fr,kr,.其他臺灣BBS與NetNews系統的結合,Usenet的一般課題(1),UsenetNews程式分類(Server,Agent,Client)系統server(INN,DNews,.)傳送程式(pushvspullmodel)Push傳送:innfeed,nntplink,.Pull傳送:suck,nntpget閱覽程式(線上vs離線閱覽)netscape,ie,tin,UsenetNews傳送方式mailing,UUCP,NNTP(RFC977),Usenet的一般課題(2),News文章的檔頭(RFC1036)RequiredheadersOptionalheadersNews文章的分類normalarticles(moderatedvsun-moderated)controlmessages(cancel,newgroup,rmgroup,checkgroups,sendsys,version)如何新建一個newsgroup送newgroupcontrolmessage,Usenet的一般課題(3),articlesrefusedorrejected(NNTP)refused(round1,存在historydatabase)rejected(round2)pseudonewsgroups(active)control,junkcontrol.cancel,control.newgroup,control.rmgroup,Usenet的一般課題(4),轉換應用程式(applicationgateway)mail2news,news2mail,bbs2news,anti-spamvsfiltering匿名問題(anonymousposting)cancelbot(automaticcancel)PGPverify(controlmessages)FilteringNoCem(No-See-Them)Cleanfeed,UsenetNewsserver的規畫,UsenetNewsserver的規畫Network,Memory,Disk,CPUUPSsystemMemorysize128Mbytes(themore,thebetter)HardDisksizeDiskcapacity12Gbytes(themore,thebetter)SCSIII,Wide(thenewer,thebetter)Inodenumber=2kbytes/inodeFilesystem(hardwareorsoftwarediskarray),News系統的運作與管理課題,In-comingNews(接收)Unbatching/decompression,Filing,.IndexingsupportOut-goingnewsfeeds(外送)Expiration(清理過期文章)Archive(永久保存)系統記錄與製做統計報告,關於news站的管理,建立外界連絡用的e-mailaddressnewsadmin,usenet,abuse例如.tw建立newspeering關係認識你的news上游管理者建立第二個備援站(redundantbackupsite),UsenetserverINN的建置,UsenetNewssoftware的取得.tw/Packages/news/*INNServer的安裝INNREADMEINNInstallationGuide(install.ms)INNFAQPart8:AppendixA:NormansinstallguideMaster/slaveservers,INN中典型的系統目錄,僅量分散原則NewsLibraryDirectory子目錄/usr/local/news/bin,etc,lbin,lib,locks,man,run,varNewsSpoolDirectory子目錄/news/archive,articles,ing,out.going,over.viewNewsLogDirectory子目錄/var/log/news,INN上必須編輯設定的檔案,inn.conf,hosts.nntp,nnrp.accessnewsfeeds,innfeed.confactive,history(*)expire.ctl,innwatch.ctl,control.ctloverview.fmt,moderatorsinnreport.conf(外加選項功能),INN的相關系統設定(1),接收(In-comingconnection)hosts.nntp,nnrp.acesss儲存與內部處理(filing)active,control.ctl外送(out-goingnewsfeeding)newsfeed,innfeed.conf(ornntpsend.ctl,)加掛特殊功能程式(overchan,crosspost,inpath,autoresponder,)newsfeed,INN的相關系統設定(2),定期清理(expiration;news.daily)expire.ctl系統監督(background程式)innwatch.ctl系統報告(news.daily)innreport.conf其他次要功能設定moderators,passwd.nntp,.,INN.conf的設定,範例#pathhost:如果不定,default就是FQDNpathhost:netnews.NCTU.edu.tworganization:NationalChiaoTungUniversity,Taiwanserver:localhost,INN的hosts.nntp設定,格式:範例.tw::.tw:!*,tw*,nctu.*,nthu.*,INN的nnrp.access,標準格式:範例#-Defaultisnoaccess,nowaytoauthentication,andnogroups.*:-no-:-no-:!*#-GeneralIPaddressrangesformostTaiwanssites*.tw:R:*,!junk,!control*,!tw.bbs.adm.*,!alt.binaries.*#-NCTU-NationalChiaoTungUniversity140.113.*:Read:*,!junk,!control*,!twbbs.adm.*.tw:ReadPost:*,!junk,!control*,!twbbs.adm.*,INN的newsfeeds設定(1),標準格式site/exclude,exclude,.:pattern,pattern./distrib,distrib.:flag,flag.:param詳細說明請參閱manpage-newsfeeds(5),INN的newsfeeds設定(2),範例ME:!*/!local:#Createthelinksforcross-postedarticlesxpost:*:Tc,Ap,WR,B4096/1024:/usr/local/news/bin/crosspost#NewsoverviewNOV!:*:Tc,WO,B4096/1024:/usr/local/news/bin/overchan#innfeed-0.10.1,86/04/22innf!:!*:Tc,Wnm*,B4096/1024:/usr/local/news/lbin/startinnfeed-c/news/innfeed/innfeed.conf#-CC1/.tw,.tw:*,!control*,!junk:Tm,G20:innf!,關於feed型態特別說明,FeedTypeTc,channelmodeTm,funnelmodeTf,filemodeTp,program(orpipe)modeTx,explodermode,INN的expire.ctl設定,格式/remember/:範例/remember/:10#Keepfor1-10days,allowExpiresheaderstowork.#Generalexpirepolicyformostnewsgroups*:A:0:0:0*:U:1:1:31*:M:1:7:31tw.*:U:1:7:31*.answers:M:1:31:31,INN的control.ctl設定,格式:action型態cancel,newgroup,rmgroup,ihave/sendme,sendsys,checkgrup,version,“all”範例all:*:*:mailcheckgroups:*:*:log=checkgroupssendsys:*:*:log=sendsysnewgroup:.tw:tw.*:doit=newgrouprmgroup:*:*:mail,Crontabentry-AnExmple,#Dailyexpirationjob402*/usr/local/news/bin/news.dailydelayrmexpireover#PurgeNewsOverviewdatabase406*/usr/local/news/bin/expireover-a#Reloadnewsfeeds300,6,12,18*(cd/usr/local/news;bin/ctlinndthrottleregularreload;bin/ctlinndreloadnewsfeeds/dev/null2bin/ctlinndgo)#PathSurvey-inpaths159301,3-12*/usr/local/news/lbin/pathsurvey159282*/usr/local/news/lbin/pathsurvey,INN上變動性的database(1),active(active,active.times)記錄系統接收哪些newsgroups,以及其屬性,流水編號等資料,同時可供newsreading當作指標.history(history,history.dir,history.pag)記錄系統上所有的newsarticles的進出時間,以及各articles的message-id,儲存路徑名稱等資料.用途1,以防重覆傳送.用途2,expire時根據這一些資料,找出要去除的articles.,Usenet上active的格式,格式namehimarklomarkflags範例tw.test00000123450000012340ynews.answers00000987650000097654mFlags種類y,n,m,x,j,=foo.bar,INN上變動性的database(2),newsgroups(主要用於news-reading)記錄newsgroups對應的說明資料subscriptions(系統)預先設定的newsgroups建議列表,用途1,推薦一些實用的newsgroups用途2,避免初學者,因不熟悉系統操作,以為本系統沒有任何newsgroups可用.目前還不是標準功能(NNTP),所以並非所有news-reader都支援這個功能.,DebugINN系統,Enablenewssyslog/etc/syslog.confCheck/var/log/newsnews.crit,news.err,news.notice(系統狀態)news(記錄每篇newsarticle的流向資料)telnetlocalhost119直接操作NNTPcommands,INN管理工具程式ctlinnd,使用or身份來執行列出所有可用的命令/usr/local/news/bin/ctlinndhelpctlinndxxx,其中xxx代表mode,newgroup,rmgroup,pause,reload,go,shutdown,.,其他Newsserver的簡介(1),HighWind系列(商用版,評價很好)Cyclone,Typhoon,BreezeDNews(Unix,WindowsNT)NNTPcache(Unix)Diabolo(FreeBSD,Solaris)freeware,仍持續發展中,主要newsfeeder,其他Newsserver的簡介(2),NNTPrelay(WindowsNT)商用正式版Tortoise即將出現Netscapeserver有Unix和WindowsNT版從INN1.4開始發展前景不明MSIISserver只適合小規模intranet使用,UsenetNews發展新趨勢(1),Feeder跟Readerserver分開如商用的HighWind系列走向tcpport119(reader),433(feeder)專門的readersupportactived(mmap,overview)NNTPcache(server分級,kernelsvsleaves)Anti-SPAMPGPverify,Filtering+Cancel-bot,Client-tracking,UsenetNews發展新趨勢(2),Filteringcleanfeed(MD5hashing,perlhook)INN,Diablo,CycloneExpire(timevsspace)CNFS(CyclicNewsFileSystem)傳統的unixbfsvsCNFS新版INN2.0即將出爐,CNFS是標準功能DejaNews-Newsarchive,copyright,.News系統HTML化的衝擊,附錄,UsenetHeaders(RFC1036)簡介Usenet/INNrelatedUtilityProgramsAtypicalcontrolmessageAtypicalinnfeed.conf,UsenetHeaders(RFC1036)-簡介(1),必要的(requiredheaders)Newsgroups,SubjectUser提供From,Date,Path,Message-ID系統產生選擇性的(optionalheaders)Reply-to,SenderFollowup-To,References,XrefExpiresControl,AprovedDistributionOrganization,UsenetHeaders(RFC1036)-簡介(2),其他非RFC1036定義NNTP-Posting-HostX-Newsreader.RFC1036RevisedDraft,一些Usenet管理的實用程式,Usenet/INNrelatedutilityprogramsinnreportflowstatsinpathinndfautoresponderFtp:/.tw/Packages/News/*,ATypicalControlMessage,Path:netnews.NCTU.edu.tw!.tw!nntp-!cam-news-!sanjose-news-!sonysjc!vixie!!bounce-backFrom:(DavidCLawrence)Newsgroups:comp.archivesSubject:cmsgnewgroupcomp.archivesmoderatedControl:newgroupcomp.archivesmoderatedApproved:Message-ID:Date:Thu,09Apr199801:30:01-0000Lines:4X-Info:/pub/pgpcontrol/README.html/pub/pgpcontrol/READMEX-PGP-Sig:2.6.2Subject,Control,Message-ID,Date,From,SenderiQCVAwUBNSwkmcJdOtO4janBAQEzhwP/Y9JsOopcfVeQmo6HEJ6e21K9FWWjXwdWQipIRmTcC+0UN6RwufFQ9Qe4rHv3twY8+zM+MXZ13LZ4N64gvk1aKB8PIJLT1/yp9rHmZFG2ac1gPfcyPSQbatsPNiOToc2ncXW5URGysTqC5swgP4h4KE7MZzhFItKLa5uLAm9yrsA=ju5cXref:netnews.NCTU.edu.twcontrol.newgroup:41374comp.archivesisamoderatednewsgroup.Foryournewsgroupsfile:comp.archivesDescriptionsofpublicaccessarchives.(Moderated),#innfeed.conffile.Seethecommentblockatthe#endforafullerdescription.#Globalvalues.No