版权说明:本文档由用户提供并上传,收益归属内容提供方,若内容存在侵权,请进行举报或认领
文档简介
Unix電子郵件管理
(漏洞排除、網路問題診斷、DNS管理等)陳昌盛國立交通大學
計算機與網路中心技術發展組組長(2008.11.26)綱要(Outline)E-mail基本運作原理與管理課題垃圾郵件防護機制問題診斷與除錯(Troubleshooting&Debugging)常見過濾機制(Mail,DNS,IPS/Firewall,etc.)問題與討論個案探討總結與未來發展附錄新興課題-網路釣魚詐騙信件(Phishing)參考資料E-mail運作原理與管理課題
(垃圾郵件的產生)
Part1E-mailBasics從RFC821/2821,E-mail基本組成結構Message=anenvelope+contentContent=mailheaders+bodyMIMEextensionForthetransmissionofimages,audio,orothersortsofstructureddatainelectronicmailmessages.MIMEdocumentseries[RFC2045,RFC2046,RFC2049]InternetBouncingserverIncomingSMTPGatewayFarmMailSpoolserverOutgoingSMTPGatewayFarmFirewall典型E-mail系統運作圖SMTPauthMailFilteringBL/GL/WLAuto-learn垃圾郵件防治概論Q1:何謂SPAM?為何會有那麼多SPAMmail?WheredidtheSPAMmergetmye-mailaddress?Q2:如何反制Spammail?Or,howdoestheE-mailsystemknowifanincomingmailisaspammessage?Q3:Thebigissueswithfilteringtodate“Spammail阻擋效率如何?”“多少正常的e-mail也被阻擋?”何謂垃圾郵件(SpamMail)?垃圾郵件防護概論(個別認知差異)
--TruthDependsonInterpretationFilteringwithH1(msg)FilteringWithH2(msg)MailSpoolDiscardMTA1(orMUA1)AcceptMTA0
MTA=MailTransferAgentMUA=MailUserAgentMTA2
(orMUA1)SpamMail特性透過密件傳送功能(headerBCCforbulkmailing)以規避大量傳送信件的限制Avoidingtheheaderlengthlimits使用經常改變且是假的送件者以逃避郵件過濾使用假造的電子信件郵戳以逃避追蹤(fakedReceivedlinesforpreventing/confusingthespamsourcetracing)SyntaxOk,SemanticsError有時候Spammail會夾帶病毒WheredidtheSPAMmergetmye-mailaddress?
為何會有這麼多SpamMail?SPAM來源Themostcommonformofspamiscommercialspam,wheretheuserishopingtomakeaprofit.Takeasanexamplespam,whereauserabusestheun-meterednatureofemailtosendoutmillionsofemails.Astheincrementalcostsofsendingmoreemailstothespammerarealmostzero,hecanstillmakeaprofitevenwithasuccessrateof0.0001%.
UsingaBotnettosendspammails
-FromWikipediacomputerhackingandbotnetattacksby
criminals,terroristsandforeignpowers.Botnet簡介Botnet俗稱殭屍網路(ZombieNetwork),又稱機器人網路(RobotNetwork),受Botnet感染之主機猶如殭屍般任由控制者操控駭客藉由IRC(InternetRelayChat)等管道遠端控制受感染的主機,可發動網路攻擊包括竊取私密資料、網路釣魚(Phishing)、散布垃圾郵件(SPAM)、發動阻斷式服務(DDoS),恐嚇被駭網站等犯罪行為Botnet病毒,通常每隔5至10秒利用IRC通訊埠(6660-6669或7000,主要為6667)進行網路連線Botnet具有自我複製並主動散播之特性,同時具有隱匿性,受感染之主機不易發覺若再經有心人士製造變種Botnet病毒,防毒軟體更不易偵測,常造成嚴重之損害垃圾郵件反制Part2WhyBotherFilteringSpam?
--EconomicalviewOnaglobalscaleuseofbandwidth,CPUresourcesandpeopletimearewasted.
Seemstobeabout30%to60%ofmailtraffic,andincreasingThespamrecipientstimeiswastedaswell,andreceivingthespammaydirectlycostingtheuserbandwidthfeesfromtheirISP.ISP'salsodislikespambecauseitcoststhemtimeandmoneytodealwiththecomplaints,andrecoveroverloadedmailserversthatsometimescrashundertheloadofintensivespamming.WhyBotherFilteringSpam?
-SocialviewNearlyimpossibletounsubscribe“unsubscribe”addressesworkonly37%ofthetime,accordingtotheUSFTC
Opt-invs.opt-outLegalretaliation(求償)notpossibleinmostpartsoftheworldyetOnlypossibleinsomeregions(e.g.,Korea,somestatesinUS,etc.)Taiwan(準備採用Option-out)已經訂草案,送交立法(近年的報紙消息)AHybridModelforAnti-spamandRelatedIssues
Economy+Education+Law+TechnologyEducationEconomyTechnologyLawHash-moneyBL,GL,WLMachinelearningOpt-in,opt-outCyberforensicAuthenticationConfirmationIdentificationVerificationRetaliation((求償)PrivacyprotectionAnti-SPAM
HowDoTheSpammersFeel?SpamreliesonlowoverheadsandextremelycheapdeliveryDisrupttheequationandtheywillgiveup!Alreadyhurting,accordingtoCBS:“[I’vegonethrough]unbelievablehardships[tokeepspamming]...Myoperatingcostshavegoneup1,000%thisyear,justsoIcanfigureouthowtogetaroundallthesefilters”Anti-SpamParadigmView1:PreventyoursitesfrombecomingSPAMsourcesSenderauthenticationVulnerabilityscanningAccessControl(e.g.,Firewall,etc.)View2:PreventSPAMfromenteringthemailboxesofyoursiteTasks:identify/detectincomingSPAMmessagesSenderauthenticationWhitelist,Blacklist,Greylist,Auto-learning(personalization)Sub-views:server-sidevs.client-sidefiltering
View1:防止本單位網站變成Spam幫兇
(CommonSPAMSource)目前TANet常見的模式CompromisedHosts:主機遭入侵,被植入後門程式,讓有心人士可以利用該主機發送廣告信件.(e.g.,主機遭病毒攻擊)OpenProxy:ProxyServer未對可信賴的使用者IP或Domainname範圍做限制,讓有心人士利用HTTP協定上的漏洞寄送廣告信件至Internet.OpenRelay:
郵件伺服器未對可寄送信件的使用者IP或Domainname範圍做限制,讓有心人士利用來轉發廣告信函至Internet上.其他使用者不當使用,利用學術網路發送廣告信函.MeasurestoAvoidBecomingSPAMVictims
-OtherSuggestedAdministrationPoliciesBasicMeasuresPrevention/Disableofopenrelay(SMTP)and/oropenproxyOpenproxy:tcpport80,tcp3128,etc.Enableanti-viruscapabilitySenderAuthenticationEnableSMTPauth(orsomethingofthelike)SenderPolicyFramework(SPF)
–
Enableadvertisedwhite-listfromSender(throughDNS)SubtypeofProblem-ForgedSenderGoodnews:SPF,SenderID,DomainKeys,etc.BadnewsThismightcostmoremoneyforauthenticationservicesinthefuture(e.g.,anti-viruscheckingservices)Itmightnotbeeffectivetoauthenticatesomethinglikeabc.123@ora13yotdfgfg@,etc.
i.e.,theremightstillbetoomuchoverhead/loadingforauthenticatingthesepossiblefakedsources(Cf.DNSSEC)View2:防止SPAM進入單位內信箱
(Anti-spam:垃圾郵件防治)用戶端防制法ThunderbirdOutlookexpressServer端防治法SpamAssasin(MachineLearning)Dspam(統計)CandidateFeaturesforFilteringEnvelopaddress(EnvFrom,EnvRcpt)Malformedsender(orrecipient)addressRelay(Helo,rDNS,IPaddressrange,etc.)SMTPPeakConnectionRatio(8.13)HeaderAddress(HdrFrom,HdrRcpt,etc)BasicFeatures:From,To,SubjectExtendedFeatures:X-Mailer,Message-Id,etc.UsingSPAMware(e.g.,Dynamailer,Dmailer,etc.)BodyContentUnwantedcontents(Subject,Bodylines,URL,etc.)垃圾郵件防治基礎過濾方式評估(FilteringApproaches)Server-sidevs.user-sideStaticvs.adaptiveAuto-learning可用過濾機制(FilteringMechanisms)黑名單(Blacklist-totallydenied)白名單(Whitelist-totallyaccept)灰名單(Greylist-partlydenied)自動學習(Auto-learningvs.StatisticalApproach)Mail過濾機制示意圖
--AtypicalAnti-spamModelGenericMailFiltering白名單黑名單自動學習防治拒收
收下灰名單
(1)(2)(3)(4)PassPassFailFailFailtemporarily發信者UpdateMailSpool隔籬區(Quarantine)暫時收下Anti-SPAMMethodologies
(usingArtificialIntelligenceTerms)Rule-basedMethodologyMilter-regex(server-server),Procmail(client-side)Database-basedMethodologyBlacklist(totallydenied)SpamCop,DNSBL,etc.Whitelist(totallyaccept)Greylist(partlydenied)Razor-likeorDCC-likeapproach(distributed)DataMining/MachineLearningMethodologyThunderbirdapproach(personal)SpamAssassin(server,personal)Rule-basedModelsforE-mailfiltering(e.g.,Sendmail,Postfix,etc.)PatternMatching(RegularExpression)ToolE.g.,Sendmail+Milter-regexWhitelistvs.BlacklistRejectvs.DiscardBehaviorHeuristicsSMTPPeakConnectionRatio/Threshold(sendmail8.13)Greylist(two-phaseadaptiveblacklist)E.g.,Sendmail+milter-greylistMachineLearningToolSendmail+SpamAssasinIntroductiontoGreylistIn2003,EvanHarrisproposedanovelidea,whichhecalledGreylisting.i.e.,basedontheobservationthatmanyunsolicitedbulkmailsaresentviaopenproxiesandothermechanismsthatdonotinvolvepropermailtransferagents.
Themainideasofgreylistingareasfollows:MailfromunfamiliarsendersaretemporarilyrejectedandshouldberetransmittedbytheirISPs'SMTPclients.Mailsfromfamiliarsendersarepassedimmediately.Youcan
whitelistfriendlySMTPservers,andyoushould
whitelistyourownnetwork,otherwiseyourSMTPclientswillhaverealtroubletosende-mail.Whitelistinglocalhostisalsoamust.RationalebehindusingGreylist(cont)GreylistingworksbyassumingthatcontrarilytolegitimateMTA,spamengineswillnotretrysendingtheirjunkmailonatemporaryerror.
RFC
2821saysthatthesendingMTAshouldretransmit30minutesorlaterafterafailure,butspamsentthroughanopenproxyaswellassomevirusesandwormsarenotretransmitted.ApropersendingMTAwillrepeatatransmissionafteratemporary
4yzrejection.Ifspammersevertrytoresendrejectedmessages,wecanassumetheywillnotstayidlebetweenthetwosends.Oddsaregoodthatthespammerwillsendamailtoanhoneypotaddressandgetblacklistedinadistributedblacklistbeforethesecondattempt.##greylistedtuples#----------------------------------------------------------------------------------------#SenderIPSendere-mailRecipiente-mailTimeaccepted10<vjxgtcfn@><lh15@.tw>1099474741#2004-11-0317:39:0110<vjxgtcfn@><limintsai@.tw>1099474742#2004-11-0317:39:0210<vjxgtcfn@><lindajmm@.tw>1099474743#2004-11-0317:39:03##Auto-whitelistedtuples#========================================#SenderIPSendere-mailRecipiente-mailExpire2<epaper@.tw><ysm@.tw>1100042183AUTO#2004-11-1007:16:232<epaper@.tw><yytzou@.tw>1100042354AUTO#2004-11-1007:19:142<epaper@.tw><wsfu@.tw>1100041397AUTO#2004-11-1007:03:17…moreConsiderations,Caveats,andDifferences
Falsepositives(不是SPAM,卻沒有放行)arepossibleifalegitimateSMTPclientdoesnotretransmitanembargoed(禁制)messageaftertheembargoexpires.
FailingtoretransmitclearlyviolatestheSMTPstandard,becauseitwillresultinlostmailshouldsomethingotherthanGreylistingcauseatemporaryfailureresponse.Falsenegatives(是SPAM,卻未擋下)arecommon.
GreylistingcanonlydetectbogusSMTPclients.BulkmailadvertisersthatusestandardscompliantsoftwareautomaticallypassMachineLearningApproachforAnti-Spam
(cf.,SpamAssassinConcepts)Combinesmanysystemsfora"broad-spectrum"approachLotsofrulestodetermineifamailisspamornotDetectforgedheadersSpam-toolsignaturesinheadersTextkeywordscannerinthemessagebodyDNSblacklistsRazor,DCC(DistributedChecksumClearinghouse),PyzorThesearecombinedtoproduceanoverallscoreforeachmessageIfoverauser-definedthreshold,themailisjudgedasspamSpammerscannotaimtodefeat1system;theotherswillcatchthemoutSpamAssassinGAStartGoodEnough?EvolveScoresFinalScoresNoYesMachineLearningApproachforAnti-Spam
(cf.SpamAssassinExample)用戶端防治垃圾郵件
-範例:
thunderbird(1/2)垃圾郵件用戶端垃圾郵寄防治工具
--範例:Thunderbird(設定,2/2)垃圾郵件防治設定垃圾郵件防護(Anti-Spam)
Server端防制(Dspam系統)Dspam基本運作架構DspamUI使用範例Dspam成效(performance)調整Dspam個人化設定條件垃圾信件隔離區檢視(Quarantine)按機率(Spam)高低顯示(分成三種顏色)圖表顯示(Spamvs.Goodmail)誤判可放行(i.e.,正常e-mail)重新訓練(誤判、漏判)DspamAsaDeliveryAgentProxyInthediagrambelow,MTAreferstoMailTransferAgent,oryourmailserversoftware:Postfix,Sendmail,Exim,etc.LDAreferstotheLocalDeliveryAgent:Procmail,Maildrop,etc..BEFORE:[MTA]--->[LDA]--->(User'sMailbox)AFTER:[MTA]--->[DSPAM]--->[LDA]--->(User'sMailbox) \
\-->[Quarantine] [EndUser]------>[WebUI]Dspam過濾成效(performance)垃圾信件隔離區(Quarantine)
-分三種顏色顯示,低、中、高,不同機率範圍問題診斷與除錯Part3問題診斷與除錯
(Troubleshooting&Debugging)過濾機制(設備)Router,Firewall,IPS,Mail,etc.常見驗證/診斷機制SystemLog觀察退信分析Header驗證Domainname查詢DNS+Whois特殊案例--某
區網中心的誤擋實例(Router阻擋Worm攻擊)Part4問題與討論個案探討(CaseStudy)垃圾防護機制未來發展問題與討論SpamDetectionStats(正確率)訂定Spam防制策略Policy1–訂定不同的管理策略(包括個人化support)Policy2–將incoming/outgoingrelay分開Policy3–啟動傳送用戶認證(senderauthentication)SpamDetectionStats
(FromSpamConf2003)DNSBLsPhraseMatchingHeuristics(SA)StatisticsAccuracy0-60%80%95%99%+FalsePositives10%2%0.5%0.1%MeasurestoavoidbecomingSPAMvictims
-NCTUAdministrationPoliciesConsideringUsers’ViewsServer-sidefiltering.twClient-sideFiltering(i.e.,nofilteringattheserverside).twOtherAdvancedFeaturesPersonalizationsupport(e.g.,Dspam,etc.)ClientToolsServer-sideSupportMeasurestoavoidbecomingSPAMvictims
-NCTUAdministrationPolicies(cont.)SeparationofIncoming&OutgoingRelaysForeasyseparation(oridentification)ofspamsourceIncomingRelay:Enableadvertisedblacklist(orsemi-blacklist)fromSender(throughDNS)RejectdirectSMTPrelayingfrom19..twOutgoingRelay:Mightacceptrelayfrom19..twwithSMTPauth(orsimilar)案例:Spammail散佈
–利用Webmail用戶之密碼太簡單者案例:詐騙信–SocialEngineering
(騙取帳號/密碼)案例-詐騙+VirusMessage範例-Server端阻擋VirusMessage(1/3)範例-Server端阻擋VirusMessage(2/3)範例-Server端阻擋VirusMessage(3/3)SummaryandDiscussion
-FutureDirectionsEconomy-"Hash-cash"Sendingmailcurrentlymore-or-lessfreeWithhash-cash,eachrecipientrequiresCPUtimeforthesenderSpamAssassincanprovide"bonuspoints"forhash-cashusersEducationTechnology--Learningfilters(Bayesianprobabilityetc.)Learnautomatically,todetectwhat"good"mailtoyournetworklookslikeSummaryandDiscussion
-FutureDirections(cont.)Technology-Hybridapproachforanti-spammingStatic(Blacklist+Whitelist)+Adapative(e.g.,Greylist,SpamAssassin,etc.)+Auto-learn(ormachinelearning)SenderAuthenticationSenderID,SPF,DomainKeys,etc.Published/advertisedrules–blacklistvs.whitelistSummaryandDiscussion
-FutureDirections(cont.)LawCyber-forensic,Retaliation,etc.立法防杜垃圾郵件台灣政府已把濫發商業電子郵件管理條例草案送交立法院,若順利希望明年實施;張天欽(行政院通訊傳播委員會籌備處法制組組長;UDN-931117)草案中規範:企業濫發垃圾郵件罰金可達2千萬元,個人收到垃圾郵件,可到法院最低可請求500至2000元賠償。附錄MailRelay架構與Spam防護DNS:MailExchangeRecords使用Greylist網站統計(參考資訊)幾年前的網站資訊
網路詐欺(釣魚)和防護機制MailSystemLog範例FilteringConfiguration1–
MTA+anti-spam+anti-virusengine
DistributedConfiguration-
Anti-spam+anti-virusengineinMXhostsMXHostsConfigurationAllMsg.73%Rejected27%Greylist25%ClamAVSpamAssassin2%Virus3%17%5%PassedBlockedSpamLevel>16PassedSpamLevel(6-15)新興威脅–PhishingMail網路釣魚/詐欺牽涉多種網路服務Mail+Web(+DNS)欺騙用戶的眼睛(視覺/警覺盲點)問題:假冒URL常牽涉DNS名稱相似的問題典型問題–
“郵件欺詐”是一種電子郵件圈套,它透過使用虛假網站或一封回復電子郵件,誘騙客戶公佈自己的個人資訊如信用卡或借記卡帳號、支票帳戶資訊、社會保險號或銀行帳戶密碼等。
網路詐欺
-網路釣魚(Phishing網站)此類問題大致的發生機制入侵特定網站主機A建置假網頁入侵特定網站主機B(形成Botnet)製作SpamMail,內含假URLl(例如知名銀行網站,網路購物,拍賣網站等)由B散佈Spam給(不)特定的受害者X,誘騙受害者上當,點擊假的URL,導引到上述甲網站A,騙取個人身分資訊(帳號/密碼等)
或不自覺下載惡意程式
(所謂keylogging鍵盤記錄程式)網路詐欺縣電子郵件函
-範例1:網路釣魚(詐騙信+Phishing網站)
真正網址(URL)看起來的連結(有問題的假連結,欺騙眼睛)網路詐欺案(i.e.,受害者?幫兇?)
範例2-被利用的網站畫面網路詐欺通報案
→範例3︰受害單位自救通告(必須盡快因應)網路詐欺
-網路釣魚(Phishing網站)新趨勢鎖定對象Spearphishing有漸增的趨勢
一般性質run-of-the-millphishingRecentemailscamsincludethetargetingofcompanydirectorswithfakesubpeonasandMastercarduserswhowerepromiseddiscountsonfuturepurchases.
網路釣魚(Phishing網站)防護機制資安教育用戶本身的警覺性(分辨假的訊息)資安防護工具E-mailServer過濾瀏覽程式(WebBrowser)的過慮防護通報Report到特定網站可協助其他人–
前人種樹,後人乘涼盡快處理來自受害單位的自救通告避免日後的財物及法律糾紛網路釣魚(Phishing)防護機制
–範例4︰
新版瀏覽程式IE7.0(+),Firefox2.0(+)等AbnormalrelayMay1700:30:09NSsm-mta[64943]:i4GGU4Av064943:ruleset=check_rcpt,arg1=<selios.bbh@.tw>,relay=[03],reject=5505.7.1<selios.bbh@.tw>...Relayingdenied.IPnamelookupfailed[03]May1700:30:10NSsm-mta[64943]:i4GGU4Av064943:ruleset=check_rcpt,arg1=<seta.bbs@.tw>,relay=[03],reject=5505.7.1<seta.bbs@.tw>...Relayingdenied.IPnamelookupfailed[03]May1700:30:10NSsm-mta[64943]:i4GGU4Av064943:from=<sender2@>,size=0,class=0,nrcpts=0,proto=SMTP,daemon=MTA,relay=[03]Anti-SPAMCaseStudy(1)
-DNSCheckMay1307:56:41Wwwsm-mta[91713]:i4CNubd2091713:ruleset=check_rcpt,arg1=<nickie@.tw>,relay=[8],reject=5535.1.8<nickie@.tw>...Domainofsenderaddresse00025cca@
doesnotexistMay1307:56:41Wwwsm-mta[91713]:i4CNubd2091713:from=<e00025cca@>,size=0,class=0,nrcpts=0,proto=ESMTP,daemon=MTA,relay=[8]Anti-SPAMCaseStudy
-unacceptablerelayblocked(2)May1300:00:26nssm-mta[18832]:i4CG0IHN018832:ruleset=check_rcpt,arg1=<chia@.tw>,relay=218-170-127-234.[34],reject=5505.7.1<chia@.tw>...AccessdeniedMay1300:00:26nssm-mta[18832]:i4CG0IHN018832:from=<a8705135@.tw>,size=0,class=0,nrcpts=0,proto=ESMTP,daemon=MTA,relay=218-170-127-23
温馨提示
- 1. 本站所有资源如无特殊说明,都需要本地电脑安装OFFICE2007和PDF阅读器。图纸软件为CAD,CAXA,PROE,UG,SolidWorks等.压缩文件请下载最新的WinRAR软件解压。
- 2. 本站的文档不包含任何第三方提供的附件图纸等,如果需要附件,请联系上传者。文件的所有权益归上传用户所有。
- 3. 本站RAR压缩包中若带图纸,网页内容里面会有图纸预览,若没有图纸预览就没有图纸。
- 4. 未经权益所有人同意不得将文件中的内容挪作商业或盈利用途。
- 5. 人人文库网仅提供信息存储空间,仅对用户上传内容的表现方式做保护处理,对用户上传分享的文档内容本身不做任何修改或编辑,并不能对任何下载内容负责。
- 6. 下载文件中如有侵权或不适当内容,请与我们联系,我们立即纠正。
- 7. 本站不保证下载资源的准确性、安全性和完整性, 同时也不承担用户因使用这些下载资源对自己和他人造成任何形式的伤害或损失。
最新文档
- 2026年黑龙江艺术职业学院高职单招笔试化学历年参考题库含答案解析
- 2026年阳泉职业技术学院高职单招笔试职业技能测验历年参考题库含答案解析
- 2026年长沙民政职业技术学院高职单招笔试英语历年参考题库含答案解析
- 2026年金肯职业技术学院高职单招笔试综合素质历年参考题库含答案解析
- 快件处理员岗前责任担当考核试卷含答案
- 2026年郑州黄河护理职业学院高职单招笔试职业适应性测验历年参考题库含答案解析
- 产褥期乳房肿胀的护理
- 艾滋病的护理查房
- 患者一般需求的护理
- 眼科专科护理技术操作
- 围栏设施维护方案(3篇)
- 《奇思妙想的帽子》少儿美术教育绘画课件创意教程教案
- 《七七事变与全民族抗战》 教学课件
- 3000P算力中心项目可行性研究报告
- T/CNIDA 004-2022核电工程监理行业取费标准
- 煤矿企业安全生产管理人员考试题库及答案(2012年版)
- 2025年高考语文二轮复习策略讲座
- 离职后员工保密协议
- DL∕T 1971-2019 水轮发电机组状态在线监测系统运行维护与检修试验规程
- 视听语言与分镜头设计(微课版)课件 任务4 认识轴线
- JZ7型制动机试验故障判断
评论
0/150
提交评论