外文资料--Performance comparison of dynamic web platforms.pdf

PERFORMANCECOMPARISONOFDYNAMICWEBPLATFORMSVARSHAAPTEA,1,TONYHANSENB,,PAULREESERBADEPARTMENTOFCOMPUTERSCIENCEANDENGINEERING,INDIANINSTITUTEOFTECHNOLOGYBOMBAY,MUMBAI400076,INDIABATTLABS,200LAURELAVE,MIDDLETOWN,NJ07748,USARECEIVED7AUGUST2002；ACCEPTED7AUGUST2002ABSTRACTOVERTHELASTFEWYEARS,THEWORLDWIDEWEBHASTRANSFORMEDITSELFFROMASTATICCONTENTDISTRIBUTIONMEDIUMTOANINTERACTIVE,DYNAMICMEDIUMTHEWEBISNOWWIDELYUSEDASTHEPRESENTATIONLAYERFORAHOSTOFONLINESERVICESSUCHASEMAILANDADDRESSBOOKS,ECARDS,ECALENDAR,SHOPPING,BANKING,ANDSTOCKTRADINGASACONSEQUENCEHYPERTEXTMARKUPLANGUAGEHTMLFILESARENOWTYPICALLYGENERATEDDYNAMICALLYAFTERTHESERVERRECEIVESTHEREQUESTFROMTHEWEBSITEPROVIDERS’POINTOFVIEW,DYNAMICGENERATIONOFHTMLPAGESIMPLIESALESSERUNDERSTANDINGOFTHEREALCAPACITYANDPERFORMANCEOFTHEIRWEBSERVERSFROMTHEWEBDEVELOPERS’POINTOFVIEW,DYNAMICCONTENTIMPLIESANADDITIONALTECHNOLOGYDECISIONTHEWEBPROGRAMMINGTECHNOLOGYTOBEEMPLOYEDINCREATINGAWEBBASEDSERVICESINCETHEWEBISINHERENTLYINTERACTIVE,PERFORMANCEISAKEYREQUIREMENT,ANDOFTENDEMANDSCAREFULANALYSISOFTHESYSTEMSINTHISPAPER,WECOMPAREFOURDYNAMICWEBPROGRAMMINGTECHNOLOGIESFROMTHEPOINTOFVIEWOFPERFORMANCETHECOMPARISONISBASEDONTESTINGANDMEASUREMENTOFTWOCASESONEISACASESTUDYOFAREALAPPLICATIONTHATWASDEPLOYEDINANACTUALWEBBASEDSERVICE；THEOTHERISATRIVIALAPPLICATIONTHETWOCASESPROVIDEUSWITHANOPPORTUNITYTOCOMPARETHEPERFORMANCEOFTHESETECHNOLOGIESATTWOENDSOFTHESPECTRUMINTERMSOFCOMPLEXITYOURFOCUSINTHISPAPERISONHOWCOMPLEXVSSIMPLEAPPLICATIONSPERFORMWHENIMPLEMENTEDUSINGDIFFERENTWEBPROGRAMMINGTECHNOLOGIESTHEPAPERDRAWSCOMPARISONSANDINSIGHTSBASEDONTHISDEVELOPMENTANDPERFORMANCEMEASUREMENTEFFORTQ2002PUBLISHEDBYELSEVIERSCIENCEBVKEYWORDSDYNAMIC；WEB；COMMONGATEWAYINTERFACE；FASTCGI；C；JAVA；SERVLETS；JAVASERVERPAGES；PERFORMANCE；COMPARISON1INTRODUCTIONTHEWORLDWIDEWEBWWWFIRSTEMERGEDADECADEAGOASAMEDIUMTORENDERHYPERTEXTDOCUMENTSTHATWERESTOREDONTHEINTERNET,ONAUSER’SCOMPUTER,USINGSPECIALSOFTWARETHEBROWSERANDANEWPROTOCOLHTTPHYPERTEXTTRANSFERPROTOCOLFORTHEFIRSTFEWYEARS,THEWWWGREWPRIMARILYASANEWMEDIUMINWHICHSTATICCONTENTCOULDBEPUBLISHED,ANDINFORMATIONSHAREDTHECONTENTWASPUBLISHEDINTHEFORMOFHTMLHYPERTEXTMARKUPLANGUAGEFILES,WHICHWERESERVEDBYWEBSERVERS,ONREQUESTSFROMBROWSERSHOWEVER,OVERTHELASTFEWYEARSTHEWWWHASTRANSFORMEDITSELFFROMASTATICCONTENTDISTRIBUTIONMEDIUMTOANINTERACTIVE,DYNAMICMEDIUMCONTENTONTHEWEBISNOWOFTENPERSONALIZED,ANDTHEREFOREDYNAMICALLYGENERATEDTHEWEBISNOWWIDELYUSEDASTHEPRESENTATIONLAYERFORAHOSTOFONLINESERVICESSUCHASEMAIL,ECARDS,ECALENDAR,ANDADDRESSBOOKS,SHOPPING,BANKING,ANDSTOCKTRADINGASACONSEQUENCE,THEHTMLFILESTHATARERENDEREDBYTHECLIENT’SBROWSERARENOWTYPICALLYGENERATEDDYNAMICALLYAFTERTHEWEBSERVERHASPROCESSEDTHEUSER’SREQUESTTHISDYNAMICGENERATIONOFHTMLFILESHASNOTHAPPENEDWITHOUTANASSOCIATEDPERFORMANCECOSTJUSTWHENINTERNETUSERSWEREGETTINGACCUSTOMEDTO‘CLICKANDWAIT’ONDIALUPLINESDUETOGRAPHICSRICHWEBSITES,DYNAMICALLYGENERATEDCONTENTSTARTEDPROLIFERATINGONTHEWEBNOWUSERSMUSTWAITNOTONLYFORTHENETWORKDELAYBUTALSOFORTHESERVERSIDEPROCESSINGDELAYASSOCIATEDWITHSERVINGAREQUESTDYNAMICALLYINMANYCASES,THISISTURNINGOUTTOBETHELARGESTCOMPONENTOFTHEDELAYFROMTHEWEBSITEPROVIDERS’POINTOFVIEW,DYNAMICGENERATIONOFHTMLPAGESIMPLIESALESSERUNDERSTANDINGOFTHEREALCAPACITYOFTHEIRWEBSERVERSTHEVENDORPROVIDED‘HITSPERSECOND’CAPACITYOFTHEWEBSERVERISNOLONGERENOUGH,ASTHISONLYPERTAINSTOSTATICHTMLFILESCOMPUTERCOMMUNICATIONS262003888–898WWWELSEVIERCOM/LOCATE/COMCOM01403664/03/SEEFRONTMATTERQ2002PUBLISHEDBYELSEVIERSCIENCEBVPIIS01403664020022191THISWORKWASDONEWHILETHISAUTHORWASWITHTHENETWORKDESIGNANDPERFORMANCEANALYSISDEPARTMENT,ATTLABS,MIDDLETOWN,NJ07748,USATHISAUTHORHASPREVIOUSLYPUBLISHEDUNDERHERMAIDENNAMEOFVARSHAMAINKARCORRESPONDINGAUTHOREMAILADDRESSMAINKARATTCOMTHANSENFROMTHEWEBDEVELOPERS’POINTOFVIEW,DYNAMICWEBCONTENTIMPLIESANADDITIONALTECHNOLOGYDECISIONTHEWEBPROGRAMMINGTECHNOLOGYTOBEEMPLOYEDINCREATINGAWEBBASEDSERVICEORPRODUCTTHISDECISIONISBASEDONSEVERALFACTORSAMONGTHEFACTORSCONSIDEREDAREEASEOFPROGRAMMING,RICHNESSOFFEATURES,MAINTAINABILITY,RELIABILITY,ANDPERFORMANCESINCETHEWEBISINHERENTLYINTERACTIVE,PERFORMANCEISAKEYREQUIREMENT,ANDOFTENDEMANDSCAREFULANALYSISOFTHESYSTEMSINTHISPAPER,WECOMPARETHEPERFORMANCEOFFOURWEBPROGRAMMINGTECHNOLOGIES,NAMELYJAVASERVLETS,JAVASERVERPAGES,CGI/CANDFASTCGI/CASMALLERVERSIONOFTHISSTUDYWASPRESENTEDINREF1THESTUDYWASMOTIVATEDBYAREALNEEDTOMAKEATECHNOLOGYCHOICEFORDEVELOPINGSOFTWARETHATWOULDSUPPORTAWEBBASEDSERVICEASTUDYOFEXISTINGLITERATURESHOWEDVARYINGCONCLUSIONSABOUTTHEPERFORMANCESUPERIORITYOFONETECHNOLOGYOVERTHEOTHERPROPONENTSOFTHEJAVAPLATFORMCONSISTENTLYCLAIMSUPERIORPERFORMANCEOFSERVLETTECHNOLOGYMAINLYDUETOTHEELIMINATIONOFTHEOVERHEADOFPROCESSCREATION2,3ONTHEOTHERHAND,ASTUDYDONEINREF4THATCOMPARESCGI,FASTCGIANDSERVLETSSHOWEDSERVLETSTOBETHESLOWESTOFTHETHREEASIMILARCOMPARATIVESTUDYHASBEENDONEINREF5,FOCUSINGONWEBTODATABASEAPPLICATIONS,WHICHSHOWEDJAVASERVLETSTOBEBETTERTHANCGIPROGRAMSFURTHERMORE,ALTHOUGH4BRIEFLYPROVIDESSOMEEXPLANATIONABOUTTHERESULTS,ANINDEPTHANALYSISANDINSIGHTABOUTTHERESULTSWASNOTAVAILABLEINTHELITERATURETHATWESURVEYEDONECONCLUSIONFROMTHEVARIABILITYOFTHERESULTSWASALSOTHATTHEPERFORMANCEOFTHETECHNOLOGYDEPENDSONTHEAPPLICATIONINTHISPAPER,THECOMPARISONISBASEDONTWOCASESONEISACASESTUDYOFACOMPLEXAPPLICATIONTHATWASDEPLOYEDINANACTUALWEBBASEDSERVICE；THEOTHERISA‘TRIVIAL’APPLICATIONTHEMETHODOLOGYOFPERFORMANCEANALYSISWASSTRESSTESTINGANDMEASUREMENTPERFORMANCEMEASUREMENTRATHERTHANMODELINGMADEMOSTSENSEINTHISEFFORT,SINCEAQUICKTURNAROUNDOFRESULTSWASNECESSARYANDTHEACCURACYOFRESULTSWASREQUIREDTOBEHIGHTHETWOCASESIETHECOMPLEXANDTHETRIVIALPROVIDEDUSWITHANOPPORTUNITYTOCOMPAREPERFORMANCEOFTHESETECHNOLOGIESATTWOENDSOFTHESPECTRUMOFAPPLICATIONS,INTERMSOFCOMPLEXITYTHEPERFORMANCE‘ORDER’OFDIFFERENTTECHNOLOGIESISSELDOMABSOLUTEITDEPENDSGREATLYONTHENATUREOFTHEAPPLICATIONOURFOCUSINTHISPAPERISONHOWCOMPLEXVSSIMPLEAPPLICATIONSPERFORMWHENIMPLEMENTEDUSINGDIFFERENTWEBPROGRAMMINGTECHNOLOGIESAMONGTHEPAPERSSURVEYED,WEBELIEVETHISISTHEONLYPAPERPRESENTINGASYSTEMATICBOTTLENECKANALYSISOFEACHOFTHETECHNOLOGIES,ANDTHEONLYONETHATDEMONSTRATESTHATTHEPERFORMANCE‘RANKING’COULDBEREVERSED,BASEDONTHEAPPLICATION,WHILEPROVIDINGINSIGHTONWHYTHISHAPPENSTHEMAINOBSERVATIONSFROMTHISWORKWEREASFOLLOWSINGENERAL,FASTCGIOUTPERFORMEDCGI,WHILEJSPOUTPERFORMEDJAVASERVLETSINTHECASEOFACOMPLEXAPPLICATION,THECGIBASEDTECHNOLOGIESOUTPERFORMEDTHEJAVABASEDTECHNOLOGIESBYAFACTOROF3–4,WITHJAVAPERFORMANCELIMITEDBYSOFTWAREBOTTLENECKSINTHEJVMINTHECASEOFATRIVIALAPPLICATION,THERELATIVEPERFORMANCEWASREVERSED,ASJAVAOUTPERFORMEDCGIBYAFACTOROF2–3THERESTOFTHEPAPERISORGANIZEDASFOLLOWSINSECTION2WEPROVIDETHEMOTIVATIONFORCONDUCTINGSUCHACOMPARATIVESTUDY,ANDINSECTION3WEDESCRIBEBRIEFLYTHETECHNOLOGIESTHATWECOMPAREDSECTION4DESCRIBESTHEPERFORMANCEMEASUREMENTANDANALYSISMETHODOLOGY,SECTION5DESCRIBESTHECASESTUDYTESTINGRESULTSINDETAIL,ANDSECTION6DESCRIBESTHERESULTSOFTESTINGATRIVIALAPPLICATIONFINALLY,SECTION7SUMMARIZESOURRESULTS,ANDSECTION8PROVIDESSOMECONCLUDINGREMARKS2MOTIVATIONTHEAPPLICATIONCONTEXTFORTHISCASESTUDYWASANEWWEBBASEDMESSAGINGSERVICESUCHASERVICEWOULDINVOLVEABACKENDTHATWOULDINCLUDETHECOREMESSAGINGRELATEDSERVERSIMAP,POP,LDAP,SMTP,ANDAFRONTEND,ORAPRESENTATIONLAYERTHATWOULDSERVEASMIDDLEWAREBETWEENTHEWEBBROWSERANDTHEMESSAGINGSERVERTHECORESERVERSWERECHOSENTOBEESTABLISHEDMESSAGINGPRODUCTSTHEPRESENTATIONLAYERWOULDCONSISTOFAWEBSERVEROFFTHESHELFANDANEWDYNAMICPAGEGENERATIONENGINETOBEDEVELOPED,WHICHWOULD†READDATASENTBYTHEUSER,THROUGHTHEHTTPPROTOCOL†DOTHENECESSARYPROTOCOLCONVERSIONSTOIMAP,LDAP,†CARRYOUTTHEACTIONENCODEDINTHEHTTPREQUEST,USINGTHEAPPROPRIATEPROTOCOLWITHTHEBACKENDSERVERS†FORMATTHERESULTASAWEBPAGE,AND†RETURNTHERESULTTOTHEUSER’SWEBBROWSERTHROUGHTHEWEBSERVERONEWAYTOWRITESUCHAPROGRAMTHATGENERATESWEBPAGESDYNAMICALLYISTOCODETHELOGIC,ANDTHENEMBED‘PRINT’STATEMENTSINTHEPROGRAMTHATWRITEOUTSTATICHTMLCODE,ALONGWITHPRINTINGOTHERSTRINGVARIABLESTHATHAVEBEENPOPULATEDDYNAMICALLYABETTERANDMOREPOPULARWAYISUSINGTEMPLATESTHEMIDDLEWAREWESTUDIEDUSEDATEMPLATEBASEDDESIGNFORPRODUCINGDYNAMICWEBPAGESTHISMETHODINVOLVESWRITINGWEBPAGETEMPLATESWHICHHAVESTATICHTMLCODETHATSPECIFYTHEDESIGNOFTHEWEBPAGE,INTERSPERSEDWITHSCRIPTINGTAGSTHATAREINTERPRETEDBYATEMPLATESERVERPROGRAMTHESETAGSINSTRUCTTHETEMPLATESERVERPROGRAMONTHEACTIONTHATISTOBETAKENEGPOPULATINGAFIELDWITHTHESUBJECTLINEOFAMESSAGEONREADINGTHETAGTHETEMPLATESERVERPROGRAM,THEREFORE,VAPTEETAL/COMPUTERCOMMUNICATIONS262003888–898889†PARSESTHESPECIFICTEMPLATEACCESSEDBYAUSERREQUEST†INTERPRETSTHETAGSANDCOMMUNICATESWITHTHEBACKENDSERVERS†POPULATESTHEFIELDSTHATARETOBYDYNAMICALLYPOPULATEDTHERESULTISADYNAMICALLYGENERATEDWEBPAGETHEARCHITECTUREOFSUCHASYSTEMISSHOWNINFIG1GIVENTHEACCELERATEDTIMETOMARKETGOALSANDLIMITEDDEVELOPMENTTIME,THENATURALCHOICEOFTECHNOLOGYFORTHETEMPLATESERVERWASTHEONEPERCEIVEDTOBEPOWERFUL,FEATURERICHANDYETEASYTOUSEANDDEPLOYNAMELY,JAVASERVLETSANINITIALEFFORTWASDONETOQUANTIFYTHEPERFORMANCEOFTHISPAGEGENERATIONENGINE,TOSEEWHETHERITCOULDMEETTHEEXPECTEDPERFORMANCEREQUIREMENTSWECONDUCTEDASERIESOFSTRESSTESTSUSINGACOMMERCIALLOADDRIVERTOGENERATEREPEATEDREQUESTSTOTHESERVLETENGINEATVARIOUSLEVELSOFCONCURRENCYSIMULATEDUSERSTHETESTCONFIGURATIONCONSISTEDOFAWINDOWSNTSERVERRUNNINGTHELOADGENERATIONSCRIPTSDRIVER,ASOLARISSERVERRUNNINGTHEFRONTENDSOFTWARE,ANDASOLARISSERVERRUNNINGTHEBACKENDAPPLICATIONFORTHISTEST,APOP3/IMAP4MAILSERVERANDANLDAPDIRECTORYSERVERHARDWARECPU,MEMORY,DISK,I/OANDSOFTWARERESOURCECONSUMPTIONSWEREMEASUREDONALLMACHINESINADDITION,ENDTOENDUSERPERCEIVEDRESPONSETIMESWEREMEASUREDTHEDRIVERSCRIPTSEMULATEDAPRESCRIBEDNUMBEROFCONCURRENTUSERSREPEATEDLYGENERATINGTHESAMEREQUESTEGREADMESSAGE,SENDMESSAGE,ETCTHENUMBEROFCONCURRENTSIMULATEDUSERSWASVARIEDFROM1TO20THENUMBEROFREPEATEDREQUESTSPERUSERATEACHCONCURRENCYLEVELTYPICALLY2000WASSUFFICIENTTOACHIEVESTATISTICALSTABILITYTHETESTSWERERUNIN‘STRESS’MODE；THATIS,ASSOONASAUSERRECEIVESARESPONSE,ITIMMEDIATELYSUBMITSTHENEXTREQUESTIEWITHNEGLIGIBLECLIENTDELAYEACHOFTHENSIMULATEDUSERSDOESSOINDEPENDENTLYANDINPARALLELASARESULT,THECONCURRENCYLEVELIETHENUMBEROFREQUESTSINTHESYSTEMEQUALSNATALLTIMESTHERESULTSOFTHESTRESSTESTSFORAPARTICULARREQUESTTYPEREADA20KBMESSAGEARESHOWNINFIGS2AND3INPARTICULAR,FIG2PLOTSTHEENDTOEND