DDI Version 30DDI版本30.ppt

introductiontoddi3 0 sandaionescuicpsrcessdaexpertseminar september2007 ddiversion3 0 radicallydifferent morecomplex butcertainlydoable bringsimportantbenefits workshopschedule 14 30 15 10overview 40 15 10 15 35structureandtechnicalmechanisms 25 15 35 15 45break 10 15 45 16 10studyunit modulescontent 25 16 10 16 30variablemarkupexample 20 16 30 16 40break 10 16 40 17 10grouping modulescontentandexamples 30 17 10 17 30gettingstarted 20 ddi3 0 overview ddibackgrounddevelopmenthistory 1995 agrant fundedprojectinitiatedandorganizedbyicpsrproposestocreateanewstandardfordocumentingsocialsciencedata toreplaceosiristaggedcodebooks firstdraftsusedsgml thenconvertedtoweb friendlyxml 2000 ddiversion1 0publishedasamainlydocument andcodebook centricstandard ddibackgrounddevelopmenthistory 2003 ddiversion2 0publishedwithextendedscope aggregatedatacoverage basedonmatrixstructure additionalgeographicrepresentationtoassistgeographicsearchsystemsandgisusersversions1 0through2 1 latestpublished arebackwardscompatible andbasedonthesamestructure ddibackgrounddevelopmenthistory february2003 formationoftheddialliance aself sustainingmembershiporganizationwhosemembershaveavoiceinthedevelopmentoftheddispecification http www ddialliance org ddibackgrounddevelopmenthistory version3 0 2004 2006 planninganddevelopmentnovember2006 internalreviewfebruary2007 publicreviewjuly2007 candidatedraftreleasehttp www ddialliance org ddi3 index html benefitsofusingddiasanxml basedstandard interoperability enablesseamlessexchangeandreusebyothersystems repurposing providesacoredocumentfromwhichdifferenttypesofoutputscanbegenerated value addeddocumentation taggingcarries intelligence inthedocumentbydescribingcontent enhanceddatadiscovery increasesprecisionandgranularityofsearches supportfordataanalysis variablesdescriptionisacceptedasinputbyonlineanalysissystems multiplepresentationformats ascii text pdf html rtf preservation friendly non proprietaryformat whyddi3 0 ddi3 0presentsnewfeaturesinresponseto perceivedneedsof datausers dataproducers dataarchivists librariansdevelopmentsindocumentingandarchivingdataadvancesinxmltechnology ddi3 0andthedatalifecyclemodel ddiversions1 2werecodebook centric closelyfollowedthestructureoftraditionalprintcodebooks captureddatadocumentationatasingle frozen pointintime archiving ddi3 0andthedatalifecyclemodel version3 0islifecycleoriented designedtocoverallstagesinthelifecycleofadatacollection pre productionproductionpost productionsecondaryuse lifecyclecoverageinddi3 0 planningforthestudy proposal design studypurpose outlineconceptsstudypopulationauthor s fundingsources version3 1survey sampledesignpre testing lifecyclecoverageinddi3 0 proposalbecomesreality datacollectionmethodology sampling time etc instrumentcharacteristicsquestionnairedatacleaning weighting coding etc lifecyclecoverageinddi3 0 publishingthedata intellectualcontent variables categories codes physicalrepresentation dataformat recordstructure statistics lifecyclecoverageinddi3 0 archiving re distributingthedatacollection processingchecks holdings availabilityandaccessconditions lifecyclecoverageinddi3 0 ddibecomes visible totheoutsideworld ddiinstance pullstogetheralllifecyclestagesacquiresitsownidentityasanobjectbecomesatoolfordatadiscoveryandanalysis lifecyclecoverageinddi3 0 secondaryuseofdata newconceptualframework newddiinstance newpurposenewlogicalproductnewphysicaldescriptionofdata ddi3 0andthedatalifecyclemodel advantagesoflifecycleorientation allowscaptureandpreservationofmetadatageneratedbydifferentagentsatdifferentpointsintime facilitatestrackingchangesandupdatesinbothdataanddocumentation ddi3 0andthedatalifecyclemodel advantagesoflifecycleorientation enablesinvestigators datacollectorsandproducerstodocumenttheirworkdirectlyinddi thusincreasingthemetadata svisibilityandusability benefitsdatausers whoneedinformationfromthefulldatalifecycleforoptimaldiscovery evaluation interpretation andre useofdataresources new extendedfunctionalitiesinddi3 0 questionnaire versions1 2 noinstrumentcoverage questiontextonlyaspartofvariabledescription nodocumentationforquestionflow conditions version3 0 fulldescriptionofinstrumentasaseparateentity documentsspecificuseofquestions flow conditions loops compatiblewithcomputerassistedinterviewingsoftware new extendedfunctionalitiesinddi3 0 complexdata versions1 2 inadequaterepresentationofcomplex hierarchicaldataversion3 0 detaileddocumentationforcomplex hierarchicaldatalogicalstructureofrecordsrecordtypesandrelationshipsrelevantvariables key link caseidentification recordtypelocatorphysicallayoutofrecordssingle hierarchical fileforallrecords multiplerectangularfiles relationaldatabase etc new extendedfunctionalitiesinddi3 0 aggregatedata versions1 2 initiallydesignedformicrodataonlyaggregatedatasectionaddedinv2 1tosupportlimitedrepresentation census typedata delimitedfiles version3 0 addssupportfortabular spreadsheet type representationofaggregatedataaggregatedatatransportoption cellcontentmaybeincludedinlinewiththedataitemdescription new extendedfunctionalitiesinddi3 0 datatransport versions1 2 noneversion3 0 in lineinclusionenabledforbothaggregatedataandmicrodata new extendedfunctionalitiesinddi3 0 longitudinal timeseries cross nationaldatacomparability versions1 2 noneversion3 0 groupingstructuredocumentsstudiesrelatedononeorseveraldimensions time geography language etc aswellastheircomparability new extendedfunctionalitiesinddi3 0 increasedmultilingualsupport versions1 2 limitedversion3 0 supportformultiplelanguageuseandtranslationsgeburtsjahryearofbirth ddi3 0specification schema based versions1 2 dtd basedversion3 0 schema based datatypingsupportsmachineactionabilityuseofnamespacessupportsmodularityextensibilityandreusealignmentwith useofotherstandards ddi3 0specification machine actionable versions1 2 machine readableversion3 0 machine actionable 1 datatyping increaseduseofcontrolledvocabulariesandstandardcodes2 largersetofrequiredelementspredictablecontent amoreconsistentbaseforprogramming ddi3 0 modularstructure version1 2 singlefile hierarchicaldesignversion3 0 modulardesign facilitatesreusefacilitatesversioningandmaintenancesupportslifecyclemodelallowsflexibilityinorganizingtheddiinstancesupportsgroupingandcomparingstudiessupportscreationofmetadataregistries ddi3 0 alignmentwithothermetadatastandards versions1 2 marc dublincore bibliographicstandards version3 0 marc dc butalso sdmx statisticaldataandmetadataexchange iso11179 metadataregistries fgdc digitalgeospatialmetadata iso19115 geographicinformationmetadata ddi1 2orddi3 0 ddi3 0willnotsupersededdi2 1 bothversionswillcoexistcontinuetobemaintainedbeusedaccordingtospecificneeds allddi1 2markupwillnothavetobemigratedtoversion3 0 ddi3 0 structureandmechanisms ddi3 0 modularstructure buildingblocksofddi3 0 modulesschemes ddi3 0 modularstructure modules documentdifferentaspectsofastudy orgroupofstudies followingthedatathroughtheirlifecycle conceptualcomponents datacollection logicalproduct physicalinstance etc schemes includecollectionsofsibling objects thataretraditionallycomponentsofavariabledescription concepts universes questions variablelabelsandnames categories codes ddi3 0 modularstructure modules canliveindependently havetheirownschemas orconnectedtooneanotherwithinahierarchicalstructure schemes canlivesemi independently needahigher levelwrapperastheydonothavetheirownschemas orin linewithinastudyunitorgroupmodule ddi3 0 modularstructure ddi3 0model amulti branchedhierarchymodulelevel ddiinstance resourcepackage group studyunit subgroup studyunit conceptualcomponents datacollection archive organizations studyunit subgroup sub group studyunit ddi3 0 modularstructure ddi3 0model amulti branchedhierarchywithinmodules datacollection questionscheme processing methodology sampling timemethod questionitem questionitem weighting coding ddi3 0 modularstructure relationshipsareestablishedthrough in lineinclusion relationalorderisexplicit referencinginternalexternal relationalorderisimplicit ddi3 0 structuralmechanisms enablemodulardesignandhelpactualizeitsbenefits inheritancereferencingidentification ddi3 0 inheritance inheritanceisbasedonthehierarchicalstructureofthemodel inddi3 0anumberofelementsarereusedatdifferentlevelsofthehierarchy whenthesameelementispresentatmultiplelevels lowerlevelsinheritcontentfromtheupperlevels andonlyneedtospecifydifferences localoverrides ddi3 0inheritanceexample instance coverage spatial 50usstates studyunita nospatialcoveragedefined willbeinheritedfrominstance studyunitb coverage spatial 48coterminousstates supersedesdefinitionininstance ddi3 0 referencing ddi3 0modularstructureisdependentuponcreatingrelationshipsbyreference referencingimpliesbringingupthecontentofaddiobjectwithin orinassociationwith anotherobject byspecifyingitsuniqueidentifier identifiersarethekeylinksbetweenddiobjects ddi3 0 referencingexample datacollectionmodule questionscheme question id q1 text howmanydaysinthepastweekdidyouwatchthenationalnetworknewsontv conceptualcomponentsmodule conceptscheme concept id c1 description exposuretonationaltvnews logicalproductmodule variablescheme variable id v1 name v043014label dayspastweekwatchnatlnewsontvquestionreference id q1 conceptreference id c1 ddi3 0 referencingexample ddi3 0 identification consistencyinbuildingandusingidentifiersisneededfor properfunctioningofreferencesystems enablingasmoothexchangeandreuseofexistingmetadata machine actionabilityofddiinstances allowingthemtoserveasabasisforrunningprogramsandprocesses ddi3 0 identification elementtypesusedintheidentificationsystem ddi3 0 identificationelementtypes non identifiedelements requirecontext whichisprovidedbycontainingparents example codeswithincodeschemesarenotreusable example variableandcategorystatistics ddi3 0 identificationelementtypes identifiablescarrytheirownidmaybereferenced reusedcannotbeversionedormaintained exceptaspartofacomplexparentelement example variable achangeimpliesanewversionoftheentirescheme ddi3 0 identificationelementtypes versionablescarrytheirownidcarrytheirownversion contentchangesareimportanttonote example concept maybeindependentlyversionedwithinascheme ddi3 0 identificationelementtypes maintainablesarehigherlevelddiobjectsarebothidentifiableandversionablecanalsobepublishedandmaintainedasseparateentities example allmodules schemes comparisonmaps ddi3 0 identificationstructure maintainableelements urnand orid identifyingagency versioninginformation versionversiondateversionresponsibilityversionrationaleversionableelements urnand orid versioninginformationidentifiableelements urnand orid ddi3 0 identificationstructurenon specifiedidentificationinformationisinheritedfromthelevelsabove example1 inheritanceisassumed maintainable variablescheme id varscheme aidentifyingagency icpsrversion 1 0identifiable variable id var 1 identifyingagency version ddi3 0 identificationstructurenon specifiedidentificationinformationisinheritedfromthelevelsabove example1 inheritanceisassumed maintainable variablescheme id varscheme aidentifyingagency icpsrversion 1 0identifiable variable id v1 identifyingagency version example2 inheritanceisappliedbydefaultmaintainable logicalproductid logicalprod yidentifyingagency icpsrversion 1 0maintainable variablescheme id varscheme aidentifyingagency version ddi3 0 identificationstructure ids uniquenessofidentifiersisnecessaryforbothinternalandexternalreferencing 1 allidsmustbeuniquewithinamaintainable2 allmaintainablesmusthaveuniqueidsacrossanagency ddi3 0 identificationstructure creatinguniqueidentifiers addiinstancemayincludemultiplemaintainablesatdifferenthierarchicallevels instance maintainable uniqueidwithinidentifyingagencystudyunit maintainable uniqueidwithinidentifyingagencylogicalproduct maintainable uniqueidwithinidentifyingagencyvariablescheme maintainable uniqueidwithinidentifyingagency ddi3 0 identificationstructure creatinguniqueidentifiers instance a uniqueaticpsr studyunit 1logicalproduct 1variablescheme 1variable 1 instance b uniqueaticpsr studyunit 1logicalproduct 1variablescheme 1variable 1 post markup variableid instance astudyunit 1logicalproduct 1variablescheme 1variable 1instance bstudyunit 1logicalproduct 1variablescheme 1variable 1 markup ddi3 0 identificationstructure urns haveafixedstructureandmustincludeobjectid identifyingagency andversion forversionableandidentifiableelements thecontainingmaintainableisspecified takeprecedencewhenbothaurnandtheidentificationsequenceareusedforthesameobject maybeconstructedpost markupfromtheidentificationsequence ddi3 0 identification urnstructure examples maintainables urn ddi 3 0 studyunit ddialliance org studyunit id 1 0versionables urn ddi 3 0 conceptscheme ddialliance org conceptscheme id 1 0 concept concept id 2 1identifiables urn ddi 3 0 variablescheme ddialliance org variablescheme id 1 0 variable variable id objectname identifyingagency objectid objectversion ddi3 0 referencing referencestructure urn and or referencedobject s id identifyingagency version containing moduleid containing schemeid ddi3 0 reuseofinformation referencingmechanismsforreuseinheritancereuseofinformation facilitatesdevelopmentofdocumentationthroughoutthestudylifecyclepromotesinteroperabilityandstandardizationacrossorganizationssavesmarkuptimeandeffortreducestheriskofhumanentryerrorprovidesabasiclevelofimplicitcomparability ddi3 0modules content markupexamples ddiversion3 0modules structuraloverview ddiinstance studyunit group resourcepackage studyunit subgroup studyunit sub group concepts datacoll logicalpr etc other specialized ddi3 0modules aggregatedata ncubelogicalproductinlinencuberecordlayoutncuberecordlayouttabularncuberecordlayoutinlinemicrodata datasetuser specificmarkuptemplates ddiprofile ddiversion3 0modules structuraloverview ddiinstance studyunit group conceptualcomponent datacollection logicalproduct physicaldataproduct physicalinstance archive organizations conceptualcomponent datacollection logicalproduct archive studyunit group comparative ddi3 0 modulesusedtomarkupasimplestudy ddi3 0modulesfordocumentingasingle survey typestudy ddiinstance studyunit group conceptualcomponent datacollection logicalproduct physicaldataproduct physicalinstance archive organizations conceptualcomponent datacollection logicalproduct archive studyunit group comparative ddi3 0modulesfordocumentingasingle survey typestudy reusable xhtml instancestudyunitconceptualcomponentdatacollectionlogicalproductphysicaldataproductphysicalinstancearchiveorganizations ddiversion3 0modules structuraloverview ddiinstance studyunit group conceptualcomponent datacollection logicalproduct physicaldataproduct physicalinstance archive organizations conceptualcomponent datacollection logicalproduct archive studyunit group comparative ddiinstance wrapperforallmodules identificationurnidentificationsequencenamecitation optionaldcelements coveragetopicalspatialtemporalgroup module repeatableresourcepackage module repeatablestudyunit module repeatableothermaterial s note s translationinformation coverageinddi3 0 study americannationalelectionstudy anes 2004topicalcoverage subject historicalandcontemporaryelectoralprocesseskeyword electoralcampaignspoliticalattitudespoliticalparticipationspatialcoverage description unitedstatestoplevel nationlowestlevel congressionaldistricttemporalcoverage date 2004 ddiversion3 0modules structuraloverview ddiinstance studyunit group conceptualcomponent datacollection logicalproduct physicaldataproduct physicalinstance archive organizations conceptualcomponent datacollection logicalproduct archive studyunit group comparative studyunit documentsasingle study identification othermaterial s note s citationabstractuniversereferencefundinginformationpurposecoverageanalysisunitembargoconceptualcomponent module datacollection module logicalproduct module physicaldataproduct module physicalinstance module archive module organizations module ddiversion3 0modules structuraloverview ddiinstance studyunit group conceptualcomponent datacollection logicalproduct physicaldataproduct physicalinstance archive organizations conceptualcomponent datacollection logicalproduct archive studyunit group comparative conceptualcomponent listsconceptsanduniverses identification othermaterial s notescoverageconceptscheme orreferencetoexternalschemevocabulary describesvocabularyusedconceptlabeldescriptionsimilarconceptdifferenceconceptgroupconceptreference nestable universescheme orreferencetoexternalschemeuniversehumanreadablemachinereadablesubuniversesubuniverse ddiversion3 0modules structuraloverview ddiinstance studyunit group conceptualcomponent datacollection logicalproduct physicaldataproduct physicalinstance archive organizations conceptualcomponent datacollection logicalproduct archive studyunit group comparative datacollection identification othermaterial s note s coveragemethodologytimemethodsamplingcollectioneventdatacollectordatasourcecollectiondate s modeofdatacollectionquestionscheme listsactualquestionsinstrument documentsquestionflow conditionsprocessingeventcontrolandcleaningoperationsweightingdataappraisalinformationcoding ddiversion3 0modules structuraloverview ddiinstance studyunit group conceptualcomponent datacollection logicalproduct physicaldataproduct physicalinstance archive organizations conceptualcomponent datacollection logicalproduct archive studyunit group comparative logicalproduct documentsintellectualcontentofdata identification othermaterial s note s coveragecategoryscheme orreferencetoexternalcategoryschemecategorylabelderivation ifapplicable definitioncodescheme orreferencetoexternalcodeschemecategoryschemereferencehierarchytypelevel inthehierarchy codecategoryreferencevaluecode nestable variablescheme orreferencetoexternalvariablescheme logicalproductvariablescheme variable variable orreferencetoanexternallydocumentedvariableidentificationnamelabeldefinitionuniversereferenceconceptreferencequestionreferenceembargoreferenceresponseunitanalysisunitrepresentationimputationderivationcodinginstr