2025数字安全干预之旅：系统化实施路线图

TheInterventionJourney:

ARoadmaptoEffectiveDigitalSafetyMeasures

INSIGHTREPORT

MARCH2025

Images:GettyImages

Contents

Foreword3

Executivesummary4

Introduction5

1

Mappingtheinterventionjourney6

1.1Identification7

1.2Design9

1.3Implementation10

1.4Feedback,measurementandtransparency11

1.5Partnerships12

2

Interventioncasestudies13

2.1Enhancinggamingsafety:atoolkitforparentsandguardians14

2.2Safeguardingyounggamers:atailoredgamingsolution16

2.3Cultivatingtrustinthedigitalage:aholisticapproachtoartificialintelligenceandliteracy18

2.4Onlinesafetyforteens:protectionsandsupervisionfeatures20

2.5AddressingCSEArisks:achatbotfordeterrenceandsupport22

2.6Globalsignalexchange:combatingonlinescamsandfraud24

2.7Cross-platformaction:collaborationagainstonlineCSEA26

3

Interventioncategories28

3.1Technicalinterventions29

3.2Educationalinterventions30

3.3Policy-relatedinterventions31

3.4Behaviouralinterventions3

3

4

TheSMEchallenge34

4.1Thechallenges35

4.2Solutionsandconsiderations36

5

Recommendations37

5.1Adoptaproactiveandtransparentapproach38

5.2Onesizedoesnotfitall38

5.3Ensureinclusivityindigitalsafetyinterventions39

5.4Implementeffectivereportingandresponsemechanisms39

5.5Usereducationanddigitalliteracy40

5.6Prepareforemergingthreats40

5.7Strengthenpartnershipsandmultistakeholdercollaboration40

Conclusion41

Contributors42

Endnotes44

Disclaimer

ThisdocumentispublishedbytheWorldEconomicForumasacontributiontoaproject,insightareaorinteraction.Thefindings,interpretationsandconclusionsexpressedhereinarearesultofacollaborativeprocessfacilitatedandendorsedbytheWorldEconomicForumbutwhose

resultsdonotnecessarilyrepresenttheviewsoftheWorldEconomicForum,northeentiretyofitsMembers,Partnersorotherstakeholders.

©2025WorldEconomicForum.Allrightsreserved.Nopartofthispublicationmaybe

reproducedortransmittedinanyformorbyanymeans,includingphotocopyingandrecording,orbyanyinformationstorageandretrievalsystem.

TheInterventionJourney:ARoadmaptoEffectiveDigitalSafetyMeasures2

TheInterventionJourney:ARoadmaptoEffectiveDigitalSafetyMeasures3

March2025

TheInterventionJourney:

ARoadmaptoEffectiveDigitalSafetyMeasures

Foreword

AgustinaCallegari

ProjectLead,GlobalCoalitionforDigitalSafety,World

EconomicForum

DanielDobrygowski

Head,GovernanceandTrust,WorldEconomicForum

Intoday’sincreasinglytechnology-drivenworld,itisessentialtoensurethatsafetyisembeddedintothecoreofdigitalplatformsandsystems.TheSafety

byDesignapproachensuresplatformsprioritize

userprotection,preventingharmbeforeitoccurs.Regardlessofsize,platformshavearesponsibilitytosafeguardusersbydeployingtoolslikecontent-filteringalgorithms,ageverificationmechanisms

andaccessiblesafetyresources.Asartificial

intelligence(AI)becomesincreasinglycentralto

thedigitallandscape,prioritizingethicsandsafetyinitsdevelopmentanddeploymentiscriticalto

minimizingunintendedconsequences.

TheGlobalCoalitionforDigitalSafetyrecognizesthegrowingcomplexityofonlineharms,rangingfromtheproductionandcirculationofchildsexualabusematerial(CSAM)toprivacyviolations,hatespeechanddisinformation.Ourstrategyisnot

totreateachchallengeorriskinisolationbuttodevelopasuiteofinterconnectedresources.

Eachtoolthecoalitionproducescomplementstheothers,creatingaglobaltoolkitforpolicy-makers,industryleaders,civilsocietyandacademics.

AdamHildreth

Founder,Crisp,Kroll

JulieInmanGrant

eSafetyCommissioner,OfficeoftheeSafety

Commissioner,Australia

OurGlobalPrinciplesforDigitalSafetyandthe

TypologyofOnlineHarmsprovidefoundational

guidelinesandacommonlanguageforall

stakeholders.TheDigitalSafetyRiskAssessmentFrameworkhelpsidentifyrisks,whiletheHowtoMeasureDigitalSafetyEffectivelyreportoutlineskeycategoriesfordigitalsafetymetrics.

Thislatestreport,TheInterventionJourney:A

RoadmaptoEffectiveDigitalSafetyMeasures,

providesguidancefordevelopingeffectivedigital

safetyinterventionstotackleonlineharms.Itcoversthefulllifecycle–fromidentifyingriskstodesigning,implementingandevaluatingeffectivesafetymeasures.Additionally,itincludesreal-worldcasestudiesandexamplesofvarioustypesofinterventions.ByadheringtoSafetybyDesignprinciplesandincorporating

bestpractices,thereportguidescompaniesofallsizes,enablingthemtomanagerisksassociatedwiththeirdigitalplatformsproactively.

Digitalsafetyrequirescollectiveeffort,andthroughcollaborationwithgovernments,industriesandcivilsociety,thecoalitionaimstocreatesolutionsthataregloballyrelevantandlocallyadaptable.

TheInterventionJourney:ARoadmaptoEffectiveDigitalSafetyMeasures4

Executivesummary

Theinterventionjourneyprovidesastep-

by-stepguideforaddressingonlineharms,ensuringsafetyacrossdigitalenvironments.

Withtheincreaseddigitalizationoforganizations

andsociety,alongwiththerisingprevalenceof

digitalharms,itisbecomingever-moreurgentto

combattheserisksthrougheffectivedigitalsafetyinterventions.Thisreportcanprovideaclearer

understandingofchallengesandopportunities,andhelporganizationstoidentifyeffectivestrategies

andcultivatecollaborationandresourcesharing,

ultimatelycontributingtoasaferdigitalenvironmentforallusers.

ThisreportontheinterventionjourneybuildsupontheworkstreamoftheToolkitforDigitalSafety

DesignInterventions,followingthe2023report

ToolkitforDigitalSafetyDesignInterventions

andInnovations:TypologyofOnlineHarms

.

Thejourneyisdesignedtoassistorganizationsin

navigatingthecomplexlandscapeofdigitalsafetyandimplementingeffectiveandsafeinterventions,regardlessoftheirsize.Byevaluatingvarious

interventioncasestudies,thereportaimstooffer

bestpracticesforidentifyingrisks,selectingpotentialinterventionsandcollectingandanalysingfeedbackonthoseinterventions.

Thestepsoftheinterventionjourneyarecategorizedasfollows:

1

Identification:systematicallyrecognizingandanalysingfactorsthatmaythreatenusers,non-usersandorganizationsin

thedigitalenvironment

2

Design:creatingtargetedstrategiesand

solutionsthataddressspecificidentifiedriskstoeffectivelymitigatepotentialharmtousers,non-usersandorganizations

3

Implementation:executingtheplanned

strategiesandsolutions,engagingstakeholders,providingtrainingandmonitoringtheprocess

4

Feedback,measurementandtransparency:collectingandanalysinguserandstakeholderresponsestoevaluateeffectivenessand

impact,whilecommunicatingfindings

Adheringtotheinterventionjourneyensures

astructuredapproachtodefiningobjectives,

exploringsolutions,assessingoutcomes,balancingcosts,integratingsafetymeasuresandevaluatingeffectiveness.Collaboratingwithpartnerscanhelporganizationsavoidpitfallsandsolveproblems

moreefficiently.Throughopenengagementwithkeystakeholdersandsharingofbestpractices,

solutionsandtechnologies,partnershipscan

significantlyenhancetheimpactofanintervention.

Recognizingthatnotallorganizations,particularlysmall-andmedium-sizedenterprises(SMEs),havethecapacityorexpertisetoeffectivelyexecuteeachstephighlightstheimportanceofpartnerships.

Improvingdigitalsafetyisacooperativeeffortinwhichcollaborationbenefitsallstakeholders.

ThisfifthGlobalCoalitionforDigitalSafety

publicationwasdevelopedwithinputfromits

multistakeholdermembers,includingplatforms,

regulators,safetyproviders,non-governmental

organizations(NGOs),academicsandinternationalbodies.Theirinvolvementinshapingthereport

underscoresasharedcommitmenttoimprovingtheimplementationofdigitalsafetyinterventionsacrosssectorsandadvancingeffortstomakethedigital

spacesaferforall.

TheInterventionJourney:ARoadmaptoEffectiveDigitalSafetyMeasures5

Thereportguidesreadersthroughadetailedroadmap,illustratingthe

criticalstepsand

considerations

involvedin

developingand

implementing

effectivedigital

safetyinterventions.

Introduction

Inacomplexdigitalworld,proactiveinterventionsprioritizesafetywhilenavigatingregulatorydemandsandoperationalchallenges.

Thedigitalenvironmentischaracterizedbyalargevolumeofevolvingonlineharms,necessitating

solutionsthatarenotonlyadaptableandcurrentbutalsoproactiveandforward-thinking,capableofevolvingintandemwiththethreatstheyare

designedtomitigate.

Inthiscomplexlandscape,amultifacetedapproachisessential–nosingleinterventioniscapableof

addressingthevariedmyriadofonlineharms.Thenatureofdigitalharmissuchthatitdefieseasy

categorizationorsimpleremedies.Eachinterventionmustbecarefullyevaluated,weighingitscostsagainstitsbenefitswhilealsoconsideringitseffectiveness.

Digitalharmlacksadefinitivesolution.Thefocus

shouldbeonmitigatingrisksbeforeharmsoccur,

whilerecognizingthatsomelevelofriskwill

alwayspersist.Interventionsindigitalsafetycomewithinherentcoststhatextendbeyondfinancial

expenditure,impactingareassuchastime,user

experienceandfreedomofexpression.Asaresult,itisessentialtocarefullyweighthesecostsagainstthepotentialbenefits,suchasincreasedsecurity,

privacyandusertrust,andtheprotectionof

fundamentalhumanrights.Companiesmustweighthegravityofactualharmfromseriouscrimessuchaschildsexualexploitationandabuse(CSEA),sincesuchprotectionisaninternationallyrecognized

fundamentalright.

Interventionsindigitalsafetyarebroadand

encompassbothtechnologicalandnon-

technologicalmeasurestoeffectivelyaddressthecomplexitiesofonlinethreats.Inallapproaches,

measuringandanalysingdigitalsafetyinterventionsiscrucial.Itisalsoessentialtoconsiderhowwidelytheycanbeadopted,theirsuitabilityforproviders,theeaseofimplementationandoveralleffectiveness.

Interventionsareincreasinglyshapedbyevolvingregulatoryframeworks,includingAustralia’sOnlineSafetyAct2021,theUnitedKingdom’sOnline

SafetyAct2023andtheEuropeanUnion’sDigital

ServicesAct.Governmentsandinternational

organizationsareadvocatingforstrongermeasurestoprotectusersandvulnerablenon-users,andholdplatformsaccountable.

However,detaileddisclosuresabouttheinner

workingsofdigitalsafetytoolscouldbeincreasinglyexploitedbymaliciousactors,whomightusethis

informationtobetterbypasssecuritymeasuresormanipulatesystems.Inthiscontext,thechallengeliesinbalancingtheneedfortransparencywiththenecessityofmaintainingsecurity.

Smallercompaniesoftenfacechallengesin

implementingeffectivedigitalsafetyinterventionsduetolimitedtechnicalexpertiseandbudget

constraints.Thismakesthesharingofinformationandbestpracticesbetweenplatforms,suchas

throughpartnerships,crucialforaddressingtheglobalandinterconnectednatureofonlineharms.

Thisreportisdesignedtocompileabroad

spectrumofdigitalsafetyinterventions,providingcompanieswiththeinsightsneededtoenhance

theircapabilitiesinidentifyingdigitalrisks,

preventingharm,mitigatingimpactsandfacilitatingrepairintheaftermathofincidents.

Thespectrumofinterventionshasbeen

organizedintofourtypes,withmanyinterventionsintersectingwithmultipletypes.Thosetypesare:

technical,behavioural,educationalandpolicy-relatedinterventions.

Thereportguidesreadersthroughadetailed

roadmap,illustratingthecriticalstepsand

considerationsinvolvedindevelopingand

implementingeffectivedigitalsafetyinterventions.

Theobjectiveistoprovidevaluableinsights

andpracticalrecommendations,specificallyfor

SMEs.Thesharingofbestpracticesanduseof

partnershipscanhelpthemtodevelopanddeployrobustsafetymeasures.

TheInterventionJourney:ARoadmaptoEffectiveDigitalSafetyMeasures6

1

Mappingthe

interventionjourney

EmbeddingSafetybyDesignprinciplesthroughoutdevelopmentcreatesresilient,adaptableinterventionsthataddress

evolvingdigitalsafetychallenges.

TheInterventionJourney:ARoadmaptoEffectiveDigitalSafetyMeasures7

demands.Additionally,themappingensuresthatbothshort-andlong-termconsiderationsare

wovenintothedecision-makingprocess.

Theinterventionjourneyshouldbeseennotasalinearprocessbutasaseriesofkeyconsiderationsthatguidethedevelopmentofinterventions.

Theprocessisoften–andsometimesshould

be–iterative.Thesestepsinthejourneyarenotexhaustivechecklistsbutratherbroadstagesthatincludeexampleconsiderationstohelpinform

decision-making.

Theimplementationofaninterventionisajourneythatmustbemappedtoidentifyandaddressthe

challengesandrisksthatcouldariseateachstageofitsdevelopmentanddeployment.Bymapping

thejourney,valuablelessonscanbelearnedtohelpanticipateobstaclessuchastechnicallimitations,

resourceconstraintsoruseradoptionissues.Thisproactiveandpreventivestrategy,actionedateverystageofthejourney,followstheprinciplesofSafetybyDesign.Thiscomprehensiveapproachnotonlyensurestheintervention’seffectivenessbutalso

aidsinrefiningandadaptingittomeetevolving

1

FIGURE

>

IdentificationDesignImplementation

>

>

Feedback,

measurementand

transparency

Interventionjourneysteps

1.1

Identification

Itisnecessarytoidentifyriskfactorsspecificto

anorganization,includingcharacteristicssuchasservicefunctionalities,userbaseandbusiness

modelsthatcancontributetopotentialharm.Sincethereisnoone-size-fits-allapproachtomanagingrisk,differentriskcategoriesmaybemorerelevanttocertaintypesofplatformsorservices(e.g.

socialmediaplatformsversusdatingapps)orin

specificgeographicregions.Riskfactorscannot

beassessedinisolation,asthelevelofriskmaybe

affectedbythecumulativeimpactofmultipleriskfactors.Knowingandunderstandingwhycertainriskfactorsexistcanhelpinprioritizingrisks.

Theidentificationandmitigationofdigitalsafety

risksshouldbeachievedthroughcomprehensive

riskassessments.Thecoalition’sreport,DigitalSafetyRiskAssessmentinAction:AFrameworkandBankofCaseStudies,introducesariskassessmentframeworkdesignedtoguidethisprocess,asoutlinedinFigure2.

TheInterventionJourney:ARoadmaptoEffectiveDigitalSafetyMeasures8

2

FIGURE

Theidentificationjourney

Identifyrisk

Howareriskfactorsidentified,

categorizedandprioritized

(includingbasedontypeof

service,userbase,geo-location

anddatastorage)?

0

Reducerisk

Whatpolicies,safety

mechanismsandproactive

workflowsareimplementedto

reducetheriskofharm

happeningorproliferating?

Governance

Whatorganizationalapproachesand

accountabilitymechanismsarein

placewithrespecttodigitalsafety?

Howiscontinuousimprovement

4

1

incorporatedtofuture-proof

theapproach?

Howistheorganizationensuring

theallocationandmaintenanceof

dedicatedresources/budget?

Report

Whatmechanismsare

implementedtomeasureand

monitorharmonanongoingbasis

andfixsystemicproblems?

Whatmetricsarerecorded?

Howarereportsusedto

drivechange?

2

Mitigateharm

Whatmechanismsareinplace

toreportordetectharm,and

whatdecision-making

frameworksandenforcement

workflowsareimplemented

tomitigateit?

Repairharm

Whatmechanismsexist

torepairharm(including

post-incidentresponse

managementandappeals

mechanisms)?

3

Source:WorldEconomicForum.(2023).DigitalSafetyRiskAssessmentinAction:AFrameworkandBankofCaseStudies,p.7.

/publications/digital-safety-risk-assessment-in-action-a-framework-and-bank-of-case-studies/

.

toolsandrulesdesignedtopromotethe‘safeuse’oftheirservicesinamannerthatmitigatesharmtovulnerablenon-usergroups.”1Asorganizationsdevelopandimplementtheseassessments,itiscrucialtoensuretheyareintegratedacrossthe

entireorganizationalfootprint.

Riskassessmentsmustaccountforthediversedemographicsthatmaybeaffected,including

bothusersandnon-users.ThisfollowstheGlobalCoalition’sguidancethatdigitalsafetyincludes

preventingharmtonon-users:“Onlineplatformscanalsobeevaluatedbasedontheirprocesses,

TheInterventionJourney:ARoadmaptoEffectiveDigitalSafetyMeasures9

BOX1

Identification

Keyconsiderations

–Whatarethegeographic,culturalorregulatoryfactorsthatcouldinfluencerisklevels?

–Whichgroupsorsegmentsaremost

vulnerabletotheserisks,andhaveindividualswithlivedexperiencesbeenconsulted?

–Whatfunctionalitiesorservicesintheplatformmaycontributetopotentialharms?

–Whatpreviousincidentsorpatternsofharmhavebeenencountered,andwhatweretheircauses?

–Arethereanyexternalfactors,suchas

ecosysteminfluencesoroff-platformrisks,thatshouldbeconsidered?

–Whatresources,partnershipsortoolsareavailabletohelpaddresstheserisks?

1.2

BOX2

Design

1

2

Whendesigningdigitalsafetyinterventions,userprotectionshouldbeapriorityfromthevery

beginning.TheprinciplesofSafetybyDesign

ensurethatprotectivemeasuresarewoveninto

thefabricofaproductorservice.Thisapproachhelpspreventpotentialharmsbeforetheyarise

butalsoreinforcesusertrustbyembeddingsafetythroughouttheentiredevelopmentprocess.

Itisalsokeytoembedsafetyintotheculture

andleadershipofanorganization,cultivating

accountabilityandaimingtocreatemorepositive,

civilandrewardingonlineexperiencesforeveryone.2

ThethreeprinciplesthatSafetybyDesignisbuiltuponare:serviceproviderresponsibility,user

empowermentandautonomy,andtransparencyandaccountability.

Serviceproviderresponsibility:Requiringorganizationstotakeproactivestepsin

anticipatingandmitigatingpotentialrisksbeforetheyimpactusers

Userempowermentandautonomy:

Providinguserswithclearage-appropriate

optionsandcontrolsovertheironline

experiences,enablingthemtomakeinformeddecisionsabouttheirprivacy,securityand

interactions,anddesigningfeaturesandfunctionalitythatpreservefundamentalconsumerandhumanrights,includingtherighttosafety

3

Transparencyandaccountability:

Involvingopencommunicationaroundthe

risks,processesandpoliciesassociated

withadigitalproductorservice,allowing

userstomakeinformedchoicesandaccurateassessmentsofwhatisworking

Accountability,ontheotherhand,ensuresthat

organizationsareresponsibleforthesafetyoftheirplatformsandtheirimpactonusersandvulnerablenon-usergroups.3Eachprincipleencompasses

multiplestepsthatorganizationsshouldtaketopreservesafetyduringthedevelopmentprocess.

ImplementingSafetybyDesignprinciplesisnot

withoutitschallenges.Onesignificantobstacle

isthepotentialconflictbetweensafetymeasures

andotherbusinessobjectives,suchasmaximizinguserengagementorrevenuegeneration.For

example,strictersafetycontrolsmaylimitcertain

functionalitiesthatarepopularamongusers.

Additionally,embeddingsafetyfromtheoutsetcanberesource-intensive,requiringsignificantinvestmentinresearch,developmentandongoingmanagement.

Despitethesechallenges,theimportanceofSafetybyDesigncannotbeoverstated.Byembedding

theseprinciplesintotheverycoreoftheir

operations,organizationscannotonlyprotecttheirusersbutalsobuildamoreresilientandtrustworthydigitalecosystemwhilecontributingtobrandsafety,adrevenueanduserretention.

Design

Keyconsiderations

–Istheinterventionscalableandadaptabletofuturerisksorgrowinguserbases?

–Istheinterventionaimedatprevention,mitigation,detectionorresponse?

–Howcantheintervention’sdesignbalanceuserprivacywithsafetymeasures?

–Arethereinternalresources(e.g.staff,technology,expertise)todevelopandimplementthedesiredintervention?

–Howwillusertrustbebuiltandtransparencyaroundhowtheinterventionworksensured?

–Howwilltheeffectivenessoftheinterventionbeevaluatedovertime?

1.3

BOX3

Implementation

Aprimaryconsiderationinimplementingan

interventionisthealignmentwiththeorganization’soveralldigitalstrategyandgoals.Thisinvolves

ensuringthattheinterventionisnotonlytechnicallysoundbutalsocompatiblewiththeorganization’sculture,valuesandexistingprocesses.Scalabilityisanothercrucialfactor,asinterventionsneedto

beadaptableacrossvariousplatforms,userbasesandgeographicalregions.Integrationwithexistingsystemsisalsoessential,asnewsafetymeasuresmustworkseamlesslywithcurrenttechnologies

andworkflowswithoutcausingdisruptionsor

inefficiencies.Overcomingresistancetochange

withinanorganizationisakeychallenge,as

employeesandstakeholdersmaybehesitantto

adoptnewpractices,especiallyiftheyrequire

significantshiftsinhowtheyoperateorinteract

withtechnology.Addressingthisresistancethroughclearcommunicationandtraining,andinvolvingkeystakeholdersearlyintheprocessarevitalactions

forensuringsuccessfulimplementation.

Resourceplanning,theallocationoftimeand

budget,andaccesstoskilledpersonnelcanalso

significantlyimpactthesuccessofdigitalsafety

interventions.Organizationsmustallocatesufficientresourcestonotonlydevelopanddeploythese

interventionsbutalsotomaintain,measureand

updatethemovertime.Budgetlimitationscan

restrictthescopeofwhatcanbeachieved,leadingtodifficultdecisionsaboutwhichsafetymeasurestoprioritize.Timeconstraintscanalsobeasignificantchallenge,especiallywheninterventionsneedto

beimplementedquicklyinresponsetoemergingthreats.Theavailabilityofskilledpersonnelwho

understandboththetechnicalandstrategic

aspectsofdigitalsafetyisoftenlimited,making

itdifficulttofindandretaintheexpertiseneeded

toeffectivelymanagetheseinterventions.Properresourceplanning,therefore,involvesacareful

balancingactofensuringthattheorganization

canmeetitssafetygoalswithoutoverextending

itscapabilities.Digitalsafetyinterventio