2026企业生产级智能体开发部署指南白皮书

37

41

42

43

44

47

48

49

50

](Summary)

6YëJ**wsee,@tïa7J+iIüf‹%‹°—aü9ï?':J1PBË»€‹6zÄ*€a@*Èe.@aÈl=aü«—1JÉ.ü.ä*,aïaP:Ai@ê€ïaBzÄJtïata,eü:‹°TÉt9ÄêC?J,nÜBo>!—ByÈÏÏÄë"4TT4T"%zféf6Ë.

ïltJbt9Z;B9@eË2ï1*t%/\RÄ&(ÄB.'b»€.fiG.€6. );ï1StLLM-as-a-Judge%ïïïGt—'fiiÈ

@,VIIIAgent-basedEvaluation&J @iT'@/’) o

»xa-szafv*i«ät'••-«••taüesaaaa»ssüz,a.w«a»Jezea¿aamei‹a‹

hH”psï//gitfïub.ëöm/aws;-”gärnjaÈës/särnp[ë-ëväE-firgt-bziitdfrig-eritërprise-ägëf1ts-.wfth-agèïstcore

Eva ati

本报告来源于三个皮匠报告站（

）,由用户Id:1181721下载,文档Id:1283472,下载日期:2026-07-30

(EMEA›APAC@AMER)$8¥/(@ YYYY-QN,pJto2024-qs).'

t8‹v›&x&zs:ssh *s?›T s1,si8T,Gsl1ñ«ix ,‹si8fial,sñHi8is«&

getQuarterlyRevenue@T@getData

region:string(EMEAIAPACIAMER),quarter:string(YYYY-QN)

(revenue:number,currency:"USD",period:string}

% iT+/£% 404,#&%T%i°503

15

9a %—TT6eEvaluation-firstA\£1IN 6 *ñA1›% 66 fJ6661T T= ltJ1ñfl.

/aws-samples/sampleevaIfirst-buildingenterprise-agents-with-agentcore

20

Ø&(White-Box) Who

24

æ )öaÎs@fEæxŒÎ7CJo ï1/2@Ï-i@f>^‹*:.@z@/BtûÎû)ftùLLM-as-a-Judge,

»4%@=fiyaiv°a=aïï°n•firstÊï£ÉœÄÄGëB%æSŒ,”a#681sï#BaYæBn9JÏ1u:.

.https://gitIiüb:co”m/aws-säinpl’ës/s’arzsp.le•ëval-first-”büflding-”erit"èrprisè•ä§ents-With-ageritcorë"

34

)gJgFoundationModel

@ÎAgentComponent

Agent@@@Ï$:Æ@i,^,g!].Ø@@ìßîZØ.LLMfiØ¥1łÑ@.I@@f9

T)BEnd-to-End

37

Goa[Success:i%/ [—)i+ìä*+AtTFfi0

•ResponseRefevarice:@Ått3Ż Ø%

•GoaIAccuracy:—Sgroundtruth@ ćË

•ToolSelectionAccuracy@

•ToolParameterAccuracy:

-W

7¿T

@8?@

Z@

IE@

•TootCallErrorRate:

•Multi-turnFunction

@C&@§2@CallingAccuracy:

@

tdC(Memory)

•TopicAdherenceRefusal:7¿@1 @@\g

•TopicAdherenceClassification:high1=r

(Muíti-turn)

&$Ê

a,CoT@1xR71Tef0z& @6Um

Z

•GroundingAccuracy@@@$EJ@.

)'ßïfi(Reasoning)

—/@@(Responsibility&Safëty)

•CollaborationSuccessRate:TD@W+fl

gij Cf9J

•ŸBuff ?ñ(Multi-AgentSystem)

aSa%a6"baoQ1e71Tx",tA&aRKPia6"bt€sJJ8@a7a".

@@$g- LLM(1 ):Goalsuccessrate

as -$J§ifb/ LLM(3 ,groundtruth@@@§]j):TrajectoryExactOrderMatch,

TrajectorylnOrderMatch.TrajectoryAnyOrderMatch

aTrace*&LLM(11C)Coherence.Conciseness,ContextrelevancesCorrectness.Faith-fulness›Harmfulness.Helpfulness.Instructionfollowing.Refusal,Responserelevance›Stereotyping

• - LLM(2 )'Toolselectionaccuracy.Toolparameteraccuracy@ )e (TopicAdherence›ContextRetrieval,Multi-turnFunctionCallingAccuracy,Planning/Commu-nication/CollaborationScore@)@Amazon@“$tE@@]@,J@ C i$($@@ttli‹

LLM-as-a-judge(a judge@ )eJ.JCschema);

40

@ xci:xi‹saw‹a::m‹symaan‹xnyaet.›‹,saea.ee.ae.sano«.

&5iaATs SMs@ :1 OGa,.°.6E@sEM&a‹tYTJ&fiw'—TetéeBa\b

»^@B@%@,B4)aTrfi1=QZé(/tJZ.

ToolSelectionAccurac

y

95%

ParameterExtraction

Accuracy

98%

RefusalAccuracy

]O0O/v

ResponseQuality

LLM-as-JudgeUI!]

Latency

P5O•2s,P95«5s

CostperQuery

T@«5,000tokens

43

tTt3T OpenTetemetry/OpenlnferenceU Strands.LangGraph@C,r@ trace@ U.

$g —@ @@LLM-as-a-Judge@C t1U,@&iTfi!i@@jE§@,@ helpfulness.correctness.faithfu[ness.goalsuccessrate.harmfulness.toolselection/parameteraccuracyC @›CD]bJUgi

BNa—9 BEvatuation-fima2saboa9@9sSZ,a#6869es@YC@aPi«R:

/aws-samples/sample-eva\-first-building-enterprise-agents-with-agentcore

45

:Amazon

@

”W@m

API

Z

onboarding

ToolSelectionAccuracy(@ E@) ToolParameterAccuracy(@)fifth@@ )Multi-turnFunctionCallingAccuracy(@@

ttérfa+B›4a."ttaaI6›aBA»snP

47

AgentCoreEvaluatiohs;é,wAHowitworks(EvaluationsJ

Evaluatiohtypes(Online/On-demand/Batch)Evaluators(built-in+custom)

Buitt-inevaluators/l2,w

Built-inevaluatorsprompttemplates(1d ;&@)Customevaluators(LLM-as-a-judge)

Customcode-basedevaluators(Lambda)Onlineevaluatioh

On-demandevaluation

BatchevaluationDatasetevaluation

/bedrock-aqentcore/latest/devguidedevaluations.html

/bedrock-agentcore/latest/devguide

/how-it-works-evaluations.html

/bedrock-agentcore/latest/devguide

/evaluatIons-types.html

/bedrock-agentcore/latest/devguide

/evaluators.html

/bedrock-agentcore/latest/devguide

/built-in-evaluators-overview.htm1

/bedrock-aqentcore/latest/devguide

/prompt-templates-builtin.html

/bedrock-agentcore/latest/devguide

/customevaluators.html

/bedrock-agentcore/latest/devguide

/code-based-evaluators.html

/bedrock-agentcore/latest/devguideConfine-evaluations.html

/bedrock-agentcore/latest/devguide

/on-demand-evaluations.html

/bedrock-aqentcore/latest/devquide

/batch-evaluations.html

/bedrock-agentcore/latest/devguide

_ /dataset-evaluation_s.html

_ _ _ _

Simulation

Prerequisites(IAM/ADOT)Encryptionatrest(KMS)Optimi2ation;, (preview@/6)Optimization—HowitworksOptimization—Recommendatiohs

Optimization—Configurationbundles

0timi2ation—A/BtestingObservabifity:

Observabifity—BOX/BE.,„(ADOT/TransactionSearch)

/bedrock-aqentcore/latest/devguide

/simutation.html

/bedrock-agentcore/latest/devguidedevaluations-prerequisites.html

/bedrock-agentcore/latest/devguidedevaluations-encryption,htrnl

/bedrock-agentcore/latest/devguide

/optimization.html

/bedrock-agentcore/latest/devguide

/optimization-how-it-works.html

/bedrock-agentcore/latest/devguide

/optimization-recommendations.html

https://does.aws.amazon.oom/bedrock-agentcore/latest/devguide

/configuration-bundles.html

/bedrock-agentcore/latest/devguide

/ab-testing.html

/bedrock-aq