大模型时代知识图谱赋能高血压智能诊疗实践

DataFunSummit

2024§tłî

NDCDSSDHGEIHH-KG<v

ŽŽŠ_Ê.”*

:-•“:ÛełeFun.NQETR-RulesMat—Rules02DataFunSummit

2024FLEXTFLEXTPDATRRulet

R

les(b)

OFETH

Zuricheducated

atAtben

Einsteineducated

atUniversity

of

ZurichQ11942A.Triple-based

factsQ9S7Q206702()ETH

2uricheducated

atP69"”””

””

””

””

””

””

””

””

””

””

””

”*‘,!ACademic

degree

{PSI2):Bachelor

@787674,

)Albert

EinsteinMathematics

(Q853077}[1}Duni

G,Hnfiumg

E,

Runng

Z,

&

aL

Cliniml

dmisimsupporyt

for@jmtemion

medication

based

m

lmnu4edge

grapb{Jj.Computer

ldetbods

and

Programs

iii

Biomedicim,

2022[2j£lalkui

M,

TrivN

P,

Maheshuari

G,

ctat.

Mmsage

basing

for

Hjper-Relational

Rnnu4edge

£Iraphs[C].

EfdNLP,

2020.educated

atUniversity

of

ZuFiCh;

Academic

major

(P812):i

PhysicsModelTransE0.0850.0310.1020.204ST-KGE

Ro:mE0.3620.2930.3900.495TuckHR0.4050.3500.4290.501AttH0.4160.3480.4480.539HINGE0.1090.0620.1320.198SLKGEStarE0.3800.3210.4040.479GRAN0.4220.3430.4600.571}OIE0.6030.5350.6450.773DtKGEH

erICAIL6920.6260.7360.798DHGEw/oGE0.4920.3800.5600.695DH-KGE

DHGEw/oHGA0.6620.6270.6750.702DHGEw/oJL0.4280.3320.4680.613DHGE0.690tL6370.72611TPDTR—RulesMat—Rulesrelation

I’query

V9qfeaturelogicIjI

Iquery

Vgafloquery

VgfoSelf-AttentionqueryVt(g)

f

1

gquery

V9e

9b**UnionjogjcSelf-Attentionqpgry

Vgq%g¿featureInterseciionLQ

X

ct

al.

:Feature-logic

embedduig

framework

fxa

‹xuoplex

knowledge

graph

reasmiiog”.

art,

2023.DatasetModelip2p3p2i3ipiip2uupAVGGQE53.915.511.140.252.427.519.422.311.728.2Q2B70.523.015.161.271.841.828.737.719.040.1FBl5kBetaE65.125.724.755.866.543.928.140.125.241.6ConE73.333.829.264.473.750.935.755.731.449.8FLEX77.137.431.666.475.2S4J42.452.934J52.4GQE35.27.45.523.635.716.710.98.45.816.6Q2B41.39.97.231.145.421.913.311.98.121.1FB237BetaE39.010.910.028.842.522.412.612.49.720.9ConE41.812.811.032.647.325.514.014.510.823.4FLEX43.613,111.134,948,427.416,115,411.124.6GQE33.112.19.927.335.118.514,58.59.018.7Q2B42,714.511,734,745.823.217,412.010,723.6NELLBetaE53.013.011.437,647.524.114,312.28.524.6ConE53116113940050.8263175153113272FLEX57.816.814.740.550.827N19.415.611.628J11111111L@

et

a1.

“Flm:

Feønire-logic

einbedduig

frømework

før

complez

knowledge

grøph

reasoning”.

øre,

2023.Se

te!•)

•e

'

Who

has

co

'ered

songs

for

which

Michac!

Jocksoi\

received

or

was

nominated

for

aGrammy

Av

ard

fur

Sung

cf

the

Yc‹\r,

and

the

songs'

contributor

to

the

¿uilar

zulu

part

is

not

Eddie

Van

HaIcn?(b)

N-ary

FOL

Query:g

=

Y•,

3Y

(P{3firheni

Jerlson,

otuard

rereiued,Grnmmy

A•••rd

/or

Song

o/

the

Peor,

for

u›or1,

P)

v

P{3fic?ienf

Jorlson,

nominated

jfor,

'rrnmmp

Atunrd

/or

Songo

f

thel'eor,

/or

â,

P))

A

@

Y,contributor,

2fddie

Per

If

ofen,

opptiez

toyrf,quitoronto)

f\

F‘(Y,

per/ormer,

Y•,

hue

quofifp,

cover

uereion)Grammy

A»ard)£œ

Song

oF\rte

YeatSong

of

ffic

Year

O

.,

‹Edd

ic

Vàn

HalcnOOrNm\VeezerA'*‘o’

oodeslolermediete

nodcs'Ifirgct

nodesDe

la

f'3oH''*

AosH’er

selN-azyProjmtiooLogic

OgeratorHaihENNHł

p2pă

iModel|

AVGp

AVGq

|Ip

2p

3p

21

3łStarQE-I

p

StarQE

NOE-1»6t477°9426.83

6.79

ì

9.72

56.16

74.35

39.81

9.6230.98

44.13

52.96

63.14

83.78

71.52

55.204&35

48

*5

59

79

70

90

8555

7769

ó079ip2•upup 2cp

3¢p

|

2ln

3ln lnp

pin

piJpł

ip

2uWD5I1K-QEI-47.69

SßJ1

61.92

76d$6

9t%

8*32

6OI6ł'łodeH-only3

I.32\

2.104&72

3L87

3153

46,30

77.82

59.70

29,49

14.93

24.38

33.68

43.OP7.7842.98

2ß.09

7.79

8.64EdgeH-only29.0512.214L96

30ć0

30.6ì

37.76

63.77

47.83

27.14

1b.03

24.59

32.75

42.688.3639.05

20.71

7.73

8.44Logic-blind32.927.7549.92

34.09

35.26

51.03

90.72

65.55

30.72

I

3.66

22.95

37.15

48.183.544ß.25

14.31

2.95

5.74Unparalleled33.4†I2.4554.8

i

34.33

34.4†

49.22

84.56

63.05

3I

.98

14.'76

26.14

38.73

49.51ï.7943.89

2ß.02

8.22

†.65NOE-

I»3°

80I*

5653

75

23

52

34

97

46

9fi

80

2*

60

8ô

35

89

13

95

25

13

37

21

50

809

In45

99

19

45

7

86

7

91NQE3&8714.ΓSS

NI

37.04

36

6

53.10

95.90

68.IS

2•t72

1&66

27&

40.08

51.26

111.92

48.67

H14

8.91

9.67Luo,

Hay

Bnihong

E,

ct

al

,

2023Var.RankQuery

AnswersPro.Cor.Ans.1Primetime

Emmy

Award..78.359cNEasyUi2Golden

Globe

Award..1.399aF-3Screen

ActorsGuild

Award..1.159aNEasy1The

West

Wing67.46%NEasy22Edie

Falco3.079cF-3My

So-Called

Life1.75%F-1Allison

Janney42.38%NEasy2Stockard

Channing12.24%NHardVJ,qpj3Mary

Steenburgen7.029oF-4Janel

Moloney5.32'7oNHard5Downton

Abbey1.97'7oF-Query

Sentence

(2cp):Wliu

was

nominated

ior

the

az'ard

that

K

iitherinc

I

Rei

zl

(

KI

I

)

receivedfor

tired's

An‹ii‹›n

(tiA),

for

the

work

which

Allison

Jannex

(

AJ)

was

nominated

for

ti‹›l

Glen

tilt›bc

A›xiird

ti›r

i3est

Actress

(ti£iAi3.1)

for?N-ary

FOc

Query:q

——

V›,

2Vi,

Vz

P[Katherine

Ileigl,

award

received,

Vi,

Jor

w‹xrk:,

Creg‘sComputational

Graph:”’*’Lu’o*,’H’a*o’ran’,*B’

a’i*ho’n”g

E,

ct

a1.

“NQH:

N-try

Query

Embedding

for

Complex

QumyAnswering

over

Hyper-Relational

Knowledge

Grnphs".2fòr

wo

k,

2023.Temporal

Complet

Querybe_elected_as(François

Hollande,

President

of

France,

T

)

A

Aller(T„

T,)nstep_down_1rom(Franvois

Hollande,

President

of

France,

Z’

)

A

Before(Z’„

Z’,)

rimnke_a_visit(Xi

Jinping,

Yy,

T,)

A

make_a_visit(Barack

Obama,

Yy,

P,)Computation

Grayhe¡

:

Francois

Hollands

ri

:

be

elected

ase-s

Fmn9ois

Hollande

r2

:

°*°p

dnwn

frome2

:

President

of

France

e;

:

Xi

Jinping•4

:

President

Of

France

eg

:

Bnrack

Obamare

:

make

a

visit*4

:

Luke

a

visitP

(V„

P,

V,)'

9(MLP(V

+

r

+

Vt))P

W„

,

r,

V„)

=

(MLP(V„

+

r

+

V„))i=li=l*e(

‹))Before9ie

2

'

21+

q 1

—

q¡2

2AfterttiaT3«-«»i«iar*«ai8i8$x,

iSel«»i«&sti$tüi«K8SsoTDatasetMetrksavQuer}'2box2S.0óBefaE37.19ConE4I.94’T'FLMã6.79X(ConE)40.93FLM41.67X•1FSó.89X•lo@c56.64aves,36.6944.8850.8242.1544.4149.7851.

I7org,17.3616.4118.778.03ICEWS

14ICEWS05-15

"

'.^'AVGavg,AVG30.

629.4930.2628.34°•21.5443.0254.3736.3744.3854.0545.3628.6926.4027.7023.3924.262

I.6924.412Í.9533.?22?.5433.9829.869.6714.7518.4419.6017.8319.Œ17.9217.3611.1512.6713.5212.3413.3512.1312.115.383.I65.495.756.313.936.506.866.206.967.587.417.446.926.916.716.356.596.80$<

„.E"

"°'19.9526.4736.3735.7435.2423.4629.2537.7334.4836.3934.6826.2424.0728.0426.36avg28.0326.6529.3128.óJAVG3'L9330.1336.4335.9824.0031.3340.9348.9936.2938.9649.9044.8029.7043.5246.

f738.

j242.

IO46.I

|41.92'4.394.4l4.433.29befo,,after6.176.17ó476.64Timestamp

{0=20S4-1-1.

36S=2014-12-31)9.328.178.868.9204DataFunSummit

2024.•“:ÛnlnFun.m.01

l4vpvq]

govemmenbgovemmentyosition

held.appointed

by]

m.0fm2hm.07m2nlU]

emment ition

held.office

holder]

m.0fm2hm.0fpy4*2]

emment sitron

held.office

holder]

m.0fm2hPrevious

Retrieve-†hen-6enera†e

KBQA

FrameworkQuestion:

What

is

the

most

predominan

re

io

n

thecount

en

amln

an

olds

a

govemmentaRelation

Itetrieval:Benjamin

Netanyahum.05p3vsklocation.statistical_region.religionsm.06bvppTriple

(or

Subgraph)”Retrieval:*

*

*

"(JOIN

(R

location.religion

ercentage.religion)(ARGMAX

(JOfN

govemment,govemment sition

held.office

holder

m.0fm2h)location.re1igionyercentage.percentage))InStructi0ll

Tuning(LIama-2-7B,

ChatGLN2-6B)Open-sourceLLMs(LoRA,

§LoRA,

P-Tuning

v2,

Freeze)Fine-TunedLLMS

forSemanticPafSlfi§wro

plays

ken

barlowcoronation

street?Output(JOIN

tR

ti

.

rcy

u

lii

r

Is

ii

ppeii

riiiict.iictur)

(Aft

D

tJ

OIN

ti

.

reg

ulvr

1*

ii

ppcr

riiri

ce.Unsupervised

Retrievalfor

Entities

&

RelationsUpdated