贝叶斯网络结构学习的信息论下界

27 016on 47906we of We as as a of of (m),m is of in of of in is to be at l lm, of ( We we as a we on of in is a of as a In a a of as a of as a in a to or of of in of of be to be A of of a a 9 14. In we on of of an of as We in of (m), m is of in We of of is m, O( We on of in to 10 1of is as In we we on we by in of 8 78 7 of a is of of in of In do of 8 to at k is to 113 in 4 is in 15 a do to of a a 2on of of we 6, is of of a of we to of ,m X1:m = . as ,m =1,.,m 1:m) =( 1), ( = p(in ,m Xi|i i is is ,m,l of of is at l, l is:(| l m/2a “f ,m (,m,l), at i.i.d = x(i), x(i) is on is f . In we in of f, is to In we to we of m F,m m,l F,m,l, of by of In we of m, m,l, is by as m =3,.,m 1:m) = ( ( X3:m)(Xi)2) Xi|i 3:m = ., a to m. in is to ( f,S) is a of of in is in of we s 5to of to We as . a f at we a of ni.i.d of f. . p(pi)= p( pi, 3,.,m24 . . . : A in m,of 1 is 4X3:pi pipi,c 0 we a) F = m if of n 0. We = (yi, of j N(j,1). 1 j| 1. w , w. we a) | p if of n (p2)6at , p( 1/2.(b) | k p/2 if of 6 at , p( 1/,p = m 2, y = 2 p(3:m) = p(3,.,Xm as .,in 12 we i i,1), 3 i We on of ( If i n, Xi i i,1) =in( y,1), i) we ) i)3 im, i = i/m) 3 im, 1 i we . 3,.,m we X3:pi pito to is to 1 is by . a f F i R i m. we ni.i.d of f. f a of a) F = m if n m42e , at , p( f f) 1/2.(b) F = m,l if n m2)2e , at , f f) 1/we of a is by i ) ( 3 im)p(=1 = 01 0a = (yi, of w , w. we a) | p if of n (p2)6at , p( 1/2.(b) | k p/2 if of 6 at , p( 1/,p = m 2, y = 2 p(3:m) = p(X2)3,.,Xm as x = ., in pi pi10. 0 on 1of we 1is we by we of be = i, i 0, i = 1. as of 1, to 1 as 1|( (),5() is a of , at . i 1,.,v i. 3,.,m of () ) we X3:pi pi. a f F is by 1,.,v i m. we n i.i.d of m f. f a of a) F = m if n (v +m3/2)b) l m/2 (v +l)l(m2) we on of We of of of to in of to of a An is to of of be of P. D. . in 2005.2 E. . A of 12121, 2013. 3 J. R. J. D. n 2002.4 D. . 2002.5 T. . 2nd 2006.6 S. of 29(2165180, 1997.7 N. . On of of in 74282. 1996.8 of 783. 1993.9 D. . 009.10 A. Y. L 1 L 2 04, 8, 2004.11 P. C. N. . 1. 2 M. J. in 55(12):57285741, 2009.13 B. e e 231997.14 Y. A 2007.15 O. S. . On of to of a . X,Y = p(X,Y) X,Y =q(X,Y) be X = p(X), q(Y), = p(X|Y = y) X|Y =q(X|Y = y). we X,Y X,Y ) =EY L(PY Y ) (3)to : (KL pi pim12pi| 1|= 12 212 1|i + 1|2|+1|2 pi| 1|pi| 1|+|4we :