Automatic word clustering for text categorization using global information

110004a of a on of as we a to of it of is of is of is to a of A of 1112. A to or of or of or is or or on To to on or to to or a 04 004 0/0004 .$is is So to be in a is of so to 2 3. is at is 2310. by to we to on of a In we by s In to of a as of of in as we We a We s it It of of is of a a we at to of in 10. 2 an on as to in a to it be to a in F we . we we it as In a we (as we wt f. of is = P( P(P(P( P(P(P(1)we a wt a be a is = P(f)= P(P(f)P( P(f)P(P(f)P(2)we to of to is to do L by wt ws is (, is P(3)L It is it is p(is In a L to to we it It is (P(D(P(+ P(P(D(P( (4)a L it of in s so or of is in it t of in we a f n s a be an We f fi fj). fi 1000 fj or We i = P(f)P(f)+P(D(P(+ P(f)+P(D(P(= (15) P(f)P(f)+P(D(P(+ P(f)+P(D(P(= (16), if a is to a to to So of f _fi is to fi f i2 is is 1is of fi is f. We i 0 (7)So we f , f be we of If we - of - . 2 as of a) ).(b) -1 c) d) an of : t to we a a fi a fj N(N( N(8)(of in is of be of to in In it if of in ow we a is s . we s as we is of we 2 We ) we -1 is is So of is . in to a to we of If in be as we a on we We y in 9. is to to of a is a d we of as ( ) = P()P( j)P() P( ) (9)P( ) = P(P()(10)(is is is of in F is is , 5 10 20 50 100 200 500 1000 2000 5000: s is in (a a in cj be is by () = 1+ (11)5. we to is a is to 1 to of we F1 is by : 2p (12)r p It in a C 7 41. 8 7 of (8m/4,459 We do of We 4 We 2). we we on 2 of s 3: S we to we in 00 of is , : we of 10%, 50%, 100% of 10, 100). we 5 10 20 50 100 200 500 1000 2000 5000: 2 of of of fs x2 2fs df of we of in of 50 of fs x2 100 of we of 100 000 In fs x2 fs df 000 fs x2 00 0 of of fs x2 fs is it 0% 00 or we of we 10 0 It is 0%fs x2 fs To it is of 00 we In in of So it we a So it on a it of is of is