+ All Categories
Home > Documents > University of Cambridgesvr- · 2005. 8. 9. · H2:;>=KOZ2:B=^OZ2:BVF5B

University of Cambridgesvr- · 2005. 8. 9. · H2:;>=KOZ2:B=^OZ2:BVF5B

Date post: 30-Jan-2021
Category:
Upload: others
View: 0 times
Download: 0 times
Share this document with a friend
132
Transcript
  • ������������������ ������������������� �!��"���������#"���������� �%$�������� "&������'����(�������

    )�*,+.-0/�13254768+.*,4:9=@?*(A>BA>A>BE*,4:F�GH*(;JI:=KG%1,A>A>B=.=.B�+WOX*(O.;>134Y=ZI5Q5P0;>O.O[BD,B�+W=.;>OW_71(`aGH*,P0Q5+W;>F5L,B`b13+%OZ2:BVF5B

  • � �����������

    ����

    �H2:;>=HF5;>=.=.B�+WOZ* O.;>134Y;>=HOZ2:BV+WBOH1(`eP_ 1��K4��%13+.-0*,4:F7;J4:9=HOZ2:B^13I:O.9134�� B��:9

  • � � � � ����

    �H2:;>=KOZ2:B=^OZ2:BVF5B

  • � ��� � ��� ����� �� � � � �

    6 ; + =.O)��� �%13I:A>F�A>;J-(B O.1YOZ25*,45-�P_�=ZI5N B�+WD3;>=.1:+ M O.BF5;J4:L�OZ2:B +W;>L32�O]Q5*(AJ*,4:9O.;>9=ZP *,4:F ` +WB9�I:A *�+�� � *,PL3+.*(O.BX` I:A ` 1:+aOX2:B]=ZI5N5N 13+WOK2:B]25*(= L,;>D,B�4�P0BV1(D,B�+fOZ2:BV_�B�*,+W=%;J4 �K25*(O[B;

  • � � � � ��� ���

    � ����������������� �R!�JR M N5B134Y1(`,�H)�) d *,+.*,P0B9EG%1:B�� 9B�4,O[=H����������������������������������������������������� RE

    I JK�1�32/�*��L/�;�1;>=Z*(O.;>134Z������������������������������������������� R�S"%�JR!��7 M 2:13+WO � O[B�+.P )�13F5;�' B=[�������������������������������������������.7!&"%�JR!� D ?VB�4:B�+.* Ag;>=.B_3=.;>=S�������������������������������������������.7!&"%�JR!� T

  • D

    � JN2;����� �1���< ��M��S���/�8���';� Q �P��� I*�� � $��$�+T+��1+ "%�*� �(+��? V/� �;$(����� I��T%�JR �%*(=.;>9Ed *,+[*(A>AgBD,B0*,4:F�G 134,D�1,AJI:O.;>1345*(A 1H1�;g=[B ����������� ",S

    T%� D %a*,+W;J*(O.;>134:= 134YOZ2:B])�;>=ZP * O.9 2Y68I54:9134^������������������������������������������� D &T%� D � R UV13P *(;J4Y1(`,1 1,;>=.B�0^F5F5;>O.;>134%����������������������������������������������� D &T%� D ��7 )�*(OZ+W; ���$��* =.B9EG%1:B�� 9B�4,O[= ������������������������������������� D RT%� D � " G%134�O.;J43I:1:I:= � �%;JP0B]UV_545*,P0;>90G%13B��Y9=.O.;>9�*(A U]*(OZ*���������������������������������������������� D "T%�'$ 1H1:4�� �bO.B�+.* O.;>D,B]d )�G\��������������������������������������������������������������� D3T

    T%�'$%� R 1KI5P B�+W;>9�*(A � 4,O[B134 ��������������������������������������������������� D $T%�'$%��7 #81,L��$1 13+.P!*(A 0@N5N5+W1��:;JP *(O.;>134 ��������������������������������������������� D ET%�'$%� " #81,L�� 0^F5F/0VN5N5+W1��:; P!*(O.;>134_������������������������������������������������� D C

    T%�FE �bO.B�+[*(O.;>D,B]d )�G ������������������������������������������������������������������� D3ST%�FC 4 =.O[; P!*(O.;>134Y1(` OZ2:B]G%134�D,1,AJI:O.;>1345* AA1H1�;g=[B]G%13P N 134:B�4,OZ��������������������������� T5RT%� S G%13P N:A>B����$1H1�;g=[B 4 4�D:; + 1345P0B�4�O.=9��������������������������������������������������� T!"T%�JR)&�da+.* 99�*(A�� P N:A>B�P0B�4�OZ*(O.;>134:= ������������������������������������������������������� T�D

    T%�JR)& �JR M N5BO.;>D,B�1 1,;>=.B ����������������������������������� $`EE%�'" OZ2 0^F5F5;>O.;>D,BE*�4:F�G%134�D,1,AJI:O.;>1345* A 1 1,;>=.B ������������� $,SE%� D UV;>=.9�I:=.=.;>134 ������������������������������������������������������������������������� E87

    � �-'($�+ �;$(��8� � � �5$ QS�P��������P�3�.�>�(��46�1O.;>D,B�1 1,;>=.B�� G%13+[+.I5N:O.B

  • D3;

    C%�'"%� D d )�G 134Y)�*(9O.;>D,B91 1,;>=.B�� G%13+.+[I5N:O.B=.B ����������������������� C`CC%� T UV;>=.9�I:=.=.;>134 ������������������������������������������������������������������������� S5R

    X �-'($�+ �;$(��8� � � �5��2;� �S4���� �(X�X � ,4 Q � � ,./�P&!� ��� X �S%�JR �H2:B �&*(A>A M OX+WB$ $;�*��R�(+8�>$ ���R�(+8�>$�" ��� 7;$(����� ����� �R�1���'($(��8� ����M "D�*+��� ���$� ��$(�>��� $;�<<��$;�)�>���W��7�� Q �P3?^$�+ "%$�././� �;7 ���!�

  • � � � ��� �

    � � � � �

    R!�JR ?VB�4:B�+.* A =XN5BO.O.;J4:L =[OZ*(O.BV2:;>F5F5B�4�)�*,+[-(1(D P01:F5BO.B]2:;>F5F5B�4�)�*,+.-(1(D P01:F5B1345*(A %^;gO[B�+.Q:; F5B134� F *(=X2:B1,O.= 1(`��.9O.;JN:A>B]P0; �:OZI5+WB^9134:=

    =.1,A>;>F:��� 4:1�;g=[BEP0B�*,4;D ����������������������������������������������������������� "�D

    T%�JR �H2:B]Q5*(=.;>90N5*,+.*(A>A>BB=.BYOZ*,-(B�4�` +W13P OZ2:B 1;-�� M54@6 � S87

    F *(OZ*,Q5* =.BS��������������������������������������������������������������������������� $!"$%� D #81,L�� M N B

  • D3;>;>;

    E%��7 0KD�B�+.*(L,B�!C#743I5P0Q5B�+ `b13+ 9B�*,4��,UV;J*(L,1:45*(A3*,4:F06 I:A>A599=.B0*(O�� $(F:� ����������������������������������������������� $`C

    E%�'" 0KD�B�+.*(L,BB!C# 4:I5PEQ B�+!` 1:+ OZ2:B�d )�G 1^I5P0B�+W;>9�*(A � 4�O.B134 *,N5N5+W1��:; P!*(O.;>1349

  • � � � ��� � ��� ��� �

    "%�JR UV;�� B�+ B�4,OK4:1�;g=[B]9O.;>134�+WB134:=%`b13+H4:1,;>=.B0P *(=Z-�;J4:L0` I54:9134 �����������������.7!$"%��7 da+W1:Q5*,Q:;>Ag;>OW_YF5;g=[OZ+W;JQ5I:O.;>134:=K*(=[=ZI5P0B134:=K*,4:F7P *(=Z-�;J4:L

    ` I54:9

  • C%�JR,R ��13+WF B�+.+W13++.*(O.BD,BE4:1�;g=[B�� 9

  • �3;

    S%�'$ ��13+WFYB�+.+W1:+a+.*(O[BO.B

  • � � � � �

    �� �

    �H2:B^` 1�AgA>1��H;J4:L74:1,OZ*(O.;>134725* =KQ5B

  • � ��������� �

    � �� � � � � �

    ����

    � 4:9�+WB�*(=[; 4:L�Ag_!�H* = OZ2:B;gBF�*,N5N:A>;>9�*(O.;>134:= �%=ZN5BOE;>= 4:1,O0N51,=.=[; Q:A>B7O.1�9= P * _�+WBO0; 4�* =.B�+W;>13I:= P0;>=ZP * O.9 2 Q5B

  • 7

    ����� �������

    ���������������������?V;>D,B�40*H=XN5B=OZ2:B013Q:=.B�+WD,B=]OZ2:B *�� N5+W;>13+ ;aN5+W13Q5*,Q:;>A>;>O _�1(`�*7N5*�+WO.;>9�I:AJ*,+��1:+WF7=.OZ+W;J4:L �,$A � � % � �%;>=HOZ2:BEN5+ 13Q5*,Q:;>A>;gOW_71(` OZ2:B13Q:=.B�+WD,BD,B�47OZ2:B]* 99P013F5B=)� *,4:F �� ;>=0OZ2:B 2�_ N 1,OZ2:B=.B

  • "

    RecognitionAlgorithm

    Models

    SpeechRecognised Hypothesis

    Lexicon LanguageModel

    Acoustic

    6 ;>L3I5+WB R(�JR�� ?VB�4:B�+.* A =ZN5B

  • D

    �H2:B P01,=[OV9_&I:=[BL3+[*,P ),� "���� Q:;>L3+.*�P ), 78�V*,4:FI54:;gL:+.*,P ), R*� A *�4:L3I5*(L,B]P01:F5B=)�

    ����� �������

    ���������������������&� ������� ��� �� ������� � ��� � � ��

    �bO 25*(=EQ B

  • T

    Channel Difference

    Speech

    +

    +

    Additive Noise

    Corrupted Speech

    Convolutional Noise

    6 ;>L3I5+ B R!��7�� M ;JP N:A>;�' B=.O.1:+WO.;>134!` +.*,P0B��%13+.-

    �K2:B�+WB 5 ��$� ;g=YOZ2:B7O.1�OZ*(AH*(F5F5;>O.;>D,B�4:1�;g=[B�*,4:F ; ��$�0;>= OX2:B�9O.;>D,B4:1,;>=.B�9134 R!� T�;>=7*(A>=.1�9

  • � ��������� �

    � � � ��� �� � ��� � � ��� � � � � ���� ��� � ��� � �� � � � � � � � �

    6 13+c*(A>A5OZ2:B �%13+.- F5B=HOZ+[*(;J4:B;>BL32,OfO.13N 1,A>1,L,_];>=H4:1���D3;J+WOXI5*(A>Ag_!=.OZ*,4:F *,+ F *,4:F ;>Oa;>=%OZ2:BH1:4:BKI:=.B= �%13+.- �:OZ2:13I:L32YOZ2:B]4:I5P0Q5B�+ 1(` =.OZ*(O.B

  • E

    Non Emitting State Emitting State Allowed Transition

    2 3 4State 1 5

    6 ;>L3I5+WB�7 �JR�� 0 " � B�P0;>O.O.;J4:L =[OZ*(O.BV2:;>F5F5B�4�)�*,+[-(1(D P01:F5B134:=�*,+WB�N5B�+.P ;gO[O.BO.;>134�1(` OZ2:BVOZ+.*�4:=.;>O.;>1347P *(OZ+ ; ���5;>O.=HBB�P0B�4�O.=VP0I:=.OH13Q B=^OZ2:B^`bB�*(OZI5+WBVD,B=.OZ+W;JQ5I:O.;>134�;>=VQ5*(=.B=.9�+WBA>B=.9�+WBO.B�+�45*(O[;gD�B1347;>=^9=.OZ+W;JQ5I:O.;>134:=%9134�� �K2:B�+WB

    � $A

    � � WR*� � �7%� D��

    0KA>Ac=.OZ*,4:F *,+ F/�H)�)�=K*,+WBF5B=.B

  • C

    4:134�� B�P0;>O.O.;J4:LV=.OZ* O.B

  • S

    � 4:;>O.;J*(A>A>_�134:A>_�OZ2:B0=.;JP N:A>;�' BB P01:F5BAaQ B B�� *�P0;J4:B134 =.B��5I:B�4:9=KF5B�' 4:B�>� : �;� �7%� S���K2:B�+WBVB�*(9=V*,4 5 � F5; P B�4:=.;>1345*(A D,B=VL,;>D,B�4�Q�_�=ZI5P!P0;J4:L71 D�B�+H*(A>AeN 1,=.=.;JQ:A>B N5*(OX2:=VOZ25+W13I:L32 OZ2:BEP 13F5BO.;>134 1(`EOZ2:B&�H)�) *,4:F OZ2:B�; 4:F5B�N B�4:F5B�4:9�B*(=.=ZI5P N:O[;g1:47N5+WB13I:=[Ag_�F5BO.B]2:;>F5F5B�4�)�*�+.-(1(D P01:F5B_�*0=[; 4:L�AgB P01:F5B

  • R)&

    ����� �"��� � � � � � ����� � � � � ��� � ����� ����������H2:B `b13+ �H*,+ F�� Q5*(9 -(�H*,+WF�*(A>L,13+ ;gOX25P ;>= *,4�B��Y9134�=.B�� I:B�4:9

  • R,R

    ����� �6 ��� � ��������� ��� � � � � � � ��� ���

    �H2:BaB134V1 ` OZ2:B�N5*,+[*,P0B134N5+W13Q:A>B�P � �H2:B OZ*(=Z-;>=aO.113Q:OZ*(;J4 *C=.B=.BOZ25P0= � ;>=VOZ2:B0)�*��:; P0I5P #8;J-(B;J2:131:F )�# �%9�+W;>O.B�+W;>134��V6 13+H*!) # B1 �%B=W` _ 9O.B�+W;J*�� R)"!� �R!� �H2:BV1:Q:=.B�+WD * O.;>134:=@*�+WBH` +W13P OZ2:B]*(=.=ZI5P BA>_ 1(` F5;>=.OZ+W;JQ5I:O.;>134:= �7%� �H2:B]* =.=ZI5P0BA>_71(` F5;g=[OZ+W;JQ5I:O.;>134:=V;>= � ��BA Q5B�25* D,B=%O.1013Q:OZ* ; 4!OZ2:B^=.BB�P P!*�_0Q5B^F5B�*(A>O �H;>OZ2 * =�*V=[OZ*,4:F *,+WF P0I:A>O.;�� F5;JP0B�4:=.;>1345*(Ac13N:O.;JP0;>=Z*(O[;g1:4 OZ* =Z- � �H1����B1345*(A>;>OW_&1(`%OZ2:;>=EN5+W1:Q:AgB�P 9F5B�+VOZ2:B O[1,OZ*(A 43I5P0Q B�+V1(`KP0B�*,4:= � D *�+W;J*,4:99�*(O.;>134 1(`HOZ+.*(;J4:;J4:L � )�)�= � OZ2:;>=];>=09_�+ BX` B�+.+ BL,1:+W;>OZ25P �FC!� ��H2:B��%*,I5P(� � B

  • R*7

    F5B=��H;>A>A BAg_�+WB

  • R)"

    �K2:B�+WB0R�� � � , *,4:F�R���� � , � � 2:BKOZ+[*,4:=.;>O.;>134:=%` +W13P *,4:F O[1EOX2:B@4:134�� B�P ;gO[O.;J4:L =.OZ*(O[BO.;JN:AgB09O]*,+ BKL,;>D,B�4 ;J47OZ2:B�� �+! P!*,43I5* A � R)&87!� ������ �������

    ����������������������� � �"� �

    �H2:B N5+WB13I:=0=.B

  • R�D

    P01,=.O9_�I:=.B= O[1�=.B1347N5B�45*(A>OW_!������ � � � � � � ��� �*� ���� �"�� 4�=ZP *(A>A^D,1:9�*,Q5I:AJ*,+W_�=[_3=.O[B�P0= OZ2:B�Q5*(=.;>9�P01:F5BAg;J4:L I54:;gOY`b13+!OZ2:B � )�) ;>=7OZ2:B#�%13+ F�� 6 13+P0BB�� �%13+WF P01:F5B=)�2�HB�4:9=4:B

  • R�T

    F *(OZ*%�c)�13+WBB= �%13+.-!1(` OX2:BV`b13+.P

    �� �� �� ( &(� T�D � &(� D $ 9

  • R)$

    I:=.;J4:L�* =.B=HOZ2:B^` +WB�� I:B�4:9

  • RE

    U]*(OZ*V*,4:F P 13F5B=HP * _ *(A>=.1EQ B@P *�N5N5B=.B=.B0OZ2:BVB�4:B�+WL�_ 1(` OZ2:B]+WBL345* A 13+%B�+.+ 13+��

    �& 2 *

    � � 5 � �7%� D8D ��K2:B�+WB

    � 5 � D� 5 � � ��1�2 � � 1 � 5 ��5� �7%� D3T8�*,4:F7OZ2:B]B�+[+W13+f;>=KOZ*�-(B�4Y1(D,B�+fOZ2:B��H;J4:F51�� 1(`c; 4�O.B�+WB9�I:A * O.B

  • RC

    �H;>AgAfF +W13N���� 171 D�B�+W9=]N5+W13Q:A>B�P � F5_545*,P0;>909

  • � ��������� �

    � � ��� � �� � � � � � � � �� � � � � � � � � � � � �

    0 =XI5Q:=.OZ*,4�O.;J*(A *,P013I54�OV1(`��%13+[-�25*(=]Q B=E*,N5N5+ 13*(9=EO[179 2:1:1,=.B =XN5BD,BK*,4:F:)(1:+ 91345* A 4:1,;>=.BH*,+ B�P0;J4:;JP *(A ���HB�4:9

  • 7!&

    ;g=C` 1:I54:F�O.1�*(;>F�OZ2:B +W1:Q5I:=.OZ4:B9EF5B;>=Z*(O.;>134�� OZ25*(O%;>=K*V=ZI5N B�+W=.B=HOZ2:B^L,B�4:B�+�*(A>;g=[B1,L:*,+W;>OZ25P0;>9V` I54:9134 � D E �(C`E�� �K2:B�+ B

    � � �� ��5���� � � ��5� � ��R*� �#� � & � % � % � RA>1,L � � ��5� � � � & "%�'"��

  • 75R

    �H2:B@P B;>=.B=L,B�4:B�+.*(A>;>=.B= �'"�D��8;g=%=.;JP0;>AJ*,+fO.1Ag;J4:B�*,+%N5+WB9134YO[B=;g=!OZ2:B�4 O.B�P N 13+.*(A>A>_&' A>O.B�+WB

  • 787

    ����� � ��� � ��� ������ ���6 ��� � ���������� 4:=.O.B�* F�1(`e+ B_�4:1,;>=.B�� + 13Q5I:=.O^=.B

  • 7!"

    �K2:B�+WB� � , ��5� �

    ��V � 4 ��1�2 * �

    � � 1 � �� 4 �5���� "%�����$��������������������� '����������� ���"!#�%$�� ! � �&�'(�)�+* '($�������'($��,$�-.$�'%����/0� * ��'(��� �+��* 1��$2�3��������'($��'.����#$�'%��!4'(5�����6/7�3���'($�����"!4* '($0���3�,$8��$09:'(���;�3���'($4���* 51+ O �%���1����%��$0��9�6'(���I����� '4���3����Rb&����0H�H���'(�3* k��[)5Y� ��$w� �����$���� ���'����%e[������=* '(�;H���$���3�I�B'�$./0� * ��'(�&�f9m��$�* ���'($2'39g��* '����DzG5�'�'(e#��$0����!%a�����&�����9:���3�����6���H��3* �`&��B�^�3-(�[��$#5Y�=�H�������$0��' �1��� -%�'($�"Rgb&���* '(���6� * ���'($1/%� * ��'(� a('��&���%H�H��,$�-�a�+�3-(�3�,$1����%��$0�C9m��'(��������� '����[����R¡ J����^* '(��H����D�3���'($��3�%�'(�[��'39W� I���,���3���,$�-�����g$�'%���\�0$���*_��%$�$�� ��������'(�6���'($�'($0zm��,$��\�^��-(sa�����/7�%���'(����%H�H���'3����;�3���'($�=�%����$�'(�I���3��!Z���� �JR�b&�� ����������5��;�B���0��$%��9:'(�����3* 4$�� `l$�'%���* '($�������'($sag`E�B�D����#D�%����H���'�5��B���)��3�����#tgu�v��� *_�$��n����%R ¡ ��������'($��3��!%aC����?�I� *_�$��n����`��[�H��6���;�%����!.��� /%� �'(HY� �#9:'(�C* '($0/%'%�,�����'($��3�¢$�'%���=`&���#�)�B'3`£�[�����B�I�B/0�?$�'%���f* '(��H�'�$���$%��Rdi:��H����{9:'(�����0$�* ����$2��-(.�3��������/%��$�'%���f* '($�������'($����3+$�'%�+5Y� ��$#� /3�3�,���3��� �JR

  • |���'������ $�+,� +,� "�� �9 � /0$'&(�*� ),��� � �����) � 78�*� +¡ $

  • |%}�'� �'��� ������� �! � � 2�! �*9#9#��13� � / ��& +,�*+,��13�b&����D�3�e#'[9E�[���%H����,$�-�#�� �f'39+��'(��� ����'4�.$�� ` �[* '(������*1��$%/��,��'($�����$0�����"!Z5��#��� �,�3��� �

  • | �`+������ � 6 �^����\�����0$=�%$�� � 6 �^����d���,�3-%'($��3��* '3/7�%�6���0$�* �\���3�D����'39�����\5��,�3"R bE���H��0���%��� �����6�%���1� ����,���3��� �

  • | 'xC'($��JR ���,�3��� �C�������?� ���3�:R �E'%�,��� � � � M � � M: O * � � * � � O � M � � M: O * � � *6� � O � M � � M: O * � � * � � O� � � M�� � M: O * � � *6� �B O ���,$JM � M & � *DU)*6� �B O�O * � M � � M: O * � � *6� � O (dM�� � M: O * � � *6� �B O� ! � Md� � M: O *�� � *6� � O � M & � *DU)*6� � O (dM�� � M: O * � � *6� �B O � � M � � M: O * � � * � � O � M � � M: O * � � *6� � O � M � � M: O * � � * � � O � � M � � M: O *�� � M: O *6� �B O � M � � M: O * � � *6� � O � M � � M: O * � � * � � O ! � MC� � M: O *�� � M: O * � � O � M & � *DU)*6� � O (dM�� � M: O * � � *6� �B ObN�%5���Q�R�| !.tg��'�5��%5���B���!w���������,5������'($�4�3�����)� �w9:'(��/7�0���'(��o$�'0�BI�Z* '�$����B�I�B'�$�.�%$�� ���[�e%�,$�-9��$�* ���'($�

    �������$09:'(���;�3���'($4�"/7�3��,�%5�����,$2������H�� � * saN�'3`C� /%���E�B��`&�3�9'(��$��4��'1-%�/%��-%'�'(�HY���{9'������%$�* �%aH��%�����*����,�%���!89'(�F�'7` ��$�����-0!�H�� � * w��� -%�'($�"R ¡ �������$��3���/%� �!%ad�,$�� ��-%� `E�B* e.�[�B-0'(�������`+������=�D��='(5�����6/7�3���'($o9�[�B�=5Y��$����3��#�D��?$�'%������ /%� �:a$�'%����,$�-?���"!�5��&��� ����* � �#�%5�'����^����&�HY� � *_�'0������¢����%$f��g�\5Y� �'7` ����&$�'%���%a��'=��*��������,�3���/%�H���'(5��%5�����G!2�+���� �JRb&�� ��;��� *_�$��n���� ��%�����%H�H���� �w��$�����rs'%-[zG>�H�� * �����[�g��'(���[��$sR ¡ ���[�e%�,$�-2�*_����)���,$����Zv^x&x ��'(���[��$ ��}%���N��3+5Y� ��$.�,$0/%� ����-(�[��� �#`&���#�,��H��6'7/0� �.��� * '%-($�����'($2H����{9:'(�����0$�* �%Rb&��+�;�3�e0��$�-���� * �$��nW��� �������B���=�f/%���6!?I���;H��B�=�)'(��� �s'39J����&�,$0�����{9:�����,$�-�$�'%�����'(����* �%a����������%$

  • | b&��#�B.�6�D9�����6� � �I'k�3.>�H�� � * �%$�� 1&'0�BI�ZV�� * '���H�'%I�B�I�B'�$ �]�%U��;M:>51EV O '(� ¡ ���%H����/%� 1E'%���tg��'%�I'%��!WHY� �J�%}��GR�b&��F9'(�I� '39g�D��?'�����H����AH��6'(5��%5����B��!p9��$�* ���'($8��3A$�'3`5�� ��$�[�B�I����� �#9m��'(����������%$����0��� ==�%��I��,�%$1���������,5������'($����'1��`C� �B-�%��� �#D��� '39^�G`C'�==�0�����,�%$1���������,5������'($�"R

    Observations

    Model 1

    Model 2

    v^�-(�����=Q�R,S ! Q7zm�����)��$���'($��3���+�������5��¢��� * '������¡ g��g�&$�'%�\HY'%���,5������'�e($�'3` �7zGH����'(����`���B* ;����3���C'39J�����$�'%������'���� �~�%$���`���B* 1����[���C'39����C�H�� � * ���'���� ���g��'%��¢���e[� �B!1�3� �6� * '%-($�����'($f���,���%a%��^�g$�� * � ���0��!=��'��,$%�D��'(����* �E����C* '($�* ��H��'39y�;Q"zm���,����$���'($��3�����������5��¢��� * '(�����*���%U��GR0�&���6�%a���$�� ` /7�%���,�%5����� ��� � M�� O �B��,$%�D��'(����* � �Jas`���B* �B���� #~$�� �Z�[� ��� � M�� O^ �;�3�

    ������� � %�M �� * ��� M�� O * � ;� M�� O *�� 8 1 O � M:Q�R]|�� O`+�������� ��� � ������f�� �+'[9\�3��gH��%�����,�3�NH��[���+'[9g�B��$�-0���� S%a����������H��3��#�D���'(��-(25�'%��2�����H�� � * .�%$��2����=$�'%������'(��� �:RCb&���9:'%��B'3`&�,$�-#��� *�������'($p�A���� �� ��� � M�� O^ �;�3 � � � � � M��¢wS O � � �� � � � � M � M�� O�O M:Q�R]|%} O`+�������� ��� � M�� O �B�����1���3�������� ��'%�,$%��H���'(5��%5������!'39�5Y� �,$�-�,$4����3�I� � � '39\����;�H�� � * k�)'(��� ��%$���I���3���� ;� '39J�����$�'%������'(��� �J�3�d���,�����g�%$���'�5������/���$�-;����&�� n�����$�* � � M�S O ��' � M�� O R^b&���3��B'3`&��������B�I��H��������[���=$�'%���?�)'(��� �J�I')5Y�=���I��/0������ �JRb&���������'(�¢�����"`+5��[*_ef'39N�D��BC��� * �$��nW���f�\�D��3�\�3-��3�,$sa('3`&�,$�-���'���������3��%H�H���'3��,���3���'($sa��������3���#�������5����)'(��� ��� �w�,$����1rs'%-3zG>�HY� * �����3�d��'(���3�,$saJ`���B* 8�B��� �f* '(��H��3* �f����%$4����xC��H�������[�N��'(�;�3�,$sR=4'(��� '3/%��� a����3* 2'39g������ �������$0��='39C����f9���[��������/%� * ��'(�E�=�3�����)� ���'#5����$�����HY��$�����$%�f�,$#����=rs'0-3zG>�H�� * ���I�3�J��'(���[��$sR

    ������� � !#"���� � � � ���� %$ �� � '&)( �+*��"'&"�����Z'0�������3���Dzm'[9 zm����DzG�0�����H�� � * ��� * '0-($�����'($ �!(I�����������Zx���H�������3�&H��%�I�%��� ������"a\�3����� I�Z�%�����'(����* '(��H��[* �=�%$����������,�3-0'($��3�^* '3/7�%�6���0$�* ���3�����;H����'($4��'(�����0H�H���'(H����,�3���%R�>51EV �%$������������'(�����!.'39C����#���3�e0�,$�-.��� * �$��nW��� ��%���15��3�� �'($8rs'%-3zG>�HY� * �����3�&H��%���0��� �������R�i�=`C'(����w5��H����D9���I�%5���?�I'o�������* '���H���$���[���'($2�*_����)�=����3�E�B=�0H�H��B�*��%5���1�,$.�D��?xC��H���D���3�J��'(�;�3�,$sR+u�$�����*_;��'(��� �]zG5��3I� ���* ������&�C���D9���I��� ����'=�3g0!WHY'%���� ���� � " �B��$���� #���������,$�-��%$�����3g5�� ��$1���� �`&���.5Y'%��1V�!�$��%���*DzGbC�,���Dz "k�%�IH���$�-kMV=b0" O 5��3�� ���,S�U�� �%$�� �E42zG5��3�� � ��� �N��� * '0-($��������Rb&��#�3�,�'39+�D��B;��� *_�$��n����.����'4'(5��D�3�,$w�%$�'(H����,���[�B #���������I'Z* '�$%/%���6�?�D��#* '(������H���� ��H�� � * �,$%�I' * ����%$ �HY� � *_sR �E������D��Z'�H����,���3� #�������1�.*��3�*����,�3��� ��,$ ����krc��$����0�{zG>�H�� * ���I�3�

  • |%���'(���3�,$1�%$����C'(H����,���[���,$#������3��C�n����%��� C���$�I�%RNv'(�^�D��+*��3I�+'39J�,$�����H���$�����$0���3��������/%�=$�'%������� #�������&�

    � � � ) �� M:Q�R]| � ObN���0$��9'������,$�-�����0#�������E�,$%��';����?rs'0-3zG>�H�� * ���I�3�N�%$��#�����$2xC��H�����I�3�s��'(���3�,$#!��� ����a M: O^ M � M: O �H�� * �����[�N��'(�;�3�,$#� ����,���[��� �a � g�%$�� �� �%����� �H��B�* ����!4� ����,���3�I� �#9m��'(�j����������[��$��,$�-1���3����Rdb&��+��� * �$��nW������3E����=�3��/7�0$%���[-%������3�C���B&�%H�H���*��%5���=�I'?xC��H���D���3�~H��0���%��� �����6�R �&'3`C� /%��� a3��&���%e3� C�%$;���;H��B�* ����3������H��I�B'�$�����[�^9:'(�g�H��%�����*����,�%�E����3����'(�C* '���H�'($���$0��H��3�,���,$�-������* '�������H���� ��zm�HY� � *_2�������6��5����I�B'�$.�+�0H�H���'3(�,���3�I� �B!==�%���I���0$sR^v~�����D�������'(���%a�����B���$��%5���?�I'?* '���H���$���[���=�����/3�%���,�%$�* � �'39^������!�������#Ri:��`C'(����Z5Y�?H����D9:�����%5������'�5Y�)�05��B�f��'���HY���3�����3��N�D��?H��%���0��� �������a�$�'%�^������&����������%$��'39���������3�I�B*�H��%���0��� ������C'39N�D��=��'(��� �s�� �C�,$#�D��=xC��H�������[����'(���[��$sRdb&��&�+������3�,� '39^H��%���3��� ���'(��� � * '(��5���$��[���'($sa��D����*_����)����� /%� �'(H�� �4�,$#�����`C'(��eR�'&�� � (���� 4�3�� 46( 3 (��������� (�-/ 17+,�g�%���'(��1* '(��5���$��[���'($��'[9F�%H�H��6'(�3* �� �9:'(����'�5�������HY� � *_ ��� * '%-($�����'($ ��"/%�.5�� ��$ � ��%���,$�� �`&���<�'(���1���* * � �"R i �grsV ¡ ��3�5Y� ��$�HY� * �����3�&>���5����I�3* ���'($M�1+>�> O ��"����R 1�>�>w��3��3��'5�� ��$8* '(��5���$�� �w`E�B�Dk��'�'%���'(��'(��'���H���*oH��%�I�%��� ���������[���'($ ��}�� �-%�/(�,$�-1���;H���'3/%� �Z$�'%������'(5�����D$�� ��Rgb&���tgu�vw��� * �$��nW������3�5�� ��$#* '��?5��,$�� �4`&���#��/0������'($'39g���$����0�=�3���%H��D�3���'($ �TS�� ��';* '(����� * �E9'��&����f������'(�6+�,$2��������$����0��H��%��������'($��,$�-.'[9 ����f9:���3��������H��3* � � � ��GR bE��B1`&�3�����2�!������� ���� � 5%! >�Ei='�$w���� ¡ &t ¡ S��0���kx&>�+1 ¡ � >�H�'(e[�kS�U� /7�3�,���3���'($sR �d!4* '(��5��,$���$�-4����;�G`C'#��� ���'���=����;�!(I�����`&�3�9'���$����'.5��#��'(�6�)�6'(5��������'$�'%���%R^b&��&H��%���3��� ����'���� �(* '(��5��,$��3���'($f��� * �$��nW���E��� �*����,5�� ���,$f����^`C'(��e���3^5�� ��$�* '(��5��,$�� �`&���2�H�� * ���I�3�^���5������[* ���'($ �J'0U�aW'YS ��R �&���6�?�D��?��'���� �g�3���%H����[���'($#�?��I� �Z�I'�* '(�;H���$���3�I�=9:'(�����=�%H�H���'3����;�3���'($�&���� �#�,$1������HY� * �����3�s���5����I�3* ���'($1H���'(* � I�Rgu�$1�������;�3��~�D�3�e�� ��%���,$�� ����;H���'3/%������$0��&�,$.��� * '0-($�����'($.���[��� C`\���6��'(5����3�,$�� �JRb&��f-%��$������3�^�%H�H���'(�[*_1'39g��$���0$�* ��$�-2����=DH�� � * .�D���$Z��I��$�-#I'(���?�[���%H����3���'($1�I� *_�$��n������'.* '(�;H���$���3�I��9:'(�����I��'(��f��$

  • Q%U$�'%���%a��=��$���,e3� �!4��'�-%�/%�f-%'('��.� I���,���3��� �'39^����=* ����%$2�HY� � *_sR ¡ $�'%�D����+�3��/3�%$0���3-%���,$4����,$�-�%$1��$���%$�* ������$0�+5��3�� �#I*_��������&�D��3�C����A5Y� ��+HY���{9'������%$�* ���+$�'3` �����* ����%$.HY���{9:'(�����%$�* �#�-(�����%a^�,$8* '($%�D���3��f��'.����#��'���� �]zG5��3�� �w��� * �$��nW��� �`���������D��o5Y� ���H����{9:'(�����0$�* ��`&���+5Y�o����3��* �� �#�!�������#RgbE�'(��-(sa��3-��3�,$sa����������������=H���'(5�����'39AD��� * '($�����I��* ���,$�-%�������'3`£��$����6-%!* �B���0$#�HY� � *_p��$2H������'����`+�����������B����3De3� �o50!.$�'%���%R

  • � ��������� �

    � � � � ������� ��� � � � ����� �!� " �#�$�%�

    i'&)(+*-,/.1032]z541(76803.9(;:1:1(@?BA-CD6FE8,G4H0JI/6803.Ja/CDE CD6 CK*L:H,>N/,3` `QA1(7ER&S,/

  • q%|

    −10 −5 0 5 10 15 20 25 30 35 400

    0.002

    0.004

    0.006

    0.008

    0.01

    0.012

    0.014

    0.016

    0.018

    0.02

    Ln Power

    Like

    lihoo

    d

    � U����DS/HJL;�XR;\U/F���� −10 −5 0 5 10 15 20 25 30 35 400

    0.002

    0.004

    0.006

    0.008

    0.01

    0.012

    0.014

    0.016

    0.018

    0.02

    Ln Power

    Like

    lihoo

    d

    � M��DS/HJL;�XR;:U2F���

    −10 −5 0 5 10 15 20 25 30 35 400

    0.002

    0.004

    0.006

    0.008

    0.01

    0.012

    0.014

    0.016

    0.018

    0.02

    Ln Power

    Like

    lihoo

    d

    � E��

  • q;q

    ?3,>

  • q��

    −10 −5 0 5 10 15 20 25 30 35 400

    0.002

    0.004

    0.006

    0.008

    0.01

    0.012

    0.014

    Ln Power

    Like

    lihoo

    d

    � U �0ch0SRX^H��A@CK�=�; E:S$X^]_S/FQ;�F�@L −10 −5 0 5 10 15 20 25 30 35 400

    0.002

    0.004

    0.006

    0.008

    0.01

    0.012

    0.014

    Ln Power

    Like

    lihoo

    d

    � M� ��S2KG=DX^H��A@CK�=�; E:S$X^]_S/FQ;�F�@L

    v�CZb/I1N/0[N;EQ.1CD68EMN/6 �'68,;2DCD.�� aeN/,;CD680*-0[(;N �.1C`*v0[N/68CD,>NpCKNnEMA/0�re,;b[z5f1:103?3EM*L(7CKNeX�v ,>

  • � ��������� �

    � ��������� � � � � � � � � � ��� � ���F��

    UA/CD6+?3A1(;:/E80[Nc6P?BA/0[*-0#"QA/CZ?3AcCD6LEP,pEMNN/,;CD680$�y?3,>N1(72)N/,OCZ6P0G(;I/EM:1I/EL:141(O4/CZ2DCDE=^c.1CD68EMN/6[X�UA/CD6s*v,>.1032UEVA/0[

  • q �� N/01" EMNn:1

  • q ':1(;

  • q��

    z;XKUA/0o6V:10303?3A](;N/.kN/,;CD680G(;

  • q��

    E8,pI/680L&yI/2D2�*$,>N;aO,;2KI/E8CD,>N1(721N/,;CD680$CZ6�(7686VI1*-03.+E8,o410F?3,>N/68EM(ON;ER,7a;0[*-CKN/b968CDb>N1(@2SX�UA/I/6=*1N/,>N��y2DCKN/0[(;(7CKN9.1CD68EP,>N/6U.\I/0lE8,�*/&u,>*L:10[N/6V(7E803.n&S,/NeX

    � c0B�;

  • m>r

    NWI1I1N/.1CDE8CD,>NnC & EMA/03^](;

  • m\z

    EMA/0[N � \z$*L(@C`N.* � \ @U(@.1.1CZEPCZ,/N+CKNlEMA/0F2ZCKN/0[(;N/02*eA/,9"$03a;0[< *CZEg?3,>I/2D. 410na~(;*-03E8CK*-036I/6803.jCKN6M:103?3EM< � A1([aO0s41030[Ni,>:/EPC`*vCZ6P03.i&S,>4/EM(7CKNEMA/0k.1^1N1(;*-CD?p?3,/0$&s?3CD0[N;EP6]CD6CZ.10[NOE8CD?[(72hEP,+EMA/0U6PC`*g:/2Z0l.1C � 0[N1(72e.\

  • m @

    CZ6Q,>N/2D^]:1,O6868CK4/2D0GC & EMA/0l?3,>N/2D^9EMA/0+*-0[(ON/6U,7&�EMA/0G*-,/.1032D6(;N1(72(�$0[:/68EM*L:10[N/6V(7E8CD,>Nj:1?303686A* EMA/0n0��h03?3E86L,7&JEVA/0]a~(ON,7&hEMA/0o6M:H0303?BA9(ON/.N/,;CD680o6VA/,9"QNLCKN01�1I1(7E8CD,>N#'1X @Or(;N.*;EVA/0J*-0[(;N/6�,7&eEMA/0UN/,;CD680U.1032DEM(o:1(;

  • m>q

    � b>(@C`N.*YC &JEMA/0L*-0[(;Nk,@&|EMA/0L6P03?3,>N/.p.10[*L:H0[N/6M(7E8CD,>NA1(76FEMA/0J(7.1a7(;N;EV(7b;0UEMA1(@E�EMA/0J.1032DEM(l:1(;N968EV(7E8CD68E8CD?[(72.\(7EM(1X N\,/AOE86$C`NmE80[N1*v0[N;E$,7&)(+:1(O

  • m2m

    N\,>EMI1*L:1,/N/0[N;E(;K�S�k6$EMA/0GNg&u,>*-036 ��� �0_ \ ���� � _ �lW Y �$W Y % �XW Y � & W Y�� � � _ �XW Y � % �XW Y � & W Y ��'1X!@���

    f/C`*vCZ2K(;AOE86O"UCD2Z2RNeX�N\,/*L:H0[N/6M(7E8CD,>Nk:1Nn,7&|(72D2�EMA/0-032D0$�*-0[N;EP6o,7&UEMA/0l&S0[(7EVI1

  • m '

    B���� � "�� ��� ���� ��������UE J �

    UA/0+68CK*L:/2D0368EA*h(;N/.t*-,O68EU?3,>*L:1I/EV(7E8CD,>N1(72D2D^]0$&s?3CD0[NOE=* a;0[N/6Q,7&������ (ON��yCDE80[N/0[NOEJ(72DCDb>N1*-0[NOEoCZ6o(7686VI1*-03.]I1N1(72DE80[Nn(;:1:/2D^(ON/.9CZEwCZ6QN/,;EUN/03?303686M(;*L:H,>N/0[N;EP6 �M( ��(;N/.�M45�\X�UA/0+I1

  • m �

    N\,>N1(72wC`NOE803b>NiE8,p036PE8CK*L(7E809EMA/0*-0[(;N.*�(;N/.k&u,>I1N1(@2|CKNOE803b>NkE8,90368EPC`*g(7E80LEMA/0?3,7a~(;

  • m ,

    � 68CK*-CD2K(;I1*v0[Ng,7&)EMA/0o68EV(7E8CD?x:1(OEVA/CZ6H"U(76F&S,/I1N/.tN/,;E$E8,s4H0G(L:14/2D0[*9X������� � � � � � � &����*% ��� & ��� � � �� � �

    UA/0GI/680o,@& N/I1*-0[(7.9,7&�6MI/?3A9(-E803?3A1N/C��1I/0-CD6xA/CDb>AeX

    8'&QCZE-CD6L(7686MI1*v03.�EMA1(@E+EMA/06MI1* ,7&JE0"$, �e,;b��5N/,/

  • m �

    U,;EP0oEMA1(7E$EMA/CD6UE803?3A1N/Ch� I/0-0[NO&u,>*-0[NOE86R,7&EMA/0J?3,/N,7&+����� k @�m �5X������� � � � � � ��� & ��� � � �� � �

    UA/0L68CK*L:/2D0368Es(O:1:1CK*L(7EPCZ,/NkCD6+EMA/0 � ,;b�� � .1. (;:1:1NeXR;U0[

  • m �

    UA/0[N/0[NOE86QE8,-EMA/,;680oCKN9EVA/0o?3,>N}E8,sbOCZa/CKN/b](7.1.103.��\01�>CK4/CD2DCKE=^pCKNnEMA/0LN>I1*-410[*L:1,/N/0[N;E86oEP,4H0G036PE8CK*L(7E803.+*P3�����TCD6+&y(768EP0[

  • ';r

    Corrupted-Speech

    "Observations"

    Generate Noise

    NoiseSpeech"Observations""Observations"

    Noise StateSpeech State

    Generate Speech"Observations"

    Combine usingMismatch Function

    Re-estimationBaum-Welch

    Corrupted-Speech State

    "Observations"

    N�CDb>I1

  • '1z

    UA/0 � ,;b�� � .1.�(;:1:1Np*L(^k410La/CD01"|03.c(76+(nN/,>N��yCDE80[4/EM(@C`NEMA/0$68EM(7EPCZ6PE8CD?36R&S,>.1C �h0[:/E8CK*-CD6M(7EPCZ,/Ns*L(^-410o68,;2Da;03.I/68CKN/bs(;N���� 41(76803.9(;:1:1(7?3A.*>A/,�"$03a;0[*L:1I��

    EM(7E8CD,>N1(72D2D^La;0[CK*-CD680QEMA/0J:1N/0[NOEUCKN](72D2):H,;6868CK4/2D0-68EM(7EP0J6801�1I/0[N/?3036oI/68CKN/bsEMA/0o?[I1*-4/CKN/03. "UCDEMAlEMA/0��e,;b��5w,>(;:1:1N.*7.10368?[Nf'1X��1X @ *3E8,Q0368E8CK*L(7E80EMA/0o6M:103?3EVI1(7b;0L*-,/.1032�*��H*e41I/Eob>*L:H,>N/0[NOE86=*RCD6v4/680[N/6-N/,�" 41032D,>N/bE8,]EMA/06M(;*-0o.1CD68EM:/E8CK*-CD6M(7EPCZ,/N9EM(76$4 "UCD2D2N/,�" 4H0

  • '2@

    b Y \�(;N/68EMN9:1I1N1(72QCKN1:1I/E86E8,pEMA/0968?3A/0[*-0k(;NOa;,;2KI/E8CD,>N1(72oN/,;CD680;X � 696MA/,�"JN%CKNj6P03?3E8CD,>N '1X qHX q-*

  • ';q

    ,>N/?30sEVA/0L?3,>NOa;,;2KI/E8CD,>N1(72$N/,;CD680LCD6Q4>N/,�"JNp(@2Z2FEMA/0L68EV(;N/.\(;*-4/CKN/03.,>I/EM:1I/Eo:141(;4/CD2DCDE5^ ��

    � �XW Y ��Z ��$CKNkEMA/0Q���7��?[(7680l?3,>4/EM(7CKN/03.4;^k?3,>*-4/CKN/CKN/bt6PEM(7E80 ��L,7&$EMA/0L6M:H0303?BAi*-,/.1032�"UCDEMA68EM(@E80 � �� ,@&_EVA/0sN/,;CD6809*-,>.1032uX9w,;E80-EMA1(7EC & EVA/0+?32D0[(;Nn6M:10303?3A/;I�S�k6U?3,>NOEM(7CKN](gE8,;EM(@2W,@&�i 68EV(7E8036J(;N/.9EVA/0GN/,;CD680L*-,/.1032)A1(76 � 68EM(7E8036A*EMA/0[NnEMA/0+?3,>*g:10[N/6M(7EP03.}N/CD680[

  • '�m

    Speech Model

    21 3

    Corrupted Speech Model

    Noise Model

    a b

    3a1a 2a

    1b 2b 3b

    N�CDb>I1< EMA/0xN/,OCZ6P0o68EM(7E80Q?[(;N1N/,;E$410+:1

  • '2'

    C`*g:/2Z0[*v0[N;EM(@E8CD,>Nk(76M:103?3EP6J(;NeX����������� ������� ��� � ��� �

    � ��� ��� ��� � � ������ �����1���������

    ������������f/,+&y(;I/EFEMA/0o(7?3EMI1(72 68EM(7E8CD68EPCZ?36$,7&hEMA/0Q6M:H0303?BA9(;N/.9N/,;CD680QEMA1(7E(;N/6l.10368?[

  • '��

    8'&UN/,;E+(72D2�EMA/03680-?3,>

  • '�,

    �$,7a~(O68EP0[*-6=*R,>N/2D^�(n6MI14/6803E-,7&UEMA/0#�$0[:/68EM

  • '��

    (-68CKN/b;2D0$�5:1(7686=*eN/,>N��yCDE80[NeX����� ����� � ��"���� � ��� � ��� �� ���� ��� ��� � � � ��� � ������� ������� ������� ��� ��oCDa;0[NnEMA/0-?3,>NnEMA/0L?32D0[(;N6M:10303?3Ai.\(7EM(;41(@680s(;N/.i,>4/680[N/6=*:W Y �[Z �1*�(;.1032D6|*g([^oEVA/0[NG4H0Ub;0[N/0[

  • '��

  • �;r

    "JA/0[

  • � ��������� �

    ����� ��� � ��� � � � � ��� � ����� ��� � �� � � ����! �"��� !

    $#&%�"('&) 4+*,)-%/.0%21435%/68791:3;#&7/3T)0AJDI6,%21&.57F3KEP*&D/'4l?1&7/E�M&791]'?)30"�'R1&'47

  • �2@

    0 1000 2000 3000 4000 5000 6000 7000 80006

    7

    8

    9

    10

    11

    12

    Frequency

    Log

    Pow

    er

    � D������H.�� (O9:24*�,/B13C(=NI.1,/24@C( 0 1000 2000 3000 4000 5000 6000 7000 80006

    7

    8

    9

    10

    11

    12

    FrequencyLo

    g P

    ower

    � K��� B>(=NODH3�24,5.)@��8,

  • ���

    .;*,AJ>/%/6]m)K%��,^&%21&>/EzM&791&.��$#,AJ.6I)0A4ZPAJ357F>2ABDFD/%/6y3;#&%rD/'?1@3;AJ791&.8A6,7/35DFE{1&'?1��m.03;AJ357F'&1,A4)KEx1&'@7F.5%}.0'&^,)K>/%��~3;#&%

    AB>V#&791&%?�\^,1k1&'47/3;)5AJD i AJD9^&%�ABl?AJ791&.03rZG%/D��m.;*,AJ>/%/6 ]`)K%��,^&%21&>/E M&791y]'?)A{.0791&l4D

  • ��m

    �\A4^&.0.57QA@1>/'?ZP*,'&1&%21430..;#&'��$.�7/3tZG^&DV#G*,A4)5A4ZG%/30%2)K.6,%/.0>2)K79MO%/67Q1#�$#,A4*&35%2)(d �?A4)K%Y.;#&'��+1G791!#Il?^,)K%-�,W�,W$�+D/%/.L.;#&'��z3;#&%.;A4ZG%Yl4%21&%2)0AJDX*,AJ3030%2)01�$7/3;)0ABD i AJD9^&%AJl?AJ791&.03rZG%/D��m.;*,AB>/%/6�]m)K%��,^&%21&>/E M&791y]'?)3;#&%f3;#,)-%/%�� �����% i AJD9^,AJ307

  • h�� �X% i %/D �fA41&6 �X% i %/D��,W��$#&%rZG'&6,%/D��X'4l��eb,*O%/>/3;)0AJD$*&DV#'J]+3T#&%}D

  • � ��������� �

    � ������� � � � ��� �� � � � � ����

    �m1&7V#U3;)K79*&D/DQA@)K72AJ.0%P'J]+ZPABDF%7/%/.0.0%/6}^&.0791&lGA � SZv.0%/>��+A4ZUZG791&l��$791&6,' ��A41&6PAGh2wZG.0%/>L]`)5A4ZG%$*,%2)K7/#o]m)0A4ZG%PA.0%/3:'J]th �� ����. ��%2)K%G>/'?ZP*,^&30%/6~W �$#&%C#/%2)K'@3;# ��%2*&.03;)0ABD=>/'?%ED}>/7/'?ZP*,^&30%/6fA41&6R.030'?)-%/6R.0791&>/%\7V#6,7Fl@7F3 �_A.0791&l4D/'?1&.53;)0AJ791&%/6�M4EzA.0E,143TA��>/'?1&.07

  • �,+.0/ > � 4(B � �;B���� 6"38 : �=<��>��� � 2 � � �� ����A4 6���� B 4

    f'?6,%/D b,a�� 6���b&%/3 ��� %Sw %A���D/'?Z �*,A4)K%/6{30'rZG'&6,%/DF.U3;)0AJ791&%/6k'?1{1&'47/'?)5)0^,*&30%/6{6IAJ3;A��^&.0791&lMO'43;#.0791&l4D/#,1&7��q^&%/.f)K%/>/'?)K6,%/6�1&'{%2)0)K'?)K.RAJ3R#&7/'?ZP*,%21&.TAJ30%/6r>/D/'?ZP*,%21&.TAJ30%/6 �?A@1&6}ZG%2A41��m>/'?ZU*,%21&.;AJ35%/6}^&.0791&l\3;#&%a+^,ZG%2)-7F>2ABD �m1@30%/l?)5AJ307

  • �,�

    �Il?^,)K% +,W9h@W �I%2AB3;^,)K% i %/>/30'?)L>/'&%ED}>/7/307 i %/D/D/30%/6zM@E3;#&%xAJ6,6,7/'?ZU*,'?1&%21@3����� �$#,A i 7Q1&l{3;#&%f#&7Fl&%/.03A i %2)0AJl4% � �1?^,ZGM,%2) W �$#&%SA i %2)0AJl4% � �1?^,ZGM,%2) ]'?)�M,'43T#P3;#&%SZG%2A41��m>/'&ZP*,%21&.;AB30%/6rA41&6RZG%2A41��A41&6 � i A4)-7QA@1&>/%��m>/'?ZP*,%21&.TAJ30%/6�ZG'&6,%/D.0%/30. �[AB.�]`A@)$D/'?ZP*,%21&.TAJ30%/6f.0E&.030%2ZRW��'?ZP*O%21&.;AJ30791&l3;#&% i A4)K79A41&>/%/.='J]I3;#&%�ZG'&6,%/D4.0%/3]`^,)K3T#&%2)C)K%/6I^&>/%/6G3;#&%�A i %2)0AJl4% � �1&^,Z8MO%2)/W �$#&7/%/.'J],3;#&%_.0E&.030%2ZW �m1GAJ6,6,7/%>2AJ.0%4W �$#&7/%\ZPAJ3T)K7�� ��%2)K%3;#&%21.0%/3S30' #/%2)K'rA41&6k3;#&%PA i %2)0ABl4% � �y1?^,ZGM,%2)SZv%2AJ.;^,)K%/6~W �$#&%PA i %2)0AJl4% � �z1&^,ZGM,%2)7/' i A4)K79A41&>/%$ZPAJ3;)-7 ���4AJ3D/'?ZP*O%21&.;AJ30%/6o.0E&.030%2Z �,l&AJ791&%/6rD

  • �4d

    A41&>/%\ZPAJ3;)-7F>/%/. � W HS79AJl@'?1,AJDI>/' i A4)K79A41&>/%\ZPAJ3T)K7/%/. ��%2)K%3;#&%2)K%T]'?)K%S^&.0%/6R791RAJD/'?ZP*,%21&.TAJ307

  • +4w

    �$#&%\.03TA41&6IA4)K6 � ���.0E&.030%2Z �Y7F3T#r1&'307/'&ZP*,%21&.;AB307/3;)0AJD@307/'?Z �*,%21&.;AJ35%/6xZG'&6,%/D/#rZG'&6,%/DCA41&6R3;#&% �)K.03��4w6,7Fl@7F35.$'J]C3;#&%30%/.03L.;*,%/%/>/#XW���'?ZP*,A4)-7F.5'?1P'B]p3T#&%S307/'?ZU*,%21&.;AJ35%/6R>2AJ.0% �$7/'?1 i '4D9^&307

  • +,h

    a+^,ZGM,%2) b,a�� 6��(��'?ZU*,'?1&%21@30. ��� %Sw %A�

    h �4w � �� � h

    4w wh2w w�4w ,+ w

    �CA4M&D/'&ZP*,'?1&%21@30.^&.0%/6]'?):%/.03079ZPAJ357Q1&l3;#&%R>/'?1 i '4D9^&307/%��X>/'?ZP*,A4)0A@M&DF% �$7/3;)0ABDC3072)-7QMO%/6�791o3;#&%P*,)K% i 7/'?ZP*,^&3;AB307/'4l?1&7

  • +��.0/ � � � B�� � B B � ����$#&7V#,A@*&30%2)G#,AJ.P*,)K%/.0%21@30%/6|)-%/.;^&D2A4M,^&D9A4)KE.0E?.530%2Z7Q1{D/'?1 i '4D9^&307/#&7F% i %/6xM@E}3;#&%Ga+^,Zv%2)K72AJD �c1435%/l?)0AJ307/D/D/#&%/6S.0E?.530%2Z �/%/7

  • � ��������� �

    � ������� � � � ��� �� � � � ��� � ��� ��� ��� �� !

    ������� ����� ��� ������� �7�� � �����

    "!$#&%(')#+*-,/.-0$132+!(45%$67#8':9(#+1;28'=(#+1?6@!$#A%(#8'CBD.-';EF45G$2+#?.HBJILKNMPOJ!$#8GQ2+.-EF%R#8G$1@4H67,>G$ST6@!$#?176@4H6;,U2%(45'745E3#+6;#8'0(4H67#6@!$#f%R#8'gBD.$'7EF45G$2+#h.HBi6@!$#j9(Y(G(45E3,/2"%(45'74kE3#+67#8'l2+.-Em%(#8G$1@4H6;,U.$Gn1;2[!$#8E3#+1X,/6LO"4H1oG$#+2+#+171@4k'45'G|6]!$,U1:2+!(45%$67#8'p6;.&=R#a#84v17,/WUYT9i0(%$W/,/284H67#+9s~e6@!$#FG$.5,/17#+117#+W/#+2+67#+9FOc#8'G$SA17#8Gk67#8G$2+#+1:45G$94m17#+6".vBLBD.-0(' 5317#8Gk67#8G$2+#67#+176p17#+6718~(.vBOJ!$,/2+!V.-G$W/YZ6@!('0(4H67,/.-GV17#+6;1 � dh "!$#a'4H67#+9T'G6@!$,/1j2+!(45%$67#8'L4Oc.-'G$#N1@%R#+#+2[!':B:·s¸ HBG9H 9BJH9 ;7B�@�BAFG?KE938:I�BD@�BGI�T 576EB"¹ B�O$º »+¼ HBG9H 9BJH ;7=�9 KE?�HL´19BJI�T"½¾ = @8:BGH¤³"?PJ¿393O�?�H F 6EBGF���9À�;7BD@�B O�B�@PQ?@�RABJI�;78:H36 H361Bx¹ BDO-º »+¼ =KEI KE?�I 8¶Á�BD@�BDKEFGB/8LK H36EB H3@�BDKEI29 I2BJ9FD@8¶µ�BGI ;7BD@�B?7µ19B�@ ¾ BGI�T�:B

  • +H

    e#+176J`$#+6 McW/#845GV`(b���w¤9��cy b".k,U1;Y|`(b���w¤9��cyri#8=�� �k �(d  �(d �p2+6�� �5 �(d + �(d¶ri#8=�� R �(d + �(d �

    o45=$W/# �(d ��stp*5#8'74HSk#J`(b��BD.-'q6@!$#A�cK 67#+1;6j17#+671"4H9(9(,>G$SF¡lY(G$^&¢#+W/,/2+.-%$67#8'"G$.5,/17#n4v6767#8G$0(4H67#+9A=kY5H9���L*4vW0(4v67,/.-G � ,�-�CdJ xOf.ZE3.$9(,��i284H67,/.-G$1:67.?6@!$#a%(4k'745E3#+67#8'),U1]4H67,/.-G|0$1;#+9|B.-'6@!$#n#+*H4HW>0(4H67,/.-GTOc#8'G$9(.HO 45G$9£4TZE317#+23B'745E3#%(#8'G$SN85±k9(,U1;67,>G$2+6J6@'),%(!$.$G$#+18d

    tpWUWX'

  • +5± / > 4(B ��� �;B���� � 254 + � 4A( �� �&(A��(�� ()B 4

    �jG$#8'G$S|6]!$#A%(45'745E_#+67#8':17#+6~o%(45'g67,/280$W4k'

  • +,� /�� 4(B ��� �;B������ �� � 2�� % %� ����04 6 ��� B 4 "!$,/1A17#+2+6;,U.$G9(#+1728'=R#+1Z*45'G$S5W/#]C%(4H1;1"6@'74H,>G$,>G$S3O",/6@!45G$9FO",/6@!$.-0$6"4H9(9(,/67,/.-G(4vWi,/67#8'74H6;,U.$G$1f.vB �c450(Ea �N#+W/2[!mOc#8'EF%(.-')6@45G$2+#p.HB¨2+.-Em%(#8G$1@4H6;,G$S3#84H2+!Qª7S-'GN4ZE3.$9(#+W©C=(4H17#+9N2+.$EF%(#8G$1@4v67,/.-GT172+!$#8E3#5d3 "!$#F': � 9 'G$Sn6]!$#f9(#+W/6@4E3#845G$18~54kG$9"�¨G(4HW/W/Y5~-,>G$2+.-';%(.-'74v67,>G$Sn6@!$#c9(#+W/6@49(#+W/6@42+.-EF%(#8G$1]4H67#+9E3#845G$1XY-,/#+W/9(#+9A4�+5 ��'

  • +,+

    "!$#?B#84H6@0('G$#+9ZO",/6@!m6@!$,/1xG$#+O6@'70(G$284H67#+9_BD#84H6]0('G$S5W/#]CIL4H171Fw %:5y +Rd + �Rd � +Rd¶ +Rd KN0$W/67,©CIL4H171 �Rd> +Rd  +Rd +Rd �

    o45=$W/# �Rd ± � �N.-')9|#8'7'G$S5W/#]C%(4H171345G$9NEa0$W/67,©C%(4H1;1:6@'74H,>G$,>G$S|.-GT¡lY(G$^¢#+W/,©2+.-%$67#8'"4H9(9(,/67,/*5#3G$.5,/17#]2+.-'7';0(%$67#+9 �cK�4H6: �H9��

    ¢p48*$,>G$S3.-=$6@4H,>G$#+9Z4n1;,G$SkWU#]C%(4v171JE3.$9(#+Wl17#+68~$,/6f,/1"%(.k1717,>=$W/#n67.3%(#8'gB.-'7E�4H9(9(,/67,/.-G(4HWl,/67#8'74v67,/.-G$1.HB5�c450(E �N#+W/2+!�#+1;67,>EF4H67,/.-Gld� "!$,/1?1@!$.-0$W/9�%(45'4HW/W/Y�.H*5#8')2+.-E3#Z6@!$#T%(.$.-'AE_.-9(#+W/W/,>G$S�.HBn6@!$#2+.-'7'70(%$67#+9$1]%(#+#+2+!F9(,/176@'),=(0$6;,U.$GZ=5YF4:1;,G$SkWU#:E30$W/67,©*45'4H6;#0F450$1717,>45Gl~k17#+#JM"!(45%$6;#8'LidL X45=$W/#0�(d©±1@!$.HO"1:6@!$#A%R#8'gBD.$'7EF45G$2+#?.HBf6]!$#AE3.$9(#+WU13S5#8G$#8';4H67#+9£=kYN45GN4H9(9(,/67,/.-G(4HWh6G?4WU,>\H#+W/,>!$.$.-917#8G$17#5~i'G$SA4Fk±,� � ,>G$28'GZ#8';'

  • +,�

    KT.$9(#+W e#+176J`$#+6 tp*5#8'74HS5#`$#+6 ri#8=����5 �p2+6 � �5 ri#8=��©(McW/#845G �,�(d � �Hid�+ �5±(d �5±(d©±

    `$,G$SkWU#]CIL4v171 �(d 8±(d© 8±(d�+ �(d `$,>G$S5W/#]CIL4H171Fw %:5y (5d¶ +(d�+ (5d© 5(d

    o45=$W/#��Rd � � �Q.-'EF%$W/#8E3#8Gk6@4H67,/.-G$18dqri.-'h4HW/Wi#+^(%(#8'E3#8Gk671"4:17,>G$S5W/#:2+.-Em%(.-G$#8Gk6j17,>G$S5W/#:176]4H67#"G$.5,/17#E3.-9(#+WeOx4v1J0$17#+9sd

    "!$# �¨'G$SFO"4H1"0$17#+9ZB.-'h6@!$#5�xK6@4H1@\udL "!$,/1xE_#845G56h6@!(4H6h,GkB.-'7Em4H67,/.-Gl~5,>G?6@!$#xBD.-';EP.HBs6@!$#:!$,/S-!$#8'g.-'

  • +5

    Clean

    Diagonal

    Truncated 24−dim to 13−dim

    5 10 15 20 25 30 3510

    −3

    10−2

    10−1

    100

    101

    Feature Vector Coefficient

    Ave

    rage

    KL

    Num

    ber

    rL,US$0('��etJ*k#8'74HS5# �:¡NG$0(Ea=R#8'qBD.-'h2+W/#845Gl~�HnIqKNMh2+.-EF%R#8G$1@4H67#+9Z45G$9|HH9(,>E3#8G$1;,U.$G(4HWs6@'70(Gk284H67#+9N67.} 9(,>E3#8G$17,/.-G$1 HnILKNM 2+.-EF%(45')#+9£67.N 9(,>E3#8G$17,/.-G(4HW)HnIqKNMh2+.-EF%R#8G$1@4H67#+9£E_.-9(#+W17#+671".-GZ¡ Y¦G$^|¢#+W/,U2+.$%$67#8'J4v9(9(,U6;,U*k#_G$.k,U1;#]2+.-'7'70(%$67#+9 �cK�4H6n �v9��9(#+WU6]4FMc#8%$176@';4(~5O"4H1hWU.k1768dj "!$0$1hBD.$'L6@!$#:2+.-Em%(#8G$1@4H6;,U.$GA%('GldL s.3,>G5*k#+1767,/S-4H67#6@!$#J# �s#+2+671h.HBs6@!$,/18~(4:17Y$1767#8E O",/6@!?G$.a6]'70(G$284H67,/.-Gl~k,Dd #5dj0$17,>G$S4HW/WjHZ9(,>E3#8G$17,/.-G$18~XO"4H1n=(0$,/W/6a0$17,>G$S|6]!$#F1@45E3#32+.-Em%$WU#+6;#F9i4H6@4H1;#+6{4H1:6]!$#F176@45G$9i4k'Gk671j0$17#+9F,>G36]!$# HnIqKNM£%('G$S85567.Z85n%R.5,>G56;1"1@!$.HOc#+9AW/,/6767W/#n*H45'4H67,/.-Gm,>G|%R#8'gBD.$'7EF45G$2+#5dL e._%(0$66@!$#J1;6@45G$9i45'

  • �5

    bp0(Ea=R#8' �N.-')9 �h'7'G$S36@!$#"*H45'45G$2+#pO"4H1j,>EF%R.-'G�17#+2+67,/.-G�±Rd ���d cOc.N,>EF%$W/#8E3#8Gk6@4H6;,U.$G$1Z.HB6@!$#A¡l.5SvtJ9(945%(%('G?67#8'7E31c.HBX6@!$#n4*5#8'74HS5# �:¡£G$0(E3=(#8'+~$,>G$9(,/284H67,>G$SZ6@!(4H6c6@!$#p# �s#+2+6f.vB6@!$#*45'45G$2+#Z.$GN6@!$#Z*H4HW>0$#Z.HBJ6@!$#ZE3#845GQO"4H1n1]EF4HW/Wd 17,>G$SN6@!$#Z¡l.5SHtp9(9�45%(%('

  • �(

    Clean

    Diagonal

    Diagonal (Mean)

    Log−Add

    Std. Log−Add

    5 10 15 20 25 30 3510

    −2

    10−1

    100

    101

    Feature Vector Coefficient

    Ave

    rage

    KL

    Num

    ber

    rL,US$0('4HSk.-G(4HWi2+.H*H45'45G$2+#:45%(%('Gk67#8'

  • �5

    t:%(%('4HS5.$G(4HW 5±(d> d 5d � (d � ±Rd ±H:,>4HS5.$G(4HWjw¤KT#845G(y Hid  d�� (d (d ± �Rd � H:,>4HS5.$G(4HW d  id�� (d> (d ± +Rd ±H:,>4HS5.$G(4HWjw¤KT#845G(y �5(d +(d d¶ (d  55d�� H:,>4HS5.$G(4HW �(5d � d  id ± 5d � 5(d©H:,>4HS5.$G(4HWjw¤KT#845G(y � d  (5d + 8±(d  5d �(d H:,>4HS5.$G(4HW �(5d  ,�(d � 8(d  (d + i5d�+H:,>4HS5.$G(4HWjw¤KT#845G(y (d � 5(d + (d ± 5d> +5(d

    o45=$W/# �(d© � �N.$'G$SHnILKNM�.-G?6@!$#a¡ Y¦G$^|¢#+W/,U2+.$%$67#8'J4v9(9(,U6;,U*k#aG$.5,/17#]2+.-';'70(%$67#+9 �cKri#8=�� �kn6;#+176"17#+6

    Clean

    Diagonal

    Pseudo

    Extended

    Std. Diagonal

    5 10 15 20 25 30 3510

    −2

    10−1

    100

    101

    Feature Vector Coefficient

    Ave

    rage

    KL

    Num

    ber

    rL,US$0('

  • "!$# HnILKNMP#+^(%(#8'),E_#8G5671m9(#+1728'=(#+9�17.VB45'3!(4*5#Z4HW/W"0$17#+9£6]!$# H:,4vS5.-G(4HWh2+.*H45'45G$2+#|45%k%('EF4H6;,U.$Gld{`$#+2+6;,U.$G±Rd>839(#+1728'),=R#+9£.k6@!$#8'"2+.H*H45'45G$2+#F45%(%('EF4H67,/.-G$1d !$#{4*5#8'74vS5#��:¡NG-0(E3=R#8'4HS5.-G(4HWu284H17#5~Ox4v1"17W/,/S-!56;WUYTOc.-'G$S:*4k'

  • �H

    KT.$9(#+W e#+176J`$#+6 tp*5#8'74vS5#`$#+6 ru#8=�� �5 �p2+6�� �5 ri#8=�� RMcW/#845G �J�(d � �vid + �k±(d> �k±(d ±

    `$,G$SkWU#]CIL4v171 �(d ±(d  ±(d + �(d¶H:,>4HS5.-G(4HW k(d  ±(d � �(d +(d¶IL17#80$9(. +(d � §id¶ ±(d  ±(d +�q^-6;#8G$9(#+9 +(d §id  ±(d ±(d �

    `$6@4kG$9i45'4HS5.-G(4vW vid � (d k(d¶ R5d ±

    o45=$W/#��Rd>5�� �N.$'=$W/#|#+^(%$W4kG(4H67,/.-G},/1F6@!(4H63,>G6@!$#|2+.-Em%(#8G$1@4H6;,U.$G172+!$#8E3#+1Z4HW/WJ2+W/#845G�1@%R#+#+2[!�E3.-9(#+W/1|45')#Z# � #+2+6;,U*k#+WUY�.-=$17#8'G�4HW/W:G$.5,/17#2+.-G$9(,/67,/.-G$18dcri.$'c2+.-EF%R.-G$#8G56;1"OJ!$,/2[!V45'G$,>G$SA9i4v6@4(~(6@!$#EF4H672+!$#+9Z17Y$1767#8E EF4YAG$.k6J!(4*5#:.-=$17#8'G$S3G$.-Gk,/67#8'74H67,/*5#$HnILKNM:dH "!$,/1j,/1jW>45=R#+WUW/#+9�� ��2���� �� � � ,G6@45=$W/#C�(d>8RdjtpW/67#8'7G(4H67,/*5#+W/Y5~l6@!$#B'745E3# 'v176@4H67#p2+.-EF%R.-G$#8Gk6{4HW/,/S-G(E3#8Gk6nEF4YZ'G�i^-#+9A4kG$9AE30$WU6;,%$W/#p2+.-EF%R.-G$#8G56;1f0$17#+9F6;.{E3.$9(#+Wi6]!$#f9(,/176]'=(0$67,/.-G3B.-'L4:%(45')67,/280$W4k'j1]%(#+#+2+!FG$.5,/17#2+.-EF%(.$G$#8G56:%(4H,>'G$Sid"tpS-4H,>Gl~u6@!$,/1JO"4H1,Em%$WU#8E_#8G567#+9TO",/6@!V6@!$# �q^-6;#8G$9(#+92+.H*H45'45G$2+#a4k%(%('45=R#+WUW/#+9 � ����� ����� � ~s0$17,>G$SZ6

  • �5±

    %(4H,>'G$Sid� !$#8GQ6@!$#3B'745E_# 'H176@4H6;#n2+.-EF%R.-G$#8Gk6a4HW/,/S-G(E3#8Gk63O",/6@!$,>G£4?176]4H67#F,/1n*H45'G$9(,/284H67#+1Z6@!(4H636@!$#B';45E3# 'H176]4H67#?2+.-EF%(.$G$#8G564HW/,US$G(E3#8G56:O,U6]!$,GQ4?176@4H67#,/1n4HW/67#8'G$SN4T5 �¥'G$9(,/284H67#+1c6@!(4v6L,G?G$.5,/17#]2+.-';'70(%$67#+9F#8Gk*-,>'G$176pB#84H6@0(')#F*5#+2]67.-'p2+.-EF%R.-G$#8Gk6:B.-':4?*45'),U#+6EF4H67,/.-G$1d

    "!$#},>EF%(.-')6@45G$2+#}.HBF2+.-EF%(#8G$1]4H67,>G$S�6@!$#N*H45'45G$2+#+1NO"4H1T4HW/17.�,>G5*5#+1;67,/S-4H67#+9sd X45=$W/#*�(d>§2+.-EF%(45'

  • �,�

    Clean

    Diagonal

    Pseudo

    Extended

    5 10 15 20 25 30 3510

    −2

    10−1

    100

    101

    Feature Vector Coefficient

    Ave

    rage

    KL

    Num

    ber

    rL,US$0('

  • �,+

    2+.-EF%(#8G$1]4H67#+9}17Y-1;67#8EZdAMx.-EF%(#8G$1]4H67,>G$S|6@!$#?*4k'45G$2+#A,>EF%(').*k#+9N6@!$#AG$.5,/17#Z'GQ6@!$,/19(, �s#8'G$S5W/#]C%(4H171F6]'74H,>G$,>G$Si~.-'j=R#+6767#8'hOJ!$#8G?6@!$#B';45E3# 'H176]4H67#c2+.-EF%R.-G$#8G56"4HW/,/S-G(E3#8Gk6"O",/6@!$,>GZ4176@4v67#",/1"4HW/WU.HOc#+9?67.3*45'G$SFB4H2+67.$'j.vB(d ±67.FSk,U*k#n45%(%('EF4v67#+W/Y&459���`(b��:dri.-'6@!$,/1F17#+2+6;,U.$G.-G$W/YG$.-Gk,/67#8'74H67,/*5#&HnILKNMPO,U6]!6@!$# H:,>4HS5.-G(4HWc2+.H*4k'45G$2+#45%(%(').^$,>EF4H67,/.-GOx4v1f2+.$G$17,/9(#8'45G2+.-EF%(.$G$#8G5671O"4H1n6@!$#8GQ'=$W/#T67.N4HW/W/.O 6@!$#?B';45E3# 'H176]4H67#F2+.-Em%(.-G$#8Gk6A4HW/,/S-G(E3#8Gk6

  • �,�

    O",/6@!$,>G4V176]4H67#Z67.N4HW/67#8'+~"4kG$9�4H91�)0$1;6F6@!$#|G$0(Ea=R#8'F.vB{2+.-Em%(.-G$#8Gk671F,>G6]!$#Z2+.-'7'70(%$67#+9$1]%(#+#+2+!E3.-9(#+Wd�G2+.-G56]'74H176367.T6@!$#VOf.$'7\T.-G¡lY(G$^�¢#+WU,/2+.-%$6;#8'AG$.5,/17#5~c6]!$#|4H,>E�!$#8'G6@45=$W/#5�(d �(dLtpW/67#8'gG(4H67,/*5#+W/Y5~s4HW/Wo6]!$#a2+.$'7'70(%$67#+9$1@%R#+#+2[!V2+.-Em%(.-G$#8Gk671pB'G6@!$,/1xG$.k,U1;#:2+.-G$9(,/67,/.-G?2+.-G$17,/1767#8Gk67W/YFS-4*5#17W/,US$!567W/YZ=(#+676;#8'f%R#8'gB.-'7EF45G$2+#pY$,U#+W/9(,>G$SZ4A§ �P,>EF%('G$S£4T6G$28'G$S?6@!$#nG-0(E3=R#8'".HBL2+.-EF%R.-G$#8Gk671",/1{4*5.k,U9(#+9sd

    /� 4(B ��� �;B ����� �� � 2 � % %� ����A4 ( �*% +�������� � � ��� ���*( � 6���� B 4 "!$#%('G$ST45%(%('EF4v67#+W/Y0(G(4��s#+2+67#+9T4H6{!$,/S-!B'GZ6@!$#2+.-G5*k.5W>0$67,/.-G(4HWoG$.5,/17##+1767,>EF4H6;#5d �h.56@!6@!$#3,U6;#8'74H67,/*5#345G$9NG$.-Gk,/67#8'74H67,/*5#"HnIqKzM172+!$#8E3#+1:Oc#8'G$#+9sdnb.567#6@!$#F`(b�� �(0$.567#+9T,>G6@!$,/1f1;#+2+67,/.-G?Oc#8'EF4H67,/.-GV172+!$#8E3#F9(#+1;28'=(#+9},Gz17#+2+67,/.-GN±(d��(d: "!$#A%(#8'CBD.-';EF45G$2+#3O"4H1{4k%(%('EF%$W/#F4H9(9(,/67,/*5#FG$.5,/17#n284H1;#�5djG6@!$,/1J17,/6@0(4v67,/.-GZ6@!$#:,/67#8';4H67,/*5#172[!$#8E_#nO"4H1J0(G$W/,>\H#+W/YT67.F,>EF%(' ³�H? H36EB H3; ? HBG9H 9BGH9 D�H361B H�;7? HBJ9H79BGH9�;7BD@�B�K1?NH I 8L@�BGFGH3> ³ FG?�R O1= @�=;µ�>:B�T� ? ;7B ¾ B�@ M 8 ¾ BDK"H36EB 9H=�H38:? K1= @³/KE=�H¤´�@�B ? P H361B �-³�KHà � BD>L8:FG?OEHBD@ KE?8:9B DEH3628:9:I 61= ¾ B >L8:HH3>:B BgÁ�BGFGHGT

  • �5

    `(%R#+2 Mc.$EF% tp9i45%$68d s#+1;6J`$#+6 tp*5#8'74HSk# c,/WU6 c,/WU6 `$#8Gk68d ri#8=�� �5 �p2+6 ���5 ri#8=�� (� � 8 +(d ± �(d> �(d¶ +(d¶� � 8 8±Rd ± d  5kd ± d � � 4vWUW +(d �(d  +(d  +(d ±

    o45=$W/#C�(d> + � �N.-')9|#8'7'G$176G-0(E3=(#8'q.HB¨4H9i45%$6]4H67,/.-G17#8Gk67#8G$2+#+1f0$17,>G$S HnILKNM}O",/6@!6@!$#(H:,>4HS5.-G(4HW(2+.H*H45'45G$2+#J45%(%(').^$,>EF4H67,/.-G.-GZ¡lY(G$^|¢"#+W/,/2+.-%$67#8':4H9(9(,/67,/*5#345G$9Z2+.-Gk*5.5W>0$67,/.-G(4HWXG$.5,/17#]2+.-'7'70(%$6;#+9 �cK�4v6{ �H9��pd

    GT%('74v2+67,/2+#F,/6:,U117#+W/9(.-E�4H2+2+#8%$6@4k=$WU#?67.?O"4H,/6n0(G567,/WL6@!$#3#8G$9N.vBf4?2+.-EF%$W/#+67#F17#+1;17,/.-GT=(#]B.-'0$67,/.-G(4HWsG$.5,/17#5d(�jYZ0$17,>G$SA34H9i45%$6]4H67,/.-Gm17#8G56;#8G$2+#+1"6@!$#n%(#8'CBD.-';EF45G$2+#:O"4H1f4k%(%('EF4H6;#+WUY6@!$#:1@45E3#:4H1"6]!$#{4H9(9(,/67,/*5#3G$.5,/17#AHnILKNM�17Y$1767#8E 4kG$9A6@!$#n0$1;#:.HBsB0('G

  • 5

    4T+ ��'GTOc.-'EF%$W/#?1@%(#84k\H#8':4H9i45%$6@4v67,/.-Gl~l,>GN4H9(9(,/67,/.-GQ67.A2+.$EF%(#8G$1@4v67,>G$SZB.-'p6@!$#32+.-Gk*5.5W>0$67,/.-G(4HWG$.5,/17#n2+.-Em%(.-G$#8Gk68d

    `(%R#+2 Mc.$EF% tp9i45%$68d s#+1;6J`$#+6 tp*5#8'74HSk# c,/WU6 c,/WU6 `$#8Gk68d ri#8=�� �5 �p2+6 ���5 ri#8=�� (� � � �(d  +(d ± ±(d ± �(d¶� � � �(d  �(d  8Rd> (d � � �� �(d  +(d � +(d> +(d �

    o45=$W/#A�(d> � � �N.-' �p1]!$.O1j4:=(' ��Oc.-'0$67,/.-G(4HW¨G$.k,U1;#J=(4H9(W/Y39(#+S-'74H9(#+9F6]!$#J%(#8'gB.-'7Em45G$2+#".HBl6@!$#"17Y$1767#8E ,©Bs,/6jO"4H1LW/#]BD6c0(G$2+.-EF%R#8Gk1@4H67#+9sd�17,>G$S&4vWUWX6@!$#67#+176"9i4H6]4F67.m#+1767,>EF4H67#6@!$#n1]%(#+2+6@'74vWs67,/W/6n=('0$67,/.-G(4HWlG$.5,/17#.-GT4Z%(#8'g1@%R#845\H#8'WU#+*k#+Wj,>EF%('

  • (

    `(%R#+2 Mc.$EF% tp9i45%$68d s#+1;6J`$#+6 tp*5#8'74HSk# c,/WU6 c,/WU6 `$#8Gk68d ri#8=�� �5 �p2+6 ���5 ri#8=�� (� � 8 5Rd  8±Rd � �Rd +Rd¶� � 8 ud  5±Rd  ,�Rd  5Rd � � 4vWUW 5Rd  +Rd 8±Rd � +Rd +� � � +ud � +ud � 5kd + d +� � �� +Rd¶ �Rd ± +ud¶ �Rd>

    o45=$W/#C�(d> � �N.-')9|#8'7'G5*5#+1;67,/S-4H67#+9 6@!$#0$17#£.vBmIqKNM 4kG$9 HnIqKzM.-G�4�1@%R#845\H#8'g,>G$9(#8%(#8G$9(#8Gk6E3#+9(,>0(E17, #+#N*5.$2845=(0$W>45'G567.Z6]!$#3BD#84v6@0(''G$ST,>G$2+.-'7%(.$'74H67#+9}9(Y¦G(4kE3,/2A2+.$#EDA2+,/#8G56;1F,>G567.V6@!$#mBD#84H6]0('G4?G$.5,/17#]2+.-';'70(%$67#+9N#8Gk*-,>'QT� ? ;7B ¾ B�@ H36EB = ¾ BD@�=NM�B O�BD@PQ? @�RA=KEFGB 9361?7´2>:Ipµ�B FG?NR OE=@�=;µ�>:B�T

  • 5

    172[!$#8E_#+1FO"4H1n,>Gk*5#+1767,/S-4H6;#+9sdTrL,G(4vWUW/Y6@!$#Z0$17#Z.HB�HnILKNM B.-':1;,U6]0(4H67,/.-G$1FOJ!$#8')#Z6@!$#8'0$67,/.-G(4HWoG$.k,U1;#nO"4H1c#+^¦4kE3,>G$#+9sd

    "!$# �¨'G5*5#+1;67,/S-4H67#+9O"4H1FOp!$,U2+!%(45'74kE3#+67#8'Gk67.N6@!$#BD#84H6]0('G$SZ6@!$#32+.-EF%(.$G$#8G56:4HW/,/S-G(E3#8Gk671:67.?*45'G$S417Y-1;67#8E B').-E�ª71728'74v672[!$«?.-GT6]!$#F2+.-'7'70(%$6;#+9N9i4H6@4?9(,/9G$.56cS5,/*5#n=(#+676;#8'"%(#8'gB.-'7Em45G$2+#J6]!(45G?6@!$#p17,>G$S5W/#]C%(4H171p6@'74H,>G$#+9Z17Y$1767#8EZdL "!$,/1B4v,UW>0('45Gl~l2845GV=(#F4H676@'),=(0$6;#+9|67.6@!$#n%(.$.-'xB'74kE3# 'H176@4v67#J4HW/,/S-G(E3#8Gk6{4v2[!$,/#+*5#+9VOJ!$#8G|G$.5,/17#]2+.$'7'70(%$67#+9V9i4H6@4,/1{0$17#+9V,>GZ6@'74v,G$,>G$Sid

    ¢p48*$,>G$SN#+176@4k=$WU,/1@!$#+9�6@!(4H63B.-'S5.$.-9�')#+2+.5S-G$,/67,/.-G�%R#8'gB.-'7EF45G$2+#Z,/6FO"4H1FG$#+2+#+171]45'GF6@!$#"IqKzMzB'745E3#+Oc.-'7\pOc#8'G$#+9sdj "!$,/1j2+.-G$2+#8Gk6@'74v67#+93.-GOJ!$,/2[!31;6@4H67,/1767,/2+1Ea0$1;6x=R#:#+^¦%$W/,/2+,/67W/Y|176;.-'G$SF6@!$#n¡ Y¦G$^Z¢"#+W/,/2+.-%$67#8'pG$.5,/17#5~(6]!$#J# �s#+2+6".HBX*45'G$SF6@!$#pB'745E3# 'v176@4H67#2+.-EF%(.$G$#8G564HW/,US$G(E3#8G56mO",/6@!$,>G�4V176@4H6;#5~o,/67#8';4H67,/*5#|ILKNM:~eO"4H13#+^¦45E_,G$#+9sd "!$# �L^$67#8G$9(#+9�2+.*H45'45G$2+#|45%k%('EF4H6;,U.$GZO"4H1J0$17#+9VB.-'c6@!$#+1;#n#+^(%(#8'E3#8Gk6718drL,')1767W/Y5~l6@!$#n1]45E3#nG$0(Ea=R#8'p.HBL2+.-EF%(.$G$#8G5671:4H16@!$#3.-'G(4HWL2+W/#845GTE3.$9(#+WU1O"4H1{0$1;#+9z4kG$96]!$#_4vWU,/S-G(E_#8G5671:O,U6]!$,Gz6@!$#3176@4H67#34HW/W/.Oc#+9T67.Z4HW/67#8'+d "!$,/1",>EF%('G$S_E30$W/67,>%$W/#n2+.-Em%(.-G$#8Gk671c67.aE_.-9(#+Wu6@!$#J2+.$'7'70(%$67#+9$1@%R#+#+2[!?9(,/176]'=(0$67,/.-G?B.-'L#84v2[!m1@%(#+#+2+!45G$9|G$.5,/17#n2+.$EF%(.-G$#8Gk6J%(4H,>'G$Si~l4Z8 � ,>EF%(').*k#8E3#8G56,GV%(#8'gB.-'7Em45G$2+#:.-G?6@!$#F �v9���9i4v6@4(~(45G$95 ��4H6n8H9�� Of#8')#a4H2+!$,/#+*5#+9sdn "!$,/1p,G$9(,/284H6;#+1n6@!(4H6B.-'"=(#+1;6n%(#8'gB.-'7EF4kG$2+#a,>GTG$.5,/17#]2+.-';'70(%$67#+9#8G5*$,>'G4Z2+.-Em%$WU#+^kCG$.5,/17#V#8G5*$,>'G$# Fn0(G}G$.5,/17#AO"4H16@!$#8G#+^¦45E_,G$#+9sd F:.$.-9}%(#8'gB.-'7EF4kG$2+#F.-GV6@!$,/136@4H1@\?O"4H1n4H2+!$,/#+*5#+90$17,>G$S4Z1;,G$SkWU#]2+.$EF%(.-G$#8Gk6FG$.5,/17#E3.-9(#+W~p9(#+1@%$,/67#T,/671|%(.$.-'?E3.$9(#+WUW/,>G$S�.HBn6@!$#NG$.5,/17#T17.-0(')2+#5d�t�6

  • 6@!$#n,/67#8'74v67,/*5#nILKNM�172+!$#8E3#+1:EF4YA=(#30$17#+9sd(�jY|4vWUW/.HO",>G$S?6@!$#n2+.-Em%(.-G$#8Gk6J4HW/,/S-G(E3#8Gk6JO,U6]!$,GT4176@4H67#c67.:*H45'0$67,/.-G(4HW¨G$.k,U1;#"O"4H1j45'4HW/W/YA,>Gk6@'Gk*5#+1767,/S-4v67#+9T67."�¨G$9.-0$6:OJ!$#+6@!$#8'+~lSk,U*k#8G|1]0JDA2+,/#8G566@'74H,>G$,>G$S|9i4H6]4F6@!$#31@%R#+2+6@'74HWL6;,UW/63EF4Y|=(#F#+176;,Em4H67#+9N45G$9T,>G$2+.-'g%(.-'74v67#+9Z,>G567.m6@!$#aIqKzM�%('4H13#+176;,Em4H67#+90$17,>G$Sz4vWUWc6@!$#67#+176L9i4H6@4Fw 5p17#8Gk67#8G$2+#+1@yqOx4v1j4H2[!$,/#+*5#+9sdh "!$#"64H67,>G$S4?2+.-Gk*5.5W>0$67,/.-G(4vWjG$.5,/17#F=$,4v1n.H*5#8'p4HW/Wo6@!$#31@%R#845\H#8'

  • � ����������� �

    � ���c� �h��� ��� �� � � � � �������� � � � � � ����� ���

    "!$#At! "Iut 8kH|M"`" "bt$# #+*4HW>0(4H6;,U.$G},Gk*5.5W/*5#+9s~h4H1a41@%(.-\v#F6@4H1@\w`l5y+~o4kGT#+*4HW>0(4H6;,U.$G}.HB1@%(#+#+2+!'GN6@!$#Z%('Gk67#8'gB#8'G$SzG$.k,U1;#5d| "!$,/13,U1F4VW>45''"17Y$1767#8E_1x0$1;,G$S?6@!$#1@45E3#:6@';4H,>G$,G$S?45G$9|67#+1;6f9i4v6@4(d

    #&% ')(+*-, ( ��/. � *0* �2143&5 76 ( ��.!8+9 � * "!$#Nt! "Iut�5HM"`" "bt$#�`(%R.-\H#8}2+.-G$17,/176;1Z.HBa9i4H6]4}6@45\H#8GB'E3#8G$17,/.-G(4HWcB#84H6@0(')#F*5#+2+67.-'§db.567#F6]!(4H68~X,>G}2+.-G56]'74H176:67.T6@!$#176@45G$9i45')9|¢J �� 1;Y-176;#8EZ~iG$.AMc#8%$1;6@'74HWlKT#845GZb.-'7EF4HW/,/1@4H6;,U.$G£wMcKNbpyhOx4v1x0$1;#+9sd

    "!$#Z4H2+.-0$176;,U2Z6]'74H,>G$,>G$SN9i4H6@4V2+.-G$17,/176;#+9.HB LK $ 17#8Gk67#8G$2+#+13B'G$S:6@!$#IDRHhBD#84H6]0('GN4Z1;,G$SkWU#?%(4H171a4kG$9z4kGN4H9(9(,/67,/.-G(4HWh1@E3.$.56@!$,>G$S|%(4H171n%R#8'gBD.$'7E3#+9sd3ri.$'p6@!$#A`l8?1@%R.-\H#5~6@!$#:176@45G$9i4k'G$2+.5W>GT¡s45=$1p±5\F6]'

  • Of#8')#:#+1767,>EF4H67#+9Z.$G?6@!$#A8kHF`(39(#+*5#+W/.-%(E3#8Gk6J1]%(.-\H#:9i4v6@4(dL "!$#n`(m9i4H6@4H17#+6cO"4H1"0$17#+9T4H1",/6",/14:2+.-EF%(4k'745=$W/#"6@4H1]\n6;.:6@!$#J`l86@4H1@\O",/6@!AE_.-'E3,/17#+9%R#8'gB.-'7EF45G$2+#BiS-0(' ��B.-'e6@!$#c176@45G$9i4k'G$S51"Oc#8'nIqKzM ,>GQ6@!$#mBD.-';E�.HB"6@!$#&G$.$Gk,U6;#8'74H67,/*5#�>:,>4HS5.-G(4HWL2+.H*H45'45G$2+#45%(%('EF4v67,/.-G?.-'c6@!$#n¡ .5SHtp9(945%(%('EF4H67,/.-G?O"4H1"0$17#+9V67.32+.-EF%(#8G$1]4H67#:6@!$#3E3.-9(#+W/1:0(G$W/#+171.56@!$#8'0$#5da "!$# K 9 #PG$.k,U1;#a2+.$G$9(,U6;,U.$GOx4v1"B.-0(G$9T67.|=(#367.$.Z17#+*5#8')#a6;.A.-=$6]4H,>GE_#845G$,>G$SHB0$Wc':,4vS5.-G(4HW Y(d© 5kd  +id  8(d© id >:,4vS5.-G(4HWjw¤KT#845G(y 8 8Rd¶ d  5(dWY LK d K¡l.5SvtJ9(9 � 8 8Rd +id  (5d© Y(d©

    o45=$W/#Z(d>&NN.-'EF%('L8:938LK�M H36EBÅÆ ¹ 5�¿�;7= ¾ RAI8À 9?P H3;7= @�B��DT � ? ;7B ¾ BD@ ? K"H361B�Z¹��/I�=�H=7µ1=N9B H361B RA=]à ?P H36EBA93O�BGBJF 6";7=N9 FG= >:Fg´�>:=�HBGI�? ¾ BD@ H36EB;76E?>:B ? P$H36EB HBG9H79BJHGT�576�8:97@�BG9¤´2>:HBJI/8LK�= K�= O2O�@�?7Ã�8:RA=�HB���I� I 8¶Á�BD@�BDKEFGB-8LK¹ Å ·�D2H36+´E97H36EB � �NI�� KE?8:9B >:B ¾ BD>�8LKH=7µ2>:Bj»2T � ;7=N9 D�?K"=ARABJ=K�93O�BGBGF6"H? K1? 8:9B->:B ¾ BD> D�= O2O�@�?7Ã�8:RA=�HBD> ³ �7¼ I��

  • K

    17,>EF%$W/#8'f4k%(%('EF4H6;,U.$G31@!$.HOc#+9F2+.-EF%(45';45=$W/#J%(#8'gB.-'7Em45G$2+#"67.6@!$#R>nILKNME3#84kGk2+.-EF%(#8G$1]4H67#+917Y-1;67#8EZd

    r¨').-E�6@!$#39(#+*5#+W/.-%(E3#8Gk6F'GZ%(#8'CBD.-';EF45G$2+#pOf#8')#".-=$17#8'G$S3*45'45G$2+#:2+.$EF%(#8G$1@4v67,/.-Gld

    KT.-9(#+W `(b: �w¤9 #cy`$#+6 McW/#845G H M 8

    Mc.-Gk67,>G$0$.-0$1E3# MRd 8(d¶ 8±Rd ± d ± -(dCY

    o45=$W/#n(d© NN.$'0(4H6;,U.$G�9i4H6@4T2+.$G$17,/17671?.HBA5 1;#8G567#8G$2+#+1?1@%R.-\H#8G=5Y�8V9(,�� #8')#8G56F1]%(#845\H#8')18~f4vS-4H,>G'G$9(,U284v67#+1J6]!(4H6c6@!$#n'

  • LY

    85 �Zderi.-'h4HW/Wl6@!$#J#+*H4HW>0(4H67,/.-G?G$.5,/17#:2+.-G$9(,/67,/.-G$1"6]!$#JE3#845GkC45G$9$*H45'45G$2+#]2+.-Em%(#8G$1@4H6;#+9|17Y$1767#8E%(#8'gB.-'7E3#+9B4k'FOc.-'EF4H67,/.-GOx4v1{45%(%(').^$,>EF4H67#+W/YV6@!$#F1@45E_#a4H1:6@!$# >nIqKzM E3#845Gk2+.$EF%(#8G$1@4v67#+9N17Y$1767#8E�.H*5#8'p4HW/WL6@!$#FG$.5,/17#2+.-G$9(,/67,/.-G$18d

    e.a,>Gk*5#+1767,/S-4v67#J6]!$#"B4H,/W/,G$S?.HBo6]!$#J*H45'45G$2+#n2+.$EF%(#8G$1@4v67,/.-GF.$GZ=(.56@!m6@!$#:#+*H4HW>0(4H67,/.-GZ45G$9s~$67.4:W/#+1717#8'q#+^-67#8Gk68~k6@!$#"9(#+*5#+W/.-%(E3#8Gk6c9i4H6@4(~54EF4H672+!$#+9A¡l#+*k#+W #+*H4HW>0(4H67,/.-Gm9i4H6@4p17Y$1767#8E O"4H1j=(0$,/WU6=5YT4H9(9(,>G$S|6@!$#A4v9i45%$6@4H67,/.-GVG$.5,/17#F9i4H6]4?67.&4vWUWh6@!$# N�`"!Z6@'74H,>G$,>G$S|9i4H6]4(d:t�17#+6:.HBfE3.$9(#+W/1nO"4H16@!$#8GT=(0$,UW/6.-GV6@!$,/1:2+.-'7'70(%$67#+9$1]%(#+#+2+!T9i4H6@4(~l0$17,>G$SZ6@!$#B'745E3#��H1;6@4H67#:2+.-Em%(.-G$#8Gk6n4HW/,/S-G(E3#8Gk6:.HB6@!$#32+WU#84kG|1]%(#+#+2+!lda "!$#F¡l#+*k#+W G$.5,/17#32+.-G$9(,/67,/.-GzOx4v1J2+!$.517#8GT4H1p,/6:1@!$.HO"1J6]!$#aW>45')S5#+176p9(,U1]%(45'g,U6G£%R#8'gB.-'7EF45G$2+#5d?`$,>G$2+#Z6@!$,/1aEF4H6;2[!$#+9N1;Y-176;#8E�1@!$.-0$W/9=(#?6@!$#F1@4kE3#F4H1n6@!$#m2+.-EF%(#8G$1]4H67#+917Y-1;67#8EZ~(4H171@0(E_,G$Sm6@!(4H6c6@!$#nE3.$9(#+W/1JOc#8'GZ9(#+6]4H,/WDd

    Clean

    Diagonal

    Diagonal (Mean)

    5 10 15 20 25 30 3510

    −3

    10−2

    10−1

    100

    101

    Feature Vector Coefficient

    Ave

    rage

    KL

    Num

    ber

    rL,US$0('ptJ*k#8'74HS5# �:¡�G$0(E3=(#8'BD.$'p2+WU#84kGl~?>nILKNMPE3#845GkC4kG$9$*45'45G$2+#]2+.$EF%(#8G$1@4v67#+9�45G$9E3#845Gk2+.-EF%R#8G$1@4H67#+9TE3.$9(#+Ws17#+671".$GZ¡l#+*5#+W t! "Iut `(%(.$\H#A8#+*H4HW>0(4H67,/.-GTG$.5,/17#

    rL,/S-0('c1@!$.HO"1h6@!$#:48*k#8'74HS5# �:¡TG$0(E3=(#8'c=(#+6G$S5W/#]C%(4H1;1JEF4H672+!$#+9F17Y$1767#8E 45G$9#84H2[!_.HBs6@!$#JE3#845Gk2+.$EF%(#8G$1@4v67#+9&4kG$9F6@!$#JE3#84kGkC45G$9$*45'),4kG$2+#]2+.-EF%(#8G$1]4H67#+9Z17Y$1767#8E31doru#84H6@0('GT67#8';E31:.HBf6]!$#_4*5#8';4HS5# �:¡�G$0(E3=(#8'+~,U6pO"4H1c17W/,/S-!56;WUY|=R#+6767#8'c6;.F2+.-EF%R#8G$1@4H67#:6@!$#3E3#845G$1J4kG$9Z6@!$#n*H45'45G$2+#+18d

    "!$#"Oc.-')9a#8';'0(EFG_.HBs6@45=$W/#J(d¶ud "!$,/1a1]!$.O1n6@!$#?1@0('7%('G$S£')#+1@0$W/6a6]!(4H6n#+*5#8GQOJ!$#8GQ6@'74H,>G$,>G$S£417Y-1;67#8E 0(G$9(#8'FEm4H672+!$#+9N2+.-Gk

  • LM

    KT.$9(#+W ¡ #+*5#+W `(b: `$#+6 =L*4vW0(4v67,/.-G tp9i45%$68dib.5,/17#

    >:,>4HS5.-G(4vW ±(d +ud >:,>4HS5.-G(4vWqwDK#84kG(y k5d  5kd¶`$,>G$S5W/#]CIL4H171 (d> 8Rd

    `$,>G$S5W/#]CIL4H171Fw¤KT#845G(y (dCY 5kd¶

    o45=$W/#|(d NN.-'GldN "!$,/1F1@!('G(\k,G$SQ.HB6@!$#F*4k'45G$2+#+1FEF4YEF45\v#a6]!$#F17Y$1767#8E�W/#+171F'GN9(,��s#8'G?2+.-EF%R#8G$1@4H67,/.-G?O"4H1h#8EF%$W/.Yk#+9Z,G6@!$,/1",>EF%$W/#8E3#8Gk6@4H67,/.-G?.HB7>nILKNM"y+~k.-'c4H1"4aE_.-'G$#+9Z=5Y32+.-EF%R#8G$1@4H67,>G$S36@!$#p*45'),4kG$2+#+1jB.-'6@!$#J9i4v6@4pS5#8G$#8'74H6;#+9A.-G_6@!$#{G$.k,U1;#{4H9i4k%$6@4H67,/.-G39i4v6@4(do !$,U1c,>G$9(,/284H67#+1"6]!(4H6j6@!$#p%('45'0$67,/.-G(4HW"G$.5,/17#Z2+.$EF%(.-G$#8Gk68dT o4k=$WU#|Rd ±Z1@!$.HO"136@!$#%(#8'gB.-'7EF4kG$2+#A.HBp1@0$2[!4V172+!$#8E3#?.-GQ6@!$#Zt$ Iit85vM"`" "bt!# `(%R.-\H#N8#+*4HW>0(4H6;,U.$G9i4H6@4Rd cOc.F. �s17#+68~$1@%R#845\H#8'p4H9i45%$6@4H6;,U.$Gl~(#+1767,>EF4H6;,U.$GZ172+!$#8E3#+1pOf#8')#:,Gk*5#+176;,US$4H67#+9sd" "!$#&B¨'EF4v67#Z6@!$#Z. �s17#+6A4kG$9Ox4v1a.$G$WUY#+^(45E3,>G$#+9�.-G6@!$#Of.$'EF%$W/#T. �s17#+6A4v9i45%$6@4H67,/.-G}1;2[!$#8E3#5d #j.k6@!6@!$#E3#845Gk2+.-EF%R#8G$1@4H67#+9|4kG$9&E3#84kGkC45G$9$*45'),4kG$2+#]2+.-EF%(#8G$1]4H67#+9E_.-9(#+Wl17#+671h1@!$.HOc#+9A,>EF%('

  • 5

    KT.$9(#+W tp9i45%$6 b.5,/17#nMc.$G$9(,U6;,U.$G`$#+6 `$#8Gk68d ¡l#+*k#+Wj ¡l#+*5#+WL ¡ #+*5#+W

    >:,>4HS5.-G(4HW 8 � 8 8 8(d >:,>4HSk.-G(4HWfw¤KT#845G(y 8 � 8 8 8(d >:,>4HS5.-G(4HW � Y(dCM YRd  8(d >:,>4HSk.-G(4HWfw¤KT#845G(y � Y(dCY K d  8(dCY=L^$67#8G$9(#+9 � Y(d ± YRd  8(d>¡l.kSHtJ9(9 � 8 8 8(dCY

    o45=$W/#T(d ± NN.-'G$9(,U284v67#+1:6@!$#n0$17#:.HBL6@!$#:,/67#8'74v67,/*5#n172+!$#8E3#5d

    17#+6&4Q'G$SZ6@!$#*45'45G$2+#V17W/,/S-!56;WUY,>EF%(').*k#+9£6@!$#|%R#8'gB.-'7EF45G$2+#5dgG}67#8'7E313.HB:6@!$#?176@45G$9i45')99(#+*-,>4H67,/.-G}.vB{6@!$#Of.$'GF%(#8'CBD.-';EF45G$2+#jO"4H1X.-=$17#8')*5#+9F=(#]6COc#+#8G6@!$#R=L^$67#8G$9(#+9F2+.H*H45'45G$2+#"45%(%(':,>4HS5.$G(4HW-2+.H*H45'45G$2+#J45%(%(').^$,>EF4H67,/.-G17Y-1;67#8E318~k6@!$.-0$S-!?417W/,US$!56c,>EF%('45'G$S|%(.5,>Gk6718dG?2+.-Gk6@'74H1;6f6;._%(')#+*-,/.-0$1"#+^(%(#8'),E_#8G5671p.-G?4FE3#+9(,>0(E17,��+#3*5.$2845=(0$W>45'G$SA6@!$#*45'45G$2+#+1m.HBJ6@!$#ZE3.$9(#+WU1m9(,U9�G$.k6n,>EF%('G$#+9s~sOp!$#8'

  • 8k

    1@%(#845\v#8'p9(, �s#8'Gldn "!$,/1a'G36@!$#"%(#8'CBD.-';EF45G$2+#".HBl6@!$#JE3#84kGkC45G$9$*45'),4kG$2+#]2+.-EF%(#8G$1]4H67#+9?17Y-1;67#8E O"4H1L9i0$#"67.:1@%R#845\H#8'*45'45=$,/W/,/6EF%$W/#8E3#8G56;#+9|!$#8'G4Z176@4v67#5~X#+^¦%R#8'E3#8G56;1F.-G cK�,>G$9(,/284H67#Z6@!(4v6a6]!$,U13,>EF%('

    o45=$W/#|(d K 4NQ.-'EF4H6;#+9�45G$9£6]!$#?BD#84H6]0('

  • 8R

    G$,/67,>4HW/W/YFW/.$.-\5,>G$SF4H6X6@!$#"2+W/#845GF%R#8'gB.-'7EF45G$2+#.-G6@!$#c#+*4HW>0(4H67,/.-Gl~$6@!$#176@45G$9i45')9_¢p ���17Y$1767#8E!(4H9�4QB45'mW/.HOf#8'?#8';'EF%$W/#8E3#8Gk67#+9¬!$#8')#5dF "!$#F9(,��s#8'G£%R#8'gB.-'7EF45G$2+#=(#+6

  • � ����������� ���

    � ��� �-�c� � h��� � �� � � � �� �� ��� �

    "!$,/1"6@!$#+17,/1J!(4H19(#+6@4H,/W/#+9|6@!$#p9(#+*5#+W/.-%(E3#8Gk6".HB43E3.$9(#+W©C=(4H17#+9TG$.5,/17#n2+.-Em%(#8G$1@4H6;,U.$G?67#+2[!(G$,!�(0$#5~IL45'74HW/W/#+W"KT.-9(#+W"Mc.$Ea=$,>G(4H6;,U.$G�wILKNM"y+dL "!$#|=(4v17,/2|4H,>E,/1F67.N4HW/67#8'36@!$#|%(4k'745E3#+67#8')1a.vB{4T17#+6.HB_¢KTK1Z6]'74H,>G$#+9�,G4}2+WU#84kG�#8Gk*-,>'EF4v67#+1j.HBs6@!$#2+.-'7'70(%$67#+9$1]%(#+#+2+!ZE3#845G$1f4kG$9F*45'),4kG$2+#+18dtJW/67#8'7G(4v67,/*5#+W/Y5~hB4H1;67#8'+~L17,>EF%$W/#8'+~c#+1;67,>EF4H67,/.-G172[!$#8E_#+1AEF4Y£=(#T0$17#+9sdru.-'176@4H67,/2|%(45';45E3#+67#8'EF%$W/#8'Z45%(%('

  • 8

    �� % . 5F®�� 8 3�� * 9 5 ��� 9 "!('G$S5W/#|%(4H171aG$.k,U1;#]2+.-'7'70(%$67#+9E3.$9(#+W/18d c#+2+.5S-G$,/67,/.-G%R#8'gBD.$'7EF45G$2+#?O"4H1n4HW/17.T2+.-EF%(45';45=$W/#FO",/6@!Q6@!$#&Em4H672+!$#+9N17Y$1767#8E318~X4H2+!$,U#+*$,>G$S£ �Of.$'0$67,/.-G(4HWfG$.k,U1;#A6@4v1@\VOx4v1:1@0(%(%$W/,U#+9s~c4HW/W/.HO",>G$Sz4VE3.-'0$67,/.-G(4HW"G$.5,/17#|Oc#8'G$2+#b��:`"=��C5TO"4H1367.$.T17,>EF%$W/#|67.N''pt$ IitZ c#+17.-0('G$S5W/#]C%(4H1716@'74H,>G$#+9N17Y$1767#8E�%R#8'gB.-'7E3#+9N=(#+1;6nOJ!$#8GN=R.56@!V6@!$#AE_#845G$1n45G$9T*45'),4kG$2+#+1a.vBx4HW/WL6@!$#FE3.$9(#+Wf%(4'745E3#+67#8')1_w¤,d¶#5d176@4H67,/25~u9(#+W/6@4Z45G$9T9(#+W/6@49(#+W/6@45yOf#8')#n2+.-EF%R#8G$1@4H67#+9sd3 "!$#FG$#+#+9T67.?2+.-EF%(#8G$1]4H67#6@!$#39(Y¦G(45E_,U232+.$#TSA2+,/#8G56;1:,Gk6@'G5*k.5W/*5#+9G$.-Gk,/67#8';4H67,/*5#|ILKNM:~XOJ!$#8')#Z6@!$#?B';45E3#��H176]4H67#?2+.-EF%(.$G$#8G564HW/,US$G(E3#8G56?,/1A4H171]0(E3#+9�67.N=R#0(G(4HW/67#8'EF%('GZ.HBj0$17,>G$SA1]%(#845\H#8'4H9i45%$6@4H6;,U.$Gl~¦4vW=R#+,/6:17,>EF%$W/#5~i,>GG$.5,/17#n2+.-Em%(#8G$1@4H6;,U.$GZ67#+2+!(G$,!�¦0$#+18d

    "!$#&B¨G(4HWo9i4v6@45=(4H17##+^¦4kE3,>G$#+9O"4H16@!$#nt! "Iut 8kHAM"`" "bt!#�`l8?G$.5,/17#31@%R.-\H#5d" "!$,/1:,/14nW>45')S5#J*k.-2845=(0$W>45')YA6@4v1@\i~$±555Oc.-'GT6@!$#B.-'7E.HBx4?=$,>4H1n.-GV6@!$#3176]4H67,/2FE3#845G$18~lO"4H1BD.$0(G$96;.Z,Em%('

  • 8v

    G?1]0(EFEF45'G|')#84HWlOf.$'G$S|E3.-''745=$W/#5d£gGN2+.-Gk6@'74v176n67.V6@!$#Z0$17#A.vBxW/,>G$#845'F')#+S-''Gk671n,>GT6@!$# >nILKNMP%('Gk*5#+1767,/S-4H6;#+9NB.-'6@!$#+17#?,/67#8'74H67,/*5#ZILKNM 284H17#+18d�p*5#8'74HW/W~i6]!$#8'4HS5.$G(4HWi2+.H*4k'45G$2+#JEF4H6]'\H#+W/Y�6@!(4H6F6@!$#P>nM �,>G4v9(9(,U6;,U*k#G$.5,/17#T2+.-G$9(,/67,/.-G$1?,/1AW/#+171|45%k%('G$#+9N6;.A17#+#mOJ!$#+6@!$#8'p6@!$#S-4H,>G$1,G�%R#8'gBD.$'7EF45G$2+#V.-0$6Gk*5#+1767,/S-4v67#+9sdjG$,/67,>4HWX#+^(%(#8'E3#8Gk671",>GZ4HW/67#8'G$S?6@!$#:G-0(E3=(#8'x.HB ;n4k0$1717,>45G?2+.-E%(.-G$#8Gk671XO",/6@!$,>Gn4c176]4H67#L!(48*k#j=(#+#8G3%(#8'gB.-'7E_#+9C� LMA@C~H=(0$6lB0(')6@!$#8'lOc.-'7\c,/1L'EF%$W/#A17,>G$S5W/#]176]4H67#FE3.$9(#+WU1345'EF%$W/, BY$,G$S 4H171@0(EF%$6;,U.$G$1|!(48*k#z=R#+#8G�EF4H9(#N45=R.-0$6Z6@!$#TB.-'7E®6@!(4H6Z6]!$#2+.$G5*5.kW0$6;,U.$G(4HWnG$.5,/17#2845G�6@45\v#5d ru.-'Z4HW/Wn6@!$#Q6@4H1@\k1Z,>G5*5#+1;67,/S-4H67#+9s~p6@!$#N2+.$G5*5.kW0$6;,U.$G(4HWnG$.5,/17#}Ox4v1Z176@4H67,/.-G(4k'EF%$W/#a4k%(%('EF4H6;,U.$GF,/1J45%(%(').-%('4H67#pB.-'j')#84HWsE3,/28'G$SF4Ox4YB''

  • 8k±

    6@!$#�� � �����a45%(%(').^$,>EF4H67,/.-G,>G|6]!$#_¡ .5SHC`(%(#+2+6]'74HWX9(.-EF4H,>GT45G$9|9(,/9NG$.56p2+.-G$17,/9(#8':'GZ45G$9Z#+176;,Em4H67,>G$SF6@!$#:9(Y(G(45E3,/2%(45'745E3#+6;#8'G$,>G$S?9i4H6@46@!(4H6"284kGZ=(#a0$1;#+9sd

  • � ��� �������� �

    � � ���h��� ��� ��� � � ��� �� �

    � ��� �� � ��� c��� ����2� � � � ����h���ri.-'?6@!$#}E3,/1@EF4H672+!�B0(G$2+67,/.-G$1|9(#8'),U*k#+9�,>G�6@!$,/1TOc.-'7\u~"6@!$#Q9(#+WU6]4�%(45'74kE3#+67#8'G$9(.HO�B.-'c6@!$#9(#+W/6@4A%(4k'745E3#+67#8')1x=R#n6@!$#1@45E3#4H1"6@!$#:9(#+W/6@49(#+W/6@4?%(45'74kE3#+67#8'

  • 8 Y

    GV6@!$#31@45E3#B4v1@!$,/.-GT4H1J6]!$#_E_,U1]EF4H672+!?B0(G$2+67,/.-GVB.-'6@!$#n9(#+W/6@4Z%(45';45E3#+67#8'GZ6@!$#n¡l.kSHC`(%(#+2+6@';4HWo9(.$EF4H,>G: G 9 �) w�(y���W/.5Ssw¤#+^¦%sw!: G , �) w�(y#��uw1, �) w�(y�� 9 �) w�(y7y7y#�#+^(%sw�: G / �) w�(y#��uw1/ �) w��(y � 9 �) w��(y7y7y�#+^(%sw�: G /:�) w�(y%� :6/ �) w�����Jy��&:�,7�) w�����py%�',7�) w�(y#��/:�) w�(y��N 9 �) w�(y7y#�#+^(%sw�: G ,8�) w�(y%� :�,8�) w�����py �&:�/:�) w�����Jy(�',7�) w�(y#� / �) w�(y �N 9 �) w��(y7y7yAwDtadCMky "!$.-0$S-!2+.-EF%$W/#+^¨~u6@!$,/1p#+^¦%('

  • � ��� �������� �� � � � � c� �� � � � � ��� ���h���IL45'745E3#+6;#8'F#+176;,Em4H67,/.-G�EF4Y�=(#£%R#8'gB.-'7E3#+9�0$17,>G$S�G$0(E3#8'Gk67#+S-'74v67,/.-Gld ¤B3,>EF%$W/#8E3#8G56;#+99(,')#+2+67W/Y6]!$,U1ZOc.-0$W/9�,>G5*k.5W/*5#£4Q6COc.H9(,>E3#8G$1;,U.$G(4HW:,>G567#+S$'74H67,/.-G�67.}#+1767,>EF4H6;#|6@!$#NE3#845G�45G$9�4BD.-0('C9(,E_#8G$17,/.-G(4HWL,>G56;#+S-'74H67,/.-G67.F#+176;,Em4H67#n6]!$#n2+.H*45'),4kG$2+#_Em4H6@'

  • 8k

    "!$# B¨''G$SA*H45'45=$W/# , �) �0/ �) dXri.-'x6@!$#:. �l9(,>4HS5.-G(4HWe67#8'7E31c#+^(45E3,>G$,>G$SZ6@!$#:67#8'7E31,G$9(,/*$,/9i0(4HW/WUY$d��� / �) w�(yX/ �' w�(y�� � �" �) ' � �� �) �� �' w #pd K y=5Y?9(#TB¨G$,/67,/.-GldR=L^(45E3,>G$,>G$SA6]!$#:17#+2+.-G$9|6;#8'7E

    ��� / �) w�(yRWU.kS¨w¤#+^(%sw1, �' w�(y��>/ �' w�(y;y%��8y�� �����

    ���� / �) W/.5Ssw¤#+^(%sw��iy%��y � w�� / �) y$%� / �) w #pdCYky

    OJ!$#8'4H67#+9O",/6@!:,/68dL "!$,/1L2+.H*4k'45G$2+#fEF4v6@'EF4v67,/.-GNEF4Y=R#A%(#8'CBD.-';E3#+9N0$17,>G$Sz4?1;,E_,UW>45'345%k%('G$S ;450$1717,>45G?,>Gk67#+S-'74v67,/.-GZO",/6@!P;450$171

  • 5

    "!$#:#+176;,Em4H67,/.-GZ.vBo6@!$#n2+.H*H45'45G$2+#nEF4H6]'G$#+9|0$17,>G$SZ4317,>E3,/W>45'p,/9(#8G567,/6/:�) y(��8y(W/.5S¨wD#+^¦%sw1,8�' �3/:�' y%��y�� w #Jd y� ��� WU.kS w¤#+^(%sw1,8�) � :�,7�) �0/ �) �5:�/:�) y(��8yRWU.kSRwD#+^¦%sw1,8�' � :�,8�' �0/:�' �%:�/:�' y%�8y��

    � ��� :�/ �) WU.kS w¤#+^(%sw1, �' �3/ �' y%��8y �� ��� :�/ �) WU.kS w¤#+^(%sw1, �' � :�, �' �0/ �' �%:�/ �' y%��8y��� ��� :�/ �' W/.5S¨w¤#+^(%ow=, �) �0/ �) y%��8y��� ��� :�/ �' W/.5S¨w¤#+^(%ow=, �) � :�, �) �0/ �) �5:�/ �) y#��8y��� ��� WU.kS w¤#+^(%sw1, �) � :�, �) �0/ �) �5:�/ �) y(��8yRWU.kSRwD#+^¦%sw1, �' �3/ �' y#��y��� ��� WU.kS w¤#+^(%sw1, �) �0/ �) y#��8yRWU.kS¨w¤#+^(%sw1, �' � :�, �' �3/ �' �%:�/ �' y#�8y����5: �� �) : �� �'

    "!$.-0$S-!m6@!$,/1"#+^(%('Gk67#+S-'74H6;,U.$GmB0(G$2+67,/.-G$1d

    ¤BX6@!$#:176@4H6;,U2:45G$9Z9(#+W/6@43%(45'74kE3#+67#8'G$9(#8%(#8G$9(#8Gk6p6@!$#8G?,/6",/1JG$#+2+#+1

  • � ��� �������� �

    � � ���h��� ��� � ��� Z��� �� �� �� �� ��� �� � � ��� � �� � �� � X� �Kz4v6@!$#8EF4H67,/284HW/W/Y�6]!$#¡l.5SvCb".-';EF4HWJ45%(%(').^$,>EF4H67,/.-GS5,/*5#+1Z4N9(,/176@'),=(0$6;,U.$G�6@!(4H6A!(4v1A6@!$#V1@45E3#B¨'G$#+9N1]%(#+#+2+!4kG$9G$.5,/17#39(,/176@'=(0$67,/.-G$1,>G|6]!$#_¡ ,G$#84k'gC`(%(#+2+6@';4HW9(.-EF4H,>Gld ;,U*k#8G36@!$#p9(,U1;6@'=(0$67,/.-G$1c,>GF6@!$#p¡l.5SHC`(%R#+2+6@'74HWl9(.-EF4v,Gm45'45GF4kG$9&\$G$.HOJGl~56@!$#E3#845Gl~(6@!$#:B¨')176JE3.-E_#8G568~(EF4YZ=(#:284HW/280$W>4H67#+9VB'y7y$ "%�

    � � ����

    #+^¦%Xw � �� wL" � � � � � y7y$ " � wM:d>yOJ!$#8'

  • 5

    "!$#:*45'),4kG$2+#_Em48Ym17,>E3,/W4k'4H67#+9sd� � #+^(%sw1, �) y(#+^(%¨w=, �' y�����

    ���

    w�� ��ly�� � � � � @� #+^(%sw1, �) � , �' � w " � � � � y � w � � y � F wL" � � � � y;y! " � wM:d K y#jY2+.$G$17,/9(#8'G$S � � � � � ��w+" ) � " ' y � � 45G$9�2+.-Em%$WU#+6;,G$S6]!$#|1 �(0(45'G$Sa.$=$6@4H,>G$#+9A6]!$#J6

  • � �� �X �� ��� ���

    ���T@���������������� ��������� "!���#%$�#&�(')#%���*�+�,.-&/10 ��2)3,4 � ��5 �.687 � �:9 � � � �A@�2 ; � � � 2CBED � �:9> ��F � @�= ��BHG�I F �KJ 9 B �L2M3 7 � �:9 � � � ���P�#&�QOR���S���T&�������,��-U'V�&W K�X /

    �ZY @[\T%#&]�^�����U _�`!���#&��(/ =O�LP,��.�,���a#&���b�cSM.�,��R�-��b��#%-+-O���d��R������d������T�-be�#%#%T%fd.#%T%�L$,���������,�(/�g�ihjF �&; 3 � 2�kLB�l&mon1pMp hj'�e���$L#%- M�q,WUr"M X Y�')�&W�W�s�/

    �Zt @[\T%#&]�u�����U v�w!��+#&��(/ x�,��R�-��O-He�#%#%T%fy.#%T%�L$,���������,�d�Lza������d��S����&�������,���c{|�Hf�#x�cT%�,R�-�����T-be���T%#�/ �g�}h�F �&; 3 � 2�k�B~l&mon1pMp h�',e���$L#%- M�W�tUr"M�W K '��&WLW���/

    q @^Q\S�#%������M.#�'�+# �,R���z�'������yQ(�,T%L�j�����A/ ������jf��,�a�,���,�e�f���T���#%T%����P��LSR��+�*����-�T%f�#&��#%-{�, -be�#%#%T%fe�.��T%#%-�-�����$d���T&��V#&�LP��]�,����#&�L��-&/V�g�hjF �&; 3 � 2�kLB�l&mon1pMp h�'�P���S�R���#Y�'�e���$�#%-W�WUr(�&s�Y�')�&W�W�t�/

    X @[E]�L�'M!��}���&R��b��'L�\��$����b��'������!���U���/o!�e����#&�Lg���,.�y.#%T%�L$,���������,�yR�-+���$���z���������T{#&���bR�.#%-�������S�z,-+#%���z��.����g������#&��-����,����S(�#&e�-��b�R��/ l�O h�F �U; 3 � 2Lk�Bm � � � @�2 �:; � � � � 2CBbGp�J H;%9 ��2M3_ � B � � 2 '�e���$�#%-^�&tLtUr�%q,sC'M�&WLMLW�/

    K @ �ER��C#&.�&'�Z#O��R�.S������A'� ����de('������" N#%S�S�#&�#&��-&/[�g�de�.��P�#%�f�������#&��������P������#%S�-�{�,�-beC#%#%TKf.#%T%��$,�������


Recommended