MMO / mmouchpos

40

Jbk Djhd klbkdm kbfie_dkm

Jbk ± Klbkd kbfie_dkm

Djhd Ihj•\gy}fh agZq_ggy nmgdp•c Ic lZ Ih.

Ydsh Ic < fh lh aZf•gy}fh lhqdm Zh gZ lhqdm Zc • ydsh a[•`g•klv g_ ^hky]gmlZ lh ih\_jlZ}fhky gZ djhd

Ydsh Ic > fh lh hq_\b^gh sh \k• gZr• kijh[b agZclb agZq_ggy

f_gr_ Ih aZd•gqbebky g_\^Zq_x lhfm fb i_j_oh^bfh gZ djhd Djhd GZ pvhfm djhp• fb af_grm}fh jhaf•jg•klv kbfie_dkm

jhaih^•ehf gZ\i•e \•^klZg• \•^ dh`gh€ lhqdb kbfie_dkm ^h Zl — lhqdb sh \bagZqZ} gZcf_gr_ agZq_ggy nmgdp•€ LZdbf qbghf lhqdZ wi aZf•gy}lvky gZ lhqdm Zi + 0,5(wi -wl).

Ihl•f h[qbkex}fh Ii ^ey L Q i_j_\•jy}fh a[•`g•klv

• ydsh \hgZ g_ ^hky]gmlZ ih\_jlZ}fhky gZ djhd

Djhd I_j_\•jdZ a[•`ghkl• aZkgh\ZgZ gZ lhfm sh klZg^Zjlg_

\•^obe_ggy Q]h agZq_ggy nmgdp•€ [meh f_gr_ ^_ydh]h aZ^Zgh]h fZeh]h agZq_ggy ε .

41

M pvhfm \biZ^dm h[qbkex}lvky

h^gh]h • lhfm \hgb fh`eb\h e_`Zlv ih[ebam lhqdb f•g•fmfm nmgdp•€ ol.

Dh_n•p•}glb Z E lZ Y m \bs_gZ\_^_g•c ijhp_^mj• } \•^ih\•^gh dh_n•p•}glZfb \•^h[jZ`_ggy klbkdm • jhaly]Zggy G_e^_j • F•^ j_dhf_g^mxlv [jZlb Z E lZ Y J_dhf_g^Zp•y aZkgh\ZgZ gZ j_amevlZlZo _dki_jbf_gl•\ a j•agbfb dhf[•gZp•yfb agZq_gv P• agZq_ggy iZjZf_lj•\ ^ha\heyxlv f_lh^m [mlb _n_dlb\gbf m j•agbo kdeZ^gbo kblmZp•yo

F_lh^ OmdZ >`b\kZ

< hkgh\m f_lh^m OmdZ ± >`b\kZ ihdeZ^_gh lm h[klZ\bgm sh ihrmd ydbc i_j•h^bqgh ijh\h^blvky m gZijyfdm G(i) = w(i) – w (i-1)

^ha\hey} •klhlgh ijbkdhjblb a[•`g•klv F_lh^ OmdZ >`b\kZ } h^gbf a i_jrbo Ze]hjblf•\ m ydbo ijb \bagZq_gg• gh\h]h gZijyfdm ihrmdm \jZoh\m}lvky •gnhjfZp•y hljbfZgZ gZ ihi_j_^g•o •l_jZp•yo <eZkg_ dZ`mqb ijhp_^mjZ OmdZ >`b\kZ ij_^klZ\ey} kh[hx dhf[•gZp•x ^hke•^`mxqh]h" ihrmdm a pbde•qghx af•ghx af•ggbo •

ijbkdhjxxqh]h ihrmdm aZ ajZadhf a \bdhjbklZggyf \bagZq_gbo

_\jbklbqgbo ijZ\be >hke•^`m\Zgbc ihrmd hj•}glh\Zgbc gZ \by\e_ggy oZjZdl_jm ehdZevgh]h ih\h^`_ggy p•evh\h€ nmgdp•€ • \bagZq_ggy gZijyfd•\ ma^h\` ©yj•\ª HljbfZgZ \ j_amevlZl• ^hke•^`m\Zgh]h ihrmdm •gnhjfZp•y ihl•f \bdhjbklh\m}lvky \ ijhp_k• ihrmdm aZ ajZadhf ijb jmk• ih ©yjZoª

>ey ijh\_^_ggy ^hke•^`mxqh]h ihrmdm g_h[o•^gh aZ^Zlb \_ebqbgm djhdm sh fh`_ [mlb j•aghx ^ey j•agbo dhhj^bgZlgbo gZijyfd•\ • af•gx\Zlbky \ ijhp_k• ihrmdm >hke•^`mxqbc ihrmd ihqbgZ}lvky \ ^_yd•c \bo•^g•c lhqp• Ydsh agZq_ggy p•evh\h€ nmgdp•€ \ ijh[g•c lhqp• g_ i_j_\bsm} agZq_ggy nmgdp•€ m \bo•^g•c lhqp• lh djhd ihrmdm jha]ey^Z}lvky yd mki•rgbc M ijhlbe_`ghfm \biZ^dm g_h[o•^gh ih\_jgmlbky \ ihi_j_^gx lhqdm • ajh[blb djhd m

42

ijhlbe_`ghfm gZijyfdm a gZklmighx i_j_\•jdhx agZq_ggy p•evh\h€ nmgdp•€ I•key i_j_[hjm \k•o 1 dhhj^bgZl ^hke•^`mxqbc ihrmd aZ\_jrm}lvky HljbfZgm \ j_amevlZl• lhqdm gZab\Zxlv [Zah\hx lhqdhx.

Ihrmd aZ ajZadhf ihey]Z} \ j_Ze•aZp•€ }^bgh]h djhdm a hljbfZgh€ [Zah\h€ lhqdb ma^h\` ijyfh€ sh a }^gm} px lhqdm a ihi_j_^gvhx [Zah\hx lhqdhx Gh\Z lhqdZ ajZadZ \bagZqZ}lvky \•^ih\•^gh ^h nhjfmeb

w(k+1)p = w(k)+(w(k)-w(k-1)).

Yd l•evdb jmo aZ ajZadhf g_ ijb\h^blv ^h af_gr_ggy p•evh\h€

(k+1)

nmgdp•€ lhqdZ Z p n•dkm}lvky \ ydhkl• lbfqZkh\h€ [Zah\h€ lhqdb • agh\m ijh\h^blvky ^hke•^`mxqbc ihrmd Ydsh \ j_amevlZl•

\boh^blv lhqdZ a f_grbf agZq_ggyf p•evh\h€ nmgdp•€ g•` m lhqp• w(k) lh \hgZ jha]ey^Z}lvky yd gh\Z [Zah\Z lhqdZ Z(k+1) A •grh]h [hdm

ydsh ^hke•^`m\Zgbc ihrmd g_\^Zebc g_h[o•^gh ih\_jgmlbky \ lhqdm Z(k) • ijh\_klb ^hke•^`mxqbc ihrmd a f_lhx \by\e_ggy

gh\h]h gZijyfdm f•g•f•aZp•€ < j_amevlZl• \bgbdZ} kblmZp•y dheb lZdbc ihrmd g_ ijb\h^blv ^h mki•om M pvhfm \biZ^dm ihlj•[gh af_grblb \_ebqbgm djhdm reyohf \\_^_ggy ^_ydh]h fgh`gbdZ • \•^gh\blb ihrmd Ihrmd aZ\_jrm}lvky dheb \_ebqbgZ djhdm klZ} ^hkblv fZehx

LZd ijbibgblb ihrmd ihlhqgZ lhqdZ Zijhdkbfm} lhqdm hilbfmfm Z*. G• af_grblb a[•evr_ggy ih nhjfme•

Djhd Qb \bdhgm}lvky g_j•\g•klv I Z(k+1))<f(w(k))?

LZd ihdeZklb Z(k-1) = w(k), w(k) = w(k+1) I_j_clb ^h djhdm G• i_j_clb ^h djhdm

F_lh^ kijy`_gbo gZijyfd•\ IZm_eeZ

GZc[•evr _n_dlb\gbf a Ze]hjblf•\ ijyfh]h ihrmdm } f_lh^ jhajh[e_gbc IZm_eehf Ijb jh[hl• pvh]h Ze]hjblfm •gnhjfZp•y hljbfZgZ gZ ihi_j_^g•o •l_jZp•yo \bdhjbklh\m}lvky ^ey ih[m^h\b \_dlhj•\ gZijyfd•\ ihrmdm Z lZdh` ^ey mkmg_ggy aZpbde_ggy ihke•^h\ghkl• dhhj^bgZlgbo ihrmd•\ F_lh^ hj•}glh\Zgbc gZ \bj•r_ggy aZ^Zq •a d\Z^jZlbqgbfb p•evh\bfb nmgdp•yfb • ‰jmglm}lvky gZ nmg^Zf_glZevgbo l_hj_lbqgbo j_amevlZlZo

AZ^Zq• a d\Z^jZlbqgbfb p•evh\bfb nmgdp•yfb aZcfZxlv \Z`eb\_ f•kp_ \ l_hj•€ hilbf•aZp•€ aZ ^\hfZ ijbqbgZfb

1. D\Z^jZlbqgZ nmgdp•y y\ey} kh[hx gZcijhkl•rbc lbi

g_e•g•cgbo nmgdp•c ^ey ydbo fh`_ [mlb knhjfmevh\ZgZ aZ^ZqZ [_amfh\gh€ hilbf•aZp•€ e•g•cg• nmgdp•€ g_ fZxlv \gmlj•rg• hilbfmfb Hl`_ ydsh aZ ^hihfh]hx lh]h Z[h •grh]h f_lh^m mki•rgh \bj•rmxlvky aZ^Zq• hilbf•aZp•€ a p•evh\bfb nmgdp•yfb aZ]Zevgh]h \b^m lh lZdbc f_lh^ ih\bggbc \by\blbky _n_dlb\gbf ijb \bj•r_gg• aZ^Zq •a d\Z^jZlbqgbfb nmgdp•yfb

< hdhebp• lhqdb hilbfmfm [m^v ydm g_e•g•cgm nmgdp•x fh`gZ Zijhdkbfm\Zlb d\Z^jZlbqghx nmgdp•}x hkd•evdb e•g•cgbc qe_g jhadeZ^Zggy L_cehjZ h[_jlZ}lvky \ gmev Hl`_ jh[hlZ Ze]hjblfm ijb \bj•r_gg• aZ^Zq •a d\Z^jZlbqgbfb nmgdp•yfb ^ha\hey} h^_j`Zlb \bagZq_g_ my\e_ggy ijh a[•`g•klv Ze]hjblfm m \biZ^dm dheb f•g•f•am}lvky nmgdp•y aZ]Zevgh]h \b]ey^m

Hkgh\gZ •^_y Ze]hjblfm ihey]Z} \ lhfm sh ydsh d\Z^jZlbqgZ

44

nmgdp•y 1 af•ggbo ijb\_^_gZ ^h \b]ey^m kmfb ih\gbo d\Z^jZl•\ lh €€ hilbfmf fh`_ [mlb agZc^_gbc m j_amevlZl• j_Ze•aZp•€ 1

h^gh\bf•jgbo ihrmd•\ ih i_j_l\hj_gbo dhhj^bgZlgbo gZijyfdZo Ijhp_^mjZ i_j_l\hj_ggy d\Z^jZlbqgh€ nmgdp•€ T Z D ETw+0,5Cw

^h \b]ey^m kmfb ih\gbo d\Z^jZl•\ _d\•\Ze_glgZ agZoh^`_ggx lZdh€ fZljbp• i_j_l\hj_ggy L sh ijb\h^blv fZljbpx d\Z^jZlbqgh€

nhjfb ^h ^•Z]hgZevgh]h \b]ey^m LZdbf qbghf aZ^ZgZ d\Z^jZlbqgZ nhjfZ 4 Z ZT&Z reyohf i_j_l\hj_ggy Z 7] ijb\h^blvky ^h \b]ey^m 4o ]TTTCTz=ZT'] ^_ ' ² ^•Z]hgZevgZ fZljbpy lh[lh

_e_f_glb ' \•^f•gg• \•^ gmey l•evdb ijb L M

G_oZc Wj ² Mc klh\i_pv fZljbp• L Lh^• i_j_l\hj_ggy ^ha\hey} aZibkZlb dh`gbc \_dlhj Z m \b]ey^• e•g•cgh€ dhf[•gZp•€ \_dlhj•\ klh\ip•\ Wj:

w = Tz = t1z1 + t2z2 + ... + tNzN.

1grbfb keh\Zfb aZf•klv dhhj^bgZl \_dlhjZ Z m klZg^Zjlg•c dhhj^bgZlg•c kbkl_f• amfh\e_g•c fgh`bghx \_dlhj•\ H(i),

\bdhjbklh\mxlvky dhhj^bgZlb \_dlhjZ \ gh\•c dhhj^bgZlg•c

kbkl_f• aZ^Zg•c \_dlhjZfb Wj Dj•f lh]h kbkl_fZ \_dlhj•\ Wj \•^ih\•^Z} ]heh\gbf hkyf jha]eygmlh€ d\Z^jZlbqgh€ nhjfb hkd•evdb fZljbpy d\Z^jZlbqgh€ nhjfb ijb\h^blvky ^h ^•Z]hgZevgh]h \b]ey^m Hl`_ aZ ^hihfh]hx i_j_l\hj_ggy af•ggbo d\Z^jZlbqgh€ nmgdp•€ [m^m}lvky gh\Z kbkl_fZ dhhj^bgZl sh a[•]Z}lvky a ]heh\gbfb hkyfb d\Z^jZlbqgh€ nmgdp•€ Hl`_ h^ghf•jgbc ihrmd lhqdb hilbfmfm \ ijhklhj• i_j_l\hj_gbo af•ggbo ] _d\•\Ze_glgbc ihrmdm ma^h\` dh`gh€ a ]heh\gbo hk_c d\Z^jZlbqgh€ nmgdp•€ LZd yd gZijyfhd

]heh\gbo hk_c \bagZqZxlvky \_dlhjZfb Wj lh h^ghf•jgbc ihrmd ijh\h^blvky \ gZijyfdZo aZ^Zgbo pbfb \_dlhjZfb

G_oZc K kbf_ljbqgZ fZljbpy ihjy^dm 1[1 gZijyfdb s(1), s(2), ..., s(r), r £ 1 gZab\Zxlvky K kijy`_gbfb ydsh p• gZijyfdb

e•g•cgh g_aZe_`g• • V(i)TCs(j) ^ey \k•o L ¹ j.

Ijb ijh\_^_gg• jhajZomgd•\ i_j_\Z`g•r_ [m^m\Zlb kbkl_fm

kijy`_gbo gZijyfd•\ \boh^yqb a h^g•}€ ihqZldh\h€ lhqdb sh e_]dh a^•ckgblb aZ ^hihfh]hx h^bgbqgbo dhhj^bgZlgbo \_dlhj•\ H(1), e(2), ...,

_(N).

Knhjfmex}fh maZ]Zevg_gm \eZklb\•klv j•\gh[•`gh]h i•^ijhklhjm.

45

Ydsh lhqdZ m(1) agZc^_gZ \ j_amevlZl• ihrmdm a lhqdb Z(1) ma^h\` dh`gh]h a F 0 1 kijy`_gbo gZijyfd•\ Z lhqdZ m(2)

j_amevlZl• ihrmdm a lhqdb Z(2) ma^h\` dh`gh]h a lbo `_ F kijy`_gbo gZijyfd•\ V(1), s(2), ..., s(M) lh \_dlhj m(2) ± m(1) aZ^Z}

gZijyfhd kijy`_gbc a mk•fZ h[jZgbfb F gZijyfdZfb

:e]hjblf kijy`_gbo gZijyfd•\ IZm_eeZ aZibr_fh \ gZklmighfm

\b]ey^•

Djhd AZ^Zlb ihqZldh\m lhqdm Z(0) g_aZe_`gbo gZijyfd•\ fh`eb\bc \biZ^hd

..., N.

Djhd F•g•f•am\Zlb I Z ijb ihke•^h\ghfm jmk• ih 1

gZijyfdZo ijb pvhfm hljbfZgZ jZg•r_ lhqdZ f•g•fmfm [_j_lvky \ ydhkl• \bo•^gh€ Z gZijyfhd V(N) \bdhjbklh\m}lvky yd ijb i_jrhfm

lZd • hklZggvhfm ihrmdm

Djhd <bagZqblb gh\bc kijy`_gbc gZijyfhd aZ ^hihfh]hx

maZ]Zevg_gh€ \eZklb\hkl• j•\gh[•`gh]h i•^ijhklhjm

Djhd AZf•gblb V(1) gZ V(2) • l ^ AZf•gblb V(N) kijy`_gbf gZijyfdhf

I_j_clb ^h djhdm

>ey lh]h sh[ aZklhkm\Zlb \bdeZ^_gbc f_lh^ gZ ijZdlbp• ch]h g_h[o•^gh ^hih\gblb ijhp_^mjZfb i_j_\•jdb a[•`ghkl• • e•g•cgh€ g_aZe_`ghkl• kbkl_fb gZijyfd•\ I_j_\•jdZ e•g•cgh€ g_aZe_`ghkl• hkh[eb\h \Z`eb\Z \ lbo \biZ^dZo dheb nmgdp•y I Z g_ } d\Z^jZlbqghx

A• kihkh[m ih[m^h\b Ze]hjblfm \bieb\Z} sh m \biZ^dm dheb p•evh\Z nmgdp•y d\Z^jZlbqgZ • fZ} f•g•fmf lhqdZ f•g•fmfm agZoh^blvky \ j_amevlZl• j_Ze•aZp•€ 1 pbde•\ sh \dexqZxlv djhdb• ^_ 1 ² d•evd•klv af•ggbo Ydsh ` nmgdp•y g_ } d\Z^jZlbqghx lh ihlj•[gh [•evr g•` 1 pbde•\ JZahf a lbf fh`gZ ^Zlb kljh]bc ^hdZa lh]h sh ijb ^_ydhfm ijbims_gg• f_lh^ IZm_eeZ a[•]Z}lvky ^h

lhqdb ehdZevgh]h f•g•fmfm •a kmi_je•g•cghx r\b^d•klx Jha]eygmlbc f_lh^ ^ha\hey} ih[m^m\Zlb ihke•^h\g•klv lhqhd Z(k),

sh a[•]Z}lvky ^h j•r_ggy Z F_lh^ a[•]Z}lvky ydsh g_j•\g•klv

46

\bdhgm}lvky gZ dh`g•c •l_jZp•€ Hkd•evdb ijb jhajZomgdZo a\bqZcgh hi_jmxlv d•gp_\bfb ^_kyldh\bfb ^jh[Zfb gZ\•lv gZc_n_dlb\g•rbc Ze]hjblf \bfZ]Z} ijh\_^_ggy g_kd•gq_ggh€ ihke•^h\ghkl• •l_jZp•c Lhfm \ i_jrm q_j]m ij_^klZ\eyxlv •gl_j_k Zkbfilhlbqg• \eZklb\hkl• a[•`ghkl• f_lh^•\ sh ^hke•^`mxlvky ;m^_fh ]h\hjblb sh Ze]hjblf fZ} a[•`g•klv ihjy^dm U ydsh

ε(k+1)

lim = C ,

k→∞ ε(k ) r

^_ K ² ihkl•cgZ \_ebqbgZ

A nhjfmeb \bieb\Z} sh ijb U fZ} f•kp_ g_j•\g•klv K≤ 1.

Ydsh U Z[h U lh Ze]hjblf oZjZdl_jbam}lvky e•g•cghx Z[h d\Z^jZlbqghx r\b^d•klx a[•`ghkl• \•^ih\•^gh Ijb U lZ K Ze]hjblf oZjZdl_jbam}lvky kmi_je•g•cghx r\b^d•klx a[•`ghkl•

47

JHA>1E ;:=:LH<BF1JG1 =J:>1/GLG1 F?LH>B

G?E1G1CGH2 HILBF1A:P12

G_oZc aZ^Zgh \b]ey^ ijZ\beh h[qbke_ggy ^_ydh€ nmgdp•€ \ I Z [ ^_ Z lZ [ ± kdeZ^_g• \_dlhjb klh\ip• af•ggbo • \•^hf• j_Ze•aZp•€ nmgdp•€ \ ijb \•^hfbo agZq_ggyo o Ihlj•[gh hp•gblb g_\•^hf• iZjZf_ljb Z lZdbf qbghf sh[ agZq_ggy nmgdp•€ \ ijb pbo iZjZf_ljZo g_agZqgh \•^j•agyebky \•^ \•^hfbo j_Ze•aZp•c \ ijb h^gZdh\bo aZ^Zgbo agZq_ggyo [ lh[lh g_h[o•^gh f•g•f•am\Zlb ^_ydm p•evh\m nmgdp•x ) Z ^_ ZkdeZ^_gbc \_dlhj klh\i_pv af•ggbo sh d_jmxlvky aZ d•gp_\m d•evd•klv •l_jZp•c

Ij_^klZ\bfh nmgdp•x ) Z m \b]ey^• •gl_]jZevgh]h djbl_j•x ydhkl•

) Z = åN 4(¥(Z P)),

N P=

^_ N ± ghf_j ihlhqgh€ •l_jZp•€ P N ± ghf_jZ ihi_j_^g•o •l_jZp•c Z 40 Z N ± ^_ydbc fbll}\bc djbl_j•c ydhkl• sh aZe_`blv \•^ \_dlhjZ ihfbedb 40 Z P

0Z P \ P \ P

• ydbc fZ} \b]ey^ d\Z^jZlbqgh€ nhjfb

40Z P 0TZ P 50Z P

^_ 5 ihablb\gh \bagZq_gZ fZljbpy

=jZ^•}glg• f_lh^b f•g•f•aZp•€ •gl_]jZevgh]h djbl_j•x ydhkl• aZkgh\Zg• gZ \bdhjbklZgg• ]jZ^•}glZ p•evh\h€ nmgdp•€ ) Z P• f_lh^b ghkylv •l_jZlb\gbc oZjZdl_j lhfm sh dhfihg_glb ]jZ^•}glZ \by\eyxlvky g_e•g•cgbfb nmgdp•yfb

Mk• ^Ze• jha]eygml• f_lh^b aZkgh\Zg• gZ •l_jZp•cg•c ijhp_^mj• sh j_Ze•ah\ZgZ \•^ih\•^gh ^h nhjfmeb

wk+1=wk .ks(wk),

48

^_ Zk, wk+1 ± ihlhqg_ • gh\_ gZ[eb`_ggy agZq_gv d_jm\Zevgbo

af•ggbo ^h hilbfZevgh]h j•r_ggy \•^ih\•^gh .k ± djhd a[•`ghkl• s(wk gZijyfhd ihrmdm \ 1\bf•jghfm ijhklhj• af•ggbo sh

d_jmxlvky Kihk•[ \bagZq_ggy V Zk • .k gZ dh`g•c •l_jZp•€ aZe_`blv \•^ hkh[eb\hkl_c dhgdj_lgh]h f_lh^m

F_lh^ Dhr•

F_lh^ Dhr• (f_lh^ gZcr\b^rh]h kimkdm m gZ\qZgg•

g_cjhggbo f_j_` \•^hfbc yd Ze]hjblf a\hjhlgh]h ihrbj_ggy ihfbedb i_jrh]h ihjy^dm Backpropagation ihey]Z} \ j_Ze•aZp•€

ijZ\beZ

IhagZqb\rb ihlhqgbc ]jZ^•}gl g = ∂w∂Q h^_j`bfh

wk+1 = wk kgk,

^_ k r\b^d•klv gZ\qZggy

<_ebqbgZ Z[h ihdeZ^Z}lvky ihkl•cghx • lh^• a\bqZcgh

ihke•^h\g•klv Zk koh^blvky \ hdhebpx hilbfZevgh]h agZq_ggy Z Z[h \hgZ } kiZ^Zxqhx nmgdp•}x qZkm lZd yd p_ jh[blvky \ klhoZklbqgbo Ze]hjblfZo hilbf•aZp•€ c Z^ZilZp•€

>ZgZ ijhp_^mjZ fh`_ \bdhgm\Zlbky ^hlb ^hdb agZq_ggy d_jm\Zevgbo af•ggbo g_ klZ[•e•amxlvky Z[h ^hdb ihfbedZ g_ af_grblvky ^h ijbcgylgh]h agZq_ggy

Ke•^ aZagZqblb sh ^Zgm ijhp_^mjm oZjZdl_jbam} ih\•evgZ r\b^d•klv a[•`ghkl• • fh`eb\•klv \emq_ggy \ ehdZevg• f•g•fmfb nmgdp•hgZeZ

F_lh^ GvxlhgZ

F_lh^ GvxlhgZ Z[h Ze]hjblf a\hjhlgh]h ihrbj_ggy ihfbedb ^jm]h]h ihjy^dm \•^ghkgh ^h aZ^Zq• f•g•f•aZp•€ p•evh\h€

49

nmgdp•€ fZ} \b]ey^

H[qbke_ggy ]jZ^•}glZ Ñw 40Zk-1N fh`_ [mlb \bdhgZg_ aZ

^hihfh]hx f_lh^m Dhr•

M j_amevlZl• aZ^ZqZ a\h^blvky ^h h[qbke_ggy fZljbp• ^jm]bo

F_lh^ GvxlhgZ aZ i_\gbo mfh\ fZ} •klhlgh [•evrm r\b^d•klv a[•`ghkl• g•` ]jZ^•}glgbc f_lh^

:e]hjblfb kijy`_gbo ]jZ^•}gl•\

:e]hjblfb kijy`_gbo ]jZ^•}gl•\ ij_^klZ\eyxlv kh[hx i•^deZk f_lh^•\ sh a[•]Zxlvky d\Z^jZlbqgh :e]hjblfb kijy`_gbo ]jZ^•}gl•\ \bdhjbklh\mxlv f_lh^ Dhr• ^ey h[qbke_ggy iho•^gbo p•evh\h€ nmgdp•€ sh^h d_jm\Zevgbo af•ggbo

<k• Ze]hjblfb kijy`_gbo ]jZ^•}gl•\ gZ i_jr•c •l_jZp•€ ihqbgZxlv jh[hlm a ihrmdm m gZcdjml•rhfm gZijyfdm kimkdm ijhlbe_`ghfm ]jZ^•}glm p•evh\h€ nmgdp•€

p0 = -g0.

P_ gZijyfhd m ydhfm p•evh\Z nmgdp•y af_grm}lvky gZc[•evr r\b^dh H^gZd aZagZqbfh sh p_ g_ h[h\ yadh\h aZ[_ai_qm} gZcr\b^rm a[•`g•klv

I•key pvh]h \bdhgm}lvky e•g•cgbc ihrmd sh[ \bagZqblb hilbfZevgm \•^klZgv ^ey jmom m ihlhqghfm gZijyfdm ihrmdm

wk+1 = wk + αkpk.

GZklmigbc gZijyfhd ihrmdm \bagZqZ}lvky lZd sh[ \•g [m\ kijy`_gbf a ihi_j_^g•fb gZijyfdZfb Ihrmd \•^[m\Z}lvky aZ kijy`_gbf gZijyfdhf ]jZ^•}glZ sh[ \bagZqblb jhaf•j djhdm sh f•g•f•am} p•evh\m nmgdp•x AZ]ZevgZ ijhp_^mjZ ^ey \bagZq_ggy