Irregular Repeat Accumulate Codes 1


 Merryl Simpson
 2 years ago
 Views:
Transcription
1 Irregulr epet Accumulte Codes 1 Hu Jn, Amod Khndekr, nd obert McElece Deprtment of Electrcl Engneerng, Clforn Insttute of Technology Psden, CA 9115 USA Eml: {hu, mod, Abstrct: In ths pper we wll ntroduce n ensemble of codes clled rregulr repetccumulte (IA) codes. IA codes re generlzton of the repetccumlute codes ntroduced n [1], nd s such hve nturl lnertme encodng lgorthm. We shll prove tht on the bnry ersure chnnel, IA codes cn be decoded relbly n lner tme, usng tertve sumproduct decodng, t rtes rbtrrly close to chnnel cpcty. A smlr result ppers to be true on the AWGN chnnel, lthough we hve no proof of ths. We llustrte our results wth numercl nd expermentl exmples. Keywords: repetccumulte codes, turbocodes, lowdensty prtycheck codes, tertve decodng. 1. INTODUCTION Wth the hndsght provded by the pst seven yers of reserch n turbocodes nd lowdensty prtycheck codes, one s tempted to propose the followng problem s the fnl problem for chnnel codng reserchers: For gven chnnel, fnd n ensemble of codes wth (1) lnertme encodng lgorthm, nd () whch cn be decoded relbly n lner tme t rtes rbtrrly close to chnnel cpcty. For turbocodes, both prllel nd serl, (1) holds, but ccordng to the recent work by Dvslr, Dolnr, nd Pollr [7], on the AWGN chnnel there ppers to be gp, lbet usully not lrge one, between chnnel cpcty nd the tertve decodng thresholds for ny turbo ensemble. For DPC codes, the nturl encodng lgorthm s qudrtc n the block length, nd from the work of chrdson nd Urbnke [] we know tht for regulr DPC codes, on the bnry symmetrc nd AWGN chnnels there s gp between cpcty nd the tertve decodng thresholds. On the postve sde, however, uby, Shokrollh et t. [3], [4], [8], hve estblshed the remrkble fct tht on the bnry ersure chnnel rregulr DPC codes stsfy (). ecent work by chrdson, Shokrollh nd Urbnke [5] shows 1 Ths pper s to be presented t the Second Interntonl Conference on Turbo Codes, Brest, Frnce, September. Ths reserch ws supported by NSF grnt no. CC , nd grnts from Sony, Qulcomm, nd Cltech s ee Center for Advnced Networkng. tht on the AWGN chnnel, rregulr DPC codes re mrkedly better thn regulr ones, but whether or not they cn rech cpcty s not yet known. In summry, s yet there s no known nosy chnnel for whch the fnl problem hs been solved, lthough reserchers re very close on the AWGN chnnel nd extremely close on the bnry ersure chnnel. In ths pper, we wll ntroduce promsng clss of codes clled rregulr repetccumulte codes, whch generlzes the repetccumulte codes of [1]. After defnng the codes n Secton, nd observng tht they hve smple lnertme encodng lgorthm, n Secton 3, usng the powerful chrsonurbnke method [], we wll prove rgorously tht IA codes solve the fnl problem for the bnry ersure chnnel. In Secton 4, we wll dscuss, less rgorously, the performnce of IA codes on the AWGN chnnel, nd show tht ther performnce s remrkbly good.. DEFINTION OF IA CODES Fgure 1 shows Tnner grph of n IA code wth prmeters (f 1,...,f J ; ), where f, f = 1 nd s postve nteger. The Tnner grph s bprtte grph wth two knds of nodes: vrble nodes (open crcles) nd check nodes (flled crcles). There re k vrble nodes on the left, clled nformton nodes; there re r =(k f )/ check nodes; nd there re r vrble nodes on the rght, clled prty nodes. Ech nformton node s connected to number of check nodes: the frcton of nformton nodes connected to exctly check nodes s f. Ech check node s conected to exctly nformton nodes. These connectons cn mde n mny wys, s ndcted n Fgure 1 by the rbtrry permutton of the r edges jonng nformton nodes nd check nodes. The check nodes re connected to the prty nodes n the smple zgzg pttern shown n the fgure. If the rbtrry permutton n Fgure 1 s fxed, the Tnner grph represents bnry lner code wth k nformton bts (u 1,...,u k ) nd r prty bts (x 1,...,x r ), s follows. Ech of the nformton bts s ssocted wth one of the nformton nodes; nd ech of the prty bts s ssocted wth one of the
2 (Arbtrry permutton) f f 3 f J Check nodes (ll hve left degree ) x 1 x For exmple, the orgnl A codes re nonsystemtc IA codes wth = 1 nd exctly one f equl to 1, sy f q = 1, nd the rest zero, n whch cse () smplfes to = 1/q. (However, n ths pper we wll be concerned lmost exclusvely wth systemtc IA codes.) In n tertve sumproduct messgepssng decodng lgorthm, ll messges re ssumed to be loglkelhood rtos,.e., of the form m = log(p()/p(1)). The outgong messge from vrble node u to check node v represents nformton bout u, nd messge from check node u to vrble node v represents nformton bout u. Intlly, messges re sent from vrble nodes whch represent trnsmtted symbols. The outgong messge from node u tonodev depends on the ncomng messges from ll neghbors w of u except v. Ifu s vrble messge node, ths outgong messge s Informton nodes (f = frcton of nodes of degree ) x r Prty nodes Fgure 1: Tnner grph for IA code wth prmeters (f 1,...,f J ; ). prty nodes. The vlue of prty bt s determned unquely by the condton tht the mod sum of the vlues of the vrble nodes connected to ech of the check nodes s zero. To see ths, let us conventonlly set x =. Then f the vlues of the bts on the r edges comng out of the permutton box re (v 1,...,v r ), we hve the recursve formul x j = x j 1 + v (j 1)+, (1) for j =1,,...,r. Ths s n effect the encodng lgorthm, nd so f s fxed nd n, the encodng complexty s O(n). There re two versons of the IA code n Fgure 1: the nonsystemtc nd the systemtc versons. The nonsystemtc verson s n (r, k) code, n whch the codeword correspondng to the nformton bts (u 1,...,u k )s(x 1,...,x r ). The systemtc verson s (k + r, k) code, n whch the codeword s (u 1,...,u k ; x 1,...,x r ). The rte of the nonsystemtc code s esly seen to be nsys = f, () wheres for the systemtc code the rte s sys = + f (3) m(u v) = w v m(w u)+m (u), (4) where m (u) s the loglkelhood messge ssocted wth u. (Ifu s not codeword node, ths term s bsent.) If u s check node the correspondng formul s [1] tnh m(u v) = w v tnh m(w u). (5) 3. IA CODES ON THE BINAY EASUE CHANNE The sumproduct lgorthm defned n equtons (4) nd (5) smplfes consderbly on the bnry ersure chnnel (BEC). The BEC s bnry nput chnnel wth three output symbols,, 1 nd ersure. The nput symbol s receved s n ersure wth probblty p nd s receved correctly wth probblty. It s mportnt to note tht no errors re ever mde on ths chnnel. It s not dffcult to see tht the messges defned n (4) nd (5) cn ssume only three vlues on the BEC, vz. +, or, correspondng to vrble vlue, 1, or unknown. No errors cn occur durng the runnng of the lgorthm; f messge s ±, the correspondng vrble s gurnteed to be or 1, respectvely. The opertons t the nodes n the grph gven by eqns (4) nd (5) cn be stted much more smply nd ntutvely n ths cse. At vrble node, the outgong messge s equl to ny nonersure ncomng messge, or n ersure f ll ncomng messges re ersures. At check node, the outgong messge s n ersure f ny ncomng messge s n ersure, nd otherwse s the bnry sum of ll ncomng messges.
3 3.1. Notton In ths secton nd the next, t wll be convenent to use slghtly dfferent representton for n IA code thn the one used n Secton. Frstly, we wll begn wth the ssumpton tht the degrees of both the nformton nodes nd the check nodes re nonconstnt, though we wll soon restrct ttenton to the rghtregulr cse, n whch the check nodes hve constnt degree. Secondly, let λ be the frcton of edges between the nformton nd the check nodes tht re djcent to n nformton node of degree, nd let ρ be the frcton of such edges tht re djcent to check node of degree + (.e. one whch s djcent to nformton nodes). We wll use these edge frctons λ nd ρ to represent the IA code rther thn the correspondng node frctons. We defne λ(x) = λ x 1 nd ρ(x) = ρ x 1 to be the genertng functons of these sequences. The pr (λ, ρ) s clled degree dstrbuton. It s qute esy to convert between the two representtons. We demonstrte the converson wth the nformton node degrees. et the f s be s defned n Secton nd let (x) = f x. Then we hve f = (x) = λ / j λ j/j, (6) x λ(t)dt/ λ(t)dt. (7) The rte of the systemtc IA code (we shll be delng only wth these) gven by ths degree dstrbuton s gven by ( j te = 1+ ρ ) 1 j/j j λ (8) j/j (Ths s n esy exercse. For proof, see [8].) 3.. Fxed pont nlyss of tertve decodng In [], t ws shown tht f for code ensemble, the probblty of the depthl neghborhood of n edge (n the Tnner grph) beng cyclefree goes to 1 s the length of the code goes to nfnty (we wll cll ths condton the cyclefree condton), then densty evoluton gves n ccurte estmte of the bt error rte fter l tertons, gn s the length of the codes goes to nfnty. In densty evoluton, we evolve the probblty densty of the messges beng pssed ccordng to the opertons beng performed on them, ssumng tht ll ncomng messges re ndependent (whch s true f the depthl neghbourhood s treelke). The cyclefree condton does ndeed hold for IA codes. The proof of ths fct s lmost exctly the sme s n the rregulr DPC codes cse, whch ws done n []. Now, n the cse of the ersure chnnel, we hve seen tht the messges re only of three types, so n effect we hve dscrete densty functon, nd the probblty of error s merely the probblty of ersure. Wth ths n mnd, we wll now study the evoluton of the ersure probblty, nd derve condtons whch gurntee tht t goes to zero s the number of tertons goes to nfnty. Under these condtons tertve decodng wll be successful n the sense of [],.e., t wll cheve rbtrrly smll BEs, gven enough tertons nd long enough codes. et p be the chnnel probblty of ersure. We wll terte the probblty of ersure long the edges of the grph durng the course of the lgorthm. et x be the probblty of ersure on n edge from n nformton node to check node, x 1 the probblty of ersure on n edge from check node to prty node, x the probblty of ersure on n edge from prty node to check node, nd x 3 the probblty of ersure on n edge from check node to n nformton node. The ntl probblty of ersure on the messge bts s p. We now ssume tht we re t fxed pont of the decodng lgorthm nd solve for x. We get the followng equtons: x 1 = 1 (1 x )(1 x ), (9) x = px 1, (1) x 3 = 1 (1 x ) ρ(1 x ), (11) x = pλ(x 3 ). (1) where (x) s the polynoml n whch the coeffcent of x denotes the frcton of check nodes of degree. (x) s gven by (cf. eq. (7)) (x) = x ρ(t)dt ρ(t)dt (13) We elmnte x 1 from the frst two of these equtons to get x n terms of x nd then keep substtutng forwrds to get n equton purely n x, henceforth denoted by x. We thereby obtn the followng equton for fxed pont of tertve decodng: ( [ ] pλ 1 ρ(1 x)) = x. (14) (1 x) If ths equton hs no soluton n the ntervl (, 1], then tertve decodng must converge to probblty of ersure zero. Therefore, f we hve
4 ( [ ] pλ 1 ρ(1 x)) <x, x. (1 x) (15) then n the sense of [], tertve decodng s successful Cpctychevng sequences of degree dstrbutons We wll now derve sequences of degree dstrbutons tht cn be shown to cheve chnnel cpcty. Frst, we restrct ttenton to the cse ρ(x) =x 1 for some 1, snce t turns out tht we cn cheve cpcty even wth ths restrcton. In ths cse, (x) =x, nd the condton for convergence to zero BE now becomes ( [ ] ) pλ 1 (1 x) (1 x) 1 <x, We now mke the followng new defntons x (16) [ ] f p (x) = 1 (1 x) (1 x) 1 (17) [ ] h p (x) = 1 (1 x) (1 x) (18) g p (x) = h 1 p (x) (19) Notce tht f p (x), h p (x) nd g p (x) re ll monotonc functons n [, 1] nd ttn the vlues t nd 1 t 1. In ddton, h p (x) cn be nverted by hnd (by mkng the substtuton (1 x) = y) nd t cn be shown tht g p (x) hs power seres expnson round wth nonnegtve coeffcents. et ths expnson be g p (x) = g p,x. Now, the condton (16) cn now be rewrtten s whch cn be rewrtten s pλ(f p (x)) <x, x () λ(x) < f p 1 (x) p We mke the followng choce of λ(x): λ(x) = 1 p ( N 1 g p, x + ɛx N ) (1) () where <ɛ<g p,n nd N 1 g p, + ɛ = p. Such choce of N nd ɛ exsts nd s unque snce the g p, s re nonnegtve nd g p, = g p (1) = 1. For ths choce of λ(x), we hve pλ(x) <g p (x) =h 1 p (x) <fp 1 (x) x (3) where the lst nequlty follows becuse f p (x) < h p (x) x. Thus, the condton (1) for BE gong to zero s stsfed nd the degree dstrbutons we hve thus defned yeld codes wth thresholds tht re greter thn or equl to p. We now wsh to compute the rte of these codes n the lmt s to show tht they cheve chnnel cpcty. The rte of the code s gven by eq. (8) whch smplfes to (1 + ( λ /) 1 ) 1 n the rghtregulr cse. Now, lm We lso hve λ = lm lm g p, lm =N N ( N 1 =N g p, + ɛ N ) (4) g p, lm N = (5) where the lst equlty s property of the functon g p (x) nd s lso proved by mnul nverson of h p (x). We therefore hve lm λ = lm g p, = lm = ( 1 g p (x)dx ) h p (x)dx ( ) = x x dx. The ntegrnd on the rght cn be expnded n power seres wth nonnegtve coeffcents, wth the frst nonzero coeffcent beng tht of x. Keepng n mnd tht we re ntegrtng ths power seres, t s esy to see tht +1 < 1 ( ) x x 1 dx h p (x)dx (6) ( ) < x x 1 dx. Both bounds n the bove equton cn be computed esly nd both tend to (1 p)/p n the lmt of lrge. Pluggng ths result nto the formul for the rte, we fnlly get tht the rte tends to 1 p n the lmt of lrge, whch s ndeed the cpcty of the BEC. Thus the sequence of degree dstrbutons gven n eq. () does ndeed cheve chnnel cpcty.
5 3.4. Some numercl results We hve seen tht the condton for BE gong to zero t chnnel ersure probblty of p s pλ(x) <fp 1 (x) x. We lter enforced stronger condton, nmely pλ(x) <h 1 p (x) =g p (x) x nd derved cpctychevng degree sequences stsfyng ths condton. The reson we needed to enforce the stronger condton ws tht h 1 p (x) =g p (x) hs nonnegtve powerseres coeffcents, whle the sme cnnot be sd for fp 1 (x). However, from (6) we see tht enforcng ths stronger condton costs us fctor of 1 /(+1) = 1/(+1) n the rte whch s very lrge for vlues of tht re of nterest, nd therefore the resultng codes re not very good. If, however, fp 1 (x) were to hve nonnegtve power seres coeffcents, then we could use t to defne degree dstrbuton nd we would no longer lose ths fctor of 1/( + 1). We hve found through drect numercl computton n ll cses tht we tred, tht enough terms n the begnnng of ths power seres re nonnegtve to enble us to defne λ(x) by n equton nlogous to eq. (), replcng g p (x) by fp 1 (x). Of course, the resultng code s not theoretclly gurnteed to hve threshold p, but numercl computton shows tht the threshold s ether equl to or very mrgnlly less thn p. Ths desgn turns out to yeld very powerful codes, n prtculr codes whose performnce s n every wy comprble to the rregulr DPC codes lsted n [8] s fr s decodng performnce s concerned. The performnce of some of these dstrbutons s lsted n Tble 1. The threshold vlues p re the sme s those n [8] for correspondng vlues of (IA codes wth rght degree + should be compred to rregulr DPC codes wth rght degree, so tht the decodng complexty s bout the sme), so s to mke comprson esy. The codes lsted n [8] were shown to hve certn optmlty propertes wth respect to the trdeoff between 1 δ/(1 ) (dstnce from cpcty) nd (decodng complexty), so t s very hertenng to note tht the codes we hve desgned re comprble to these. We end ths secton wth bref dscusson of the cse = 1. In ths cse, t turns out tht fp 1 (x) does ndeed hve nonnegtve powerseres coeffcents. The resultng degree sequences yeld codes tht re better thn conventonl A codes t smll rtes. An entrely smlr exercse cn be crred out for the cse of nonsystemtc A codes wth =1 nd the codes resultng n ths cse re sgnfcntly better thn conventonl A codes for most rtes. However, nonsystemtc A codes turn out to be useless for hgher vlues of, s cn be seen by mnully followng the decodng lgorthm for one terton, whch shows tht decodng does not proceed t ll. For ths reson ll the precedng nlyss ws Tble 1: Performnce of some codes desgned usng the procedure descrbed n Secton 3.4. t rtes close to /3 nd 1/. δ s the code threshold (mxmum llowble vlue of p), N the number of terms n λ(x), nd the rte of the code. δ N 1 δ/(1 ) performed for systemtc A codes. 4. IA CODES ON THE AWGN CHANNE In ths secton, we wll consder the behvor of IA codes on the AWGN chnnel. Here there re only two possble nputs, nd 1, but the output lphbet s the set of rel numbers: f the x s the nput, then the output s y =( 1) x + z, where z s men zero, vrnce σ Gussn rndom vrble. For gven nose vrnce σ, our objectve wll be to fnd left degree sequence λ(x) such tht the ensemble messge error probblty pproches zero, whle the rte s s lrge s possble. Unlke the BEC, where we del only wth probbltes, n the cse of the AWGN we must del wth probblty denstes. Ths complctes the nlyss, nd forces us to resort to pproxmte desgn methods Gussn Approxmton Wberg [9] hs shown tht the messges pssed n tertve decodng on the AWGN chnnel cn be well pproxmted by Gussn rndom vrbles, provded the messges re n loglkelhood rto form. In [6], ths pproxmton ws used to desgn good DPC codes for the AWGN chnnel. In ths subsecton, we use ths Gussn pproxmton to desgn good IA codes for the AWGN chnnel. Specfclly, we pproxmte the messges from check nodes to vrble nodes (both nformton nd prty) s Gussn t every terton. For vrble node, f ll the ncomng messges re Gussn, then ll the outgong messges re lso Gussn becuse of (4). A Gussn dstrbuton f(x) s clled consstent [5] f f(x) =f( x)e x for x. The consstency condton mples tht the men nd vrnce stsfy σ =µ. For the sumproduct lgorthm, t hs been shown [] tht consstency s preserved t messge updtes of both the vrble nd
6 check nodes. Thus f we ssume Gussn messges, nd requre consstency, we only need to keep trck of the mens. To ths end, we defne consstent Gussn densty wth men µ to be G µ (z) = 1 e (z µ) /4µ. (7) 4πµ The expected vlue of tnh z for consstent Gussn dstrbuted rndom vrble z wth men µ s then E[tnh z + ]= G µ (z) tnh z dz = φ(µ). (8) It s esy to see tht φ(u) s monotonc ncresng functon of u; we denote ts nverse functon by φ ( 1) (y). et µ (l) nd µ(l) be the mens of the messge from check nodes to vrble nodes on the left (.e., nformton nodes) nd on the rght (.e., prty nodes) t the lth terton. We wnt to obtn expressons for µ (l+1) nd µ (l+1) n terms of µ (l) nd µ (l). A messge from degree nformton node to checknodetthelth terton, s Gussn wth men ( 1)µ (l) + µ o, where µ o s the men of messge m o n (4). Hence f v denotes the messge on rndomly selected edge from n nformton node to check node, the densty of v s From (9) nd (8) we obtn: λ G (l) ( 1)µ +µo(z). (9) E[tnh v ]= λ φ(( 1)µ (l) + µ o). (3) Smlrly, f v denotes the messge on rndomly selected edge from prty node to check node, E[tnh v ]=φ(µ(l) + µ o). (31) Becuse of (5) we hve E[tnh m(u v) ]= E[tnh w v m(w u) ]. (3) Denote messge from check node to n nformton node, resp. prty node, by u, resp, u. eplcng E[tnh m(w u) ] wth the rght sde of (3) or (31) dependng upon whether the messge comes from the left or rght, (3) mples: E[tnh u ]=E[tnh v ] 1 E[tnh v ] = ( λ φ(( 1)µ (l) + µ o)) 1 (φ(µ (l) + µ o)), E[tnh u ]=E[tnh v ] E[tnh v ] = ( λ φ(( 1)µ (l) + µ o)) φ(µ (l) + µ o). Usng the defnton of φ(µ) n (8), we thus hve the followng recurson for µ (l) nd µ(l) : φ(µ (l+1) ) = ( λ φ(( 1)µ (l) + µ o)) 1 (φ(µ (l) + µ o)), (33) φ(µ (l+1) ) = ( λ φ(( 1)µ (l) + µ o)) φ(µ (l) + µ o). (34) In order to hve rbtrry smll bt error probblty, the mens µ (l) nd µ(l) should pproch nfnty s l pproches nfnty. In the next subsecton, we derve suffcent condton for ths. 4.. Fxed pont nlyss We now ssume tht tertve dedodng hs reched fxed pont of (33) nd (34),.e., µ (l+1) = µ (l) = µ nd µ (l+1) = µ (l) = µ. Denote J λ φ(( 1)µ + µ o )byx. From (3) we cn see tht <x<1 nd x 1 f nd only f µ. From (34) t s esy to show tht µ s functon of x, denoted by f,.e., µ = f(x). Then, dvdng (33) by the squre of (34) gves us: φ(µ )=φ (µ )/x +1 = φ (f(x))/x +1. (35) Now replcng µ wth φ ( 1) (φ (f(x))/x +1 ) nto the defnton of x, we obtn the followng equton for the fxed pont x: x = λ φ(µ o +( 1)φ ( 1) ( φ (f(x)) x +1 )). (36) If ths equton doesn t hve soluton n the ntervl [, 1], then the decodng bt error probblty converges to zero. Therefore, f we hve F (x) = λ φ(µ o +( 1)φ ( 1) ( φ (f(x)) x +1 )) >x, (37) for ny x [x, 1), where x s the vlue of x t the frst terton, then (the Gussn pproxmton to) tertve decodng s successful. Snce the rte of the code s gven by (cf. (8)): λ / 1/ + λ /, (38)
7 to mxmze the rte, we should mxmze λ /. Thus, under the Gussn pproxmton, the problem of fndng good degree sequence for IA codes s converted to the followng lner progrmmng problem: ner Progrmmng Problem. Mxmze under the condton λ /, (39) F (x) >x, x [x, 1]. (4) We hve desgned some degree sequences for IA codes usng ths lner progrmmng methodology. The results re presented n Tbles (code rte 1/3) nd 3 (code rte 1/). After usng the heurstc Gussn pproxmton method to desgn the degree sequences, we used exct densty evoluton to determne the ctul nose threshold. (In every cse, the true tertve decodng threshold ws better thn the one predcted by the Gussn pproxmton.) 3 4 λ λ λ λ λ λ λ λ λ 14 λ 16 λ λ rte σ GA σ ( E b N ) (db) S.. (db) Tble : Good degree sequences yeldng codes of rte pproxmtely 1/3 for the AWGN chnnel nd wth =, 3, 4. For ech sequence the Gussn pproxmton nose threshold, the ctul sumproduct decodng threshold, nd the correspondng ( E b N ) n db re gven. Also lsted s the Shnnon lmt (S..) For exmple, consder the = 3 column n Tble. We djust Gussn pproxmton nose threshold σ GA to be to hve the returned optml sequence hvng rte Then pplyng the exct densty evoluton progrm on ths code, we obtn the ctul sumproduct decodng threshold σ =1.67, whch corresponds to E b /N =.5 db. Ths should be compred to the Shnnon lmt for the ensemble of ll lner codes of the sme rte, whch s.4958 db. As we ncrese the prmeter, the ensemble mproves. For = 4, the best code we hve found hs tertve decodng threshold E b /N =.371 db, whch s only.1 db bove the Shnnon lmt. The bove nlyss s for bt error probblty. In order to hve zero word error probblty, t s necessry to hve λ =. (Ths cn be proved by the followng rgument: f λ >, then n the ensemble, s n, the verge number of weght codewords s bounded wy from zero. Hence even mxmumlkelhood decoder would hve nonzero decodng error probblty.) In Tble 3, we compre the nose thresholds of codes wth nd wthout λ =. 8 8 λ λ λ λ λ λ λ λ.7559 λ λ λ λ rte σ ( E b N ) (db) Shnnon lmt Tble 3: Two degree sequences yeldng codes of rte 1/ wth = 8. For ech sequence, the ctul sumproduct decodng threshold, nd the correspondng ( E b N ) n db re gven. Also lsted s the Shnnon lmt. We chose rte onehlf becuse we wnted to compre our results wth the best rregulr DPC codes obtned n [5]. Our best IA code hs threshold.66 db, whle the best rte onehlf rregulr DPC code found n [5] hs threshold.5 db. These two codes hve roughly the sme decodng complexty, but unlke DPC codes, IA codes hve smple lner encodng lgorthm.
8 4.3. Smulton esults We smulted the rte onehlf code wth λ = n Tble 3. Fgure shows the performnce of tht prtculr code, wth nformton block lengths 1 3,1 4, nd 1 5. For comprson, we lso show the performnce of the best known rte 1/ turbo code for the sme block length. BE n=1 Asymptotc Threshold.344 db n=1 n=1 IA code Turbo code SN (db) Fgure : Comprson between turbo codes (dshed curves) nd IA codes (sold curves) of lengths n = 1 3, 1 4, 1 5. All codes re of rte onehlf. 5. CONCUSIONS We hve ntroduced clss of codes, the IA codes, tht combnes mny of the fvorble ttrbutes of turbo codes nd DPC codes. ke turbo codes (nd unlke DPC codes), they cn be encoded n lner tme. ke DPC codes (nd unlke turbo codes), they re menble to n exct chrdson Urbnke style nlyss. In smulted performnce they pper to be slghtly superor to turbo codes of comprble complexty, nd just s good s the best known rregulr DPC codes. In our opnon, the mportnt open problem s to prove (or dsprove) tht IA codes cn be decoded relbly n lner tme t rtes rbtrrly close to chnnel cpcty. We know ths to be true for the bnry ersure chnnel, but for no other chnnel model. If ths should turn out ot be true, we would rgue tht IA codes defntvely solve the problem posed mplctly by Shnnon n If t s not true, then reserchers should serch for n even better clss of code ensembles. EFEENCES [1] D. Dvslr, H. Jn, nd. J. McElece, Codng theorems for turbolke codes, pp. 11 n Proc. 36th Allerton Conf. on Communcton, Control, nd Computng. (Allerton, Illnos, Sept. 1998). [] T. J. chrdson nd. Urbnke, The cpcty of lowdensty prtycheck codes under messge pssng decodng, submtted to IEEE Trns. Inform. Theory. [3] M. uby, M. Mtzenmcher, A. Shokrollh, D. Spelmn, nd V. Stemnn, Prctcl lossreslent codes, Proc. 9th ACM Symp. on the Theory of Computng (1997), pp [4] M. uby, M. Mtzenmcher, A. Shokrollh, nd D. Spelmn, Anlyss of lowdensty codes nd mproved desgns usng rregulr grphs, Proc. 3th ACM Symp. on the Theory of Computng (1998), pp [5] T. J. chrdson, A. Shokrollh,, nd. Urbnke, Desgn of provbly good lowdensty prtycheck codes, submtted to IEEE Trns. Inform. Theory. [6] S.Y. Chung,. Urbnke,, nd T. J. chrdson, Anlyss of sumproduct decodng of lowdensty prtycheck codes usng Gussn pproxmton, submtted to IEEE Trns. Inform. Theory. [7] D. Dvslr, S. Dolnr, nd F. Pollr, Itertve turbo decoder nlyss bsed on Gussn densty evoluton, submtted to IEEE J. Selected Ares n Comm. [8] M. A. Shokrollh, New sequences of lner tme ersure codes pprochng chnnel cpcty, Proc ISITA (Honolulu, Hw, November 1999) pp [9] N. Wberg, Codes nd decodng on generl grphs, dssertton no. 44, nköpng Studes n Scence nd Technology, nköpng, Sweden, [1] J. Hgenuer, E. Offer, nd. Ppke, Itertve decodng of bnry block nd convolutonl codes, IEEE Trns. Inform. Theory, vol. IT 4, no. (Mrch 1996). pp
Chapter NewtonRaphson Method of Solving a Nonlinear Equation
Chpter.4 NewtonRphson Method of Solvng Nonlner Equton After redng ths chpter, you should be ble to:. derve the NewtonRphson method formul,. develop the lgorthm of the NewtonRphson method,. use the NewtonRphson
More informationNewtonRaphson Method of Solving a Nonlinear Equation Autar Kaw
NewtonRphson Method o Solvng Nonlner Equton Autr Kw Ater redng ths chpter, you should be ble to:. derve the NewtonRphson method ormul,. develop the lgorthm o the NewtonRphson method,. use the NewtonRphson
More informationLuby s Alg. for Maximal Independent Sets using Pairwise Independence
Lecture Notes for Randomzed Algorthms Luby s Alg. for Maxmal Independent Sets usng Parwse Independence Last Updated by Erc Vgoda on February, 006 8. Maxmal Independent Sets For a graph G = (V, E), an ndependent
More informationOptimal Pricing Scheme for Information Services
Optml rcng Scheme for Informton Servces Shny Wu Opertons nd Informton Mngement The Whrton School Unversty of ennsylvn Eml: shnwu@whrton.upenn.edu eyu (Shron) Chen Grdute School of Industrl Admnstrton
More informationWiMAX DBA Algorithm Using a 2Tier MaxMin Fair Sharing Policy
WMAX DBA Algorthm Usng 2Ter MxMn Fr Shrng Polcy PeChen Tseng 1, JYn Ts 2, nd WenShyng Hwng 2,* 1 Deprtment of Informton Engneerng nd Informtcs, Tzu Ch College of Technology, Hulen, Twn pechen@tccn.edu.tw
More informationGraph Theory and Cayley s Formula
Graph Theory and Cayley s Formula Chad Casarotto August 10, 2006 Contents 1 Introducton 1 2 Bascs and Defntons 1 Cayley s Formula 4 4 Prüfer Encodng A Forest of Trees 7 1 Introducton In ths paper, I wll
More informationRecurrence. 1 Definitions and main statements
Recurrence 1 Defntons and man statements Let X n, n = 0, 1, 2,... be a MC wth the state space S = (1, 2,...), transton probabltes p j = P {X n+1 = j X n = }, and the transton matrx P = (p j ),j S def.
More informationA Hadoop Job Scheduling Model Based on Uncategorized Slot
Journl of Communctons Vol. 10, No. 10, October 2015 A Hdoop Job Schedulng Model Bsed on Unctegored Slot To Xue nd Tngtng L Deprtment of Computer Scence, X n Polytechnc Unversty, X n 710048, Chn Eml: xt73@163.com;
More informationPolynomial Functions. Polynomial functions in one variable can be written in expanded form as ( )
Polynomil Functions Polynomil functions in one vrible cn be written in expnded form s n n 1 n 2 2 f x = x + x + x + + x + x+ n n 1 n 2 2 1 0 Exmples of polynomils in expnded form re nd 3 8 7 4 = 5 4 +
More informationWHAT HAPPENS WHEN YOU MIX COMPLEX NUMBERS WITH PRIME NUMBERS?
WHAT HAPPES WHE YOU MIX COMPLEX UMBERS WITH PRIME UMBERS? There s n ol syng, you n t pples n ornges. Mthemtns hte n t; they love to throw pples n ornges nto foo proessor n see wht hppens. Sometmes they
More informationBoolean Algebra. ECE 152A Winter 2012
Boolen Algebr ECE 52A Wnter 22 Redng Assgnent Brown nd Vrnesc 2 Introducton to Logc Crcuts 2.5 Boolen Algebr 2.5. The Venn Dgr 2.5.2 Notton nd Ternology 2.5.3 Precedence of Opertons 2.6 Synthess Usng AND,
More informationGraphs on Logarithmic and Semilogarithmic Paper
0CH_PHClter_TMSETE_ 3//00 :3 PM Pge Grphs on Logrithmic nd Semilogrithmic Pper OBJECTIVES When ou hve completed this chpter, ou should be ble to: Mke grphs on logrithmic nd semilogrithmic pper. Grph empiricl
More informationResistive Network Analysis. The Node Voltage Method  1
esste Network Anlyss he nlyss of n electrcl network conssts of determnng ech of the unknown rnch currents nd node oltges. A numer of methods for network nlyss he een deeloped, sed on Ohm s Lw nd Krchoff
More information8.5 UNITARY AND HERMITIAN MATRICES. The conjugate transpose of a complex matrix A, denoted by A*, is given by
6 CHAPTER 8 COMPLEX VECTOR SPACES 5. Fnd the kernel of the lnear transformaton gven n Exercse 5. In Exercses 55 and 56, fnd the mage of v, for the ndcated composton, where and are gven by the followng
More informationNaïve Gauss Elimination
Nïve Guss Elmnton Ch.9 Nïve Guss Elmnton Lner Alger Revew Elementry Mtr Opertons Needed for Elmnton Methods: Multply n equton n the system y nonzero rel numer. Interchnge the postons of two equton n the
More informationLossless Data Compression
Lossless Data Compresson Lecture : Unquely Decodable and Instantaneous Codes Sam Rowes September 5, 005 Let s focus on the lossless data compresson problem for now, and not worry about nosy channel codng
More informationBasics of Counting. A note on combinations. Recap. 22C:19, Chapter 6.5, 6.7 Hantao Zhang
Bscs of Countng 22C:9, Chpter 6.5, 6.7 Hnto Zhng A note on comntons An lterntve (nd more common) wy to denote n rcomnton: n n C ( n, r) r I ll use C(n,r) whenever possle, s t s eser to wrte n PowerPont
More informationv a 1 b 1 i, a 2 b 2 i,..., a n b n i.
SECTION 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS 455 8.4 COMPLEX VECTOR SPACES AND INNER PRODUCTS All the vector spaces we have studed thus far n the text are real vector spaces snce the scalars are
More informationSolution : (a) FALSE. Let C be a binary oneerror correcting code of length 9. Then it follows from the Sphere packing bound that.
MATH 29T Exam : Part I Solutons. TRUE/FALSE? Prove your answer! (a) (5 pts) There exsts a bnary oneerror correctng code of length 9 wth 52 codewords. (b) (5 pts) There exsts a ternary oneerror correctng
More informationModels and Software for Urban and Regional Transportation Planning : The Contributions of the Center for Research on Transportation
Models nd Softwre for Urbn nd Regonl Plnnng : The Contrbutons of the Center for Reserch on Mchel Florn Aprl 2008 CIRRELT200811 Models nd Softwre for Urbn Regonl Plnnng: The Contrbutons of the Center
More informationORIGIN DESTINATION DISAGGREGATION USING FRATAR BIPROPORTIONAL LEAST SQUARES ESTIMATION FOR TRUCK FORECASTING
ORIGIN DESTINATION DISAGGREGATION USING FRATAR BIPROPORTIONAL LEAST SQUARES ESTIMATION FOR TRUCK FORECASTING Unversty of Wsconsn Mlwukee Pper No. 091 Ntonl Center for Freght & Infrstructure Reserch &
More informationLesson 28 Psychrometric Processes
1 Lesson 28 Psychrometrc Processes Verson 1 ME, IIT Khrgpur 1 2 The specfc objectves of ths lecture re to: 1. Introducton to psychrometrc processes nd ther representton (Secton 28.1) 2. Importnt psychrometrc
More information1 Example 1: Axisaligned rectangles
COS 511: Theoretcal Machne Learnng Lecturer: Rob Schapre Lecture # 6 Scrbe: Aaron Schld February 21, 2013 Last class, we dscussed an analogue for Occam s Razor for nfnte hypothess spaces that, n conjuncton
More informationLecture #8. Thévenin Equivalent Circuit
ecture #8 ANNOUNCEMENTS HW#2 solutons, HW#3 re posted onlne Chnge n Frhn s O.H. : 56 nsted of Mo 34 wll e wy next Mondy & Wednesdy Guest lecturer: Prof. Neureuther s offce hour on Wed. 9/17 cncelled
More informationLecture 3: Force of Interest, Real Interest Rate, Annuity
Lecture 3: Force of Interest, Real Interest Rate, Annuty Goals: Study contnuous compoundng and force of nterest Dscuss real nterest rate Learn annutymmedate, and ts present value Study annutydue, and
More informationChapter Solution of Cubic Equations
Chpter. Soluton of Cuc Equtons After redng ths chpter, ou should e le to:. fnd the ect soluton of generl cuc equton. Ho to Fnd the Ect Soluton of Generl Cuc Equton In ths chpter, e re gong to fnd the ect
More informationVector Geometry for Computer Graphics
Vector Geometry for Computer Grphcs Bo Getz Jnury, 7 Contents Prt I: Bsc Defntons Coordnte Systems... Ponts nd Vectors Mtrces nd Determnnts.. 4 Prt II: Opertons Vector ddton nd sclr multplcton... 5 The
More informationModule 2 LOSSLESS IMAGE COMPRESSION SYSTEMS. Version 2 ECE IIT, Kharagpur
Module LOSSLESS IMAGE COMPRESSION SYSTEMS Lesson 3 Lossless Compresson: Huffman Codng Instructonal Objectves At the end of ths lesson, the students should be able to:. Defne and measure source entropy..
More informationbenefit is 2, paid if the policyholder dies within the year, and probability of death within the year is ).
REVIEW OF RISK MANAGEMENT CONCEPTS LOSS DISTRIBUTIONS AND INSURANCE Loss and nsurance: When someone s subject to the rsk of ncurrng a fnancal loss, the loss s generally modeled usng a random varable or
More informationReasoning to Solve Equations and Inequalities
Lesson4 Resoning to Solve Equtions nd Inequlities In erlier work in this unit, you modeled situtions with severl vriles nd equtions. For exmple, suppose you were given usiness plns for concert showing
More informationTests for One Poisson Mean
Chpter 412 Tests for One Poisson Men Introduction The Poisson probbility lw gives the probbility distribution of the number of events occurring in specified intervl of time or spce. The Poisson distribution
More informationBERNSTEIN POLYNOMIALS
OnLne Geometrc Modelng Notes BERNSTEIN POLYNOMIALS Kenneth I. Joy Vsualzaton and Graphcs Research Group Department of Computer Scence Unversty of Calforna, Davs Overvew Polynomals are ncredbly useful
More informationIncorporating Negative Values in AHP Using Rule Based Scoring Methodology for Ranking of Sustainable Chemical Process Design Options
20 th Europen ymposum on Computer Aded Process Engneerng ECAPE20. Perucc nd G. Buzz Ferrrs (Edtors) 2010 Elsever B.V. All rghts reserved. Incorportng Negtve Vlues n AHP Usng Rule Bsed corng Methodology
More informationOn the Meaning of Regression Coefficients for Categorical and Continuous Variables: Model I and Model II; Effect Coding and Dummy Coding
Dt_nlysisclm On the Mening of Regression for tegoricl nd ontinuous Vribles: I nd II; Effect oding nd Dummy oding R Grdner Deprtment of Psychology This describes the simple cse where there is one ctegoricl
More informationLecture 3 Gaussian Probability Distribution
Lecture 3 Gussin Probbility Distribution Introduction l Gussin probbility distribution is perhps the most used distribution in ll of science. u lso clled bell shped curve or norml distribution l Unlike
More informationExtending Probabilistic Dynamic Epistemic Logic
Extendng Probablstc Dynamc Epstemc Logc Joshua Sack May 29, 2008 Probablty Space Defnton A probablty space s a tuple (S, A, µ), where 1 S s a set called the sample space. 2 A P(S) s a σalgebra: a set
More informationMATH 150 HOMEWORK 4 SOLUTIONS
MATH 150 HOMEWORK 4 SOLUTIONS Section 1.8 Show tht the product of two of the numbers 65 1000 8 2001 + 3 177, 79 1212 9 2399 + 2 2001, nd 24 4493 5 8192 + 7 1777 is nonnegtive. Is your proof constructive
More informationPositive Integral Operators With Analytic Kernels
Çnky Ünverte FenEdeyt Fkülte, Journl of Art nd Scence Sy : 6 / Arl k 006 Potve ntegrl Opertor Wth Anlytc Kernel Cn Murt D KMEN Atrct n th pper we contruct exmple of potve defnte ntegrl kernel whch re
More informationExample 27.1 Draw a Venn diagram to show the relationship between counting numbers, whole numbers, integers, and rational numbers.
2 Rtionl Numbers Integers such s 5 were importnt when solving the eqution x+5 = 0. In similr wy, frctions re importnt for solving equtions like 2x = 1. Wht bout equtions like 2x + 1 = 0? Equtions of this
More informationAPPLICATION OF QUEUING THEORY TO DYNAMIC VEHICLE ROUTING PROBLEM WeiNing Chen, Kainan University Taiwan
GLOBAL JOURNAL OF BUSINESS RESEARCH VOLUME 3 NUMBER 009 APPLICATION OF QUEUING THEORY TO DYNAMIC VEHICLE ROUTING PROBLEM WeNng Chen Knn Unersty Twn ABSTRACT In ths pper we eelope n nlyze ynmc moel of
More informationMathematics. Vectors. hsn.uk.net. Higher. Contents. Vectors 128 HSN23100
hsn.uk.net Higher Mthemtics UNIT 3 OUTCOME 1 Vectors Contents Vectors 18 1 Vectors nd Sclrs 18 Components 18 3 Mgnitude 130 4 Equl Vectors 131 5 Addition nd Subtrction of Vectors 13 6 Multipliction by
More informationLecture 3 Basic Probability and Statistics
Lecture 3 Bsic Probbility nd Sttistics The im of this lecture is to provide n extremely speedy introduction to the probbility nd sttistics which will be needed for the rest of this lecture course. The
More informationLinear Open Loop Systems
Colordo School of Mne CHEN43 Lner Open Loop Sytem Lner Open Loop Sytem... Trnfer Functon for Smple Proce... Exmple Trnfer Functon Mercury Thermometer...2 Derblty of Devton Vrble...3 Trnfer Functon for
More informationMath 135 Circles and Completing the Square Examples
Mth 135 Circles nd Completing the Squre Exmples A perfect squre is number such tht = b 2 for some rel number b. Some exmples of perfect squres re 4 = 2 2, 16 = 4 2, 169 = 13 2. We wish to hve method for
More informationDistributions. (corresponding to the cumulative distribution function for the discrete case).
Distributions Recll tht n integrble function f : R [,] such tht R f()d = is clled probbility density function (pdf). The distribution function for the pdf is given by F() = (corresponding to the cumultive
More informationU.C. Berkeley CS270: Algorithms Lecture 4 Professor Vazirani and Professor Rao Jan 27,2011 Lecturer: Umesh Vazirani Last revised February 10, 2012
U.C. Berkeley CS270: Algorthms Lecture 4 Professor Vazran and Professor Rao Jan 27,2011 Lecturer: Umesh Vazran Last revsed February 10, 2012 Lecture 4 1 The multplcatve weghts update method The multplcatve
More informationFuzzy Clustering for TV Program Classification
Fuzzy Clusterng for TV rogrm Clssfcton Yu Zhwen Northwestern olytechncl Unversty X n,.r.chn, 7007 yuzhwen77@yhoo.com.cn Gu Jnhu Northwestern olytechncl Unversty X n,.r.chn, 7007 guh@nwpu.edu.cn Zhou Xngshe
More information11. Fourier series. sin mx cos nx dx = 0 for any m, n, sin 2 mx dx = π.
. Fourier series Summry of the bsic ides The following is quick summry of the introductory tretment of Fourier series in MATH. We consider function f with period π, tht is, stisfying f(x + π) = f(x) for
More informationUse Geometry Expressions to create a more complex locus of points. Find evidence for equivalence using Geometry Expressions.
Lerning Objectives Loci nd Conics Lesson 3: The Ellipse Level: Preclculus Time required: 120 minutes In this lesson, students will generlize their knowledge of the circle to the ellipse. The prmetric nd
More informationExample A rectangular box without lid is to be made from a square cardboard of sides 18 cm by cutting equal squares from each corner and then folding
1 Exmple A rectngulr box without lid is to be mde from squre crdbord of sides 18 cm by cutting equl squres from ech corner nd then folding up the sides. 1 Exmple A rectngulr box without lid is to be mde
More informationSection 5.3 Annuities, Future Value, and Sinking Funds
Secton 5.3 Annutes, Future Value, and Snkng Funds Ordnary Annutes A sequence of equal payments made at equal perods of tme s called an annuty. The tme between payments s the payment perod, and the tme
More informationThe Velocity Factor of an Insulated TwoWire Transmission Line
The Velocity Fctor of n Insulted TwoWire Trnsmission Line Problem Kirk T. McDonld Joseph Henry Lbortories, Princeton University, Princeton, NJ 08544 Mrch 7, 008 Estimte the velocity fctor F = v/c nd the
More informationOnline Learning from Experts: Minimax Regret
E0 370 tatstcal Learnng Theory Lecture 2 Nov 24, 20) Onlne Learnng from Experts: Mn Regret Lecturer: hvan garwal crbe: Nkhl Vdhan Introducton In the last three lectures we have been dscussng the onlne
More informationFactoring Polynomials
Fctoring Polynomils Some definitions (not necessrily ll for secondry school mthemtics): A polynomil is the sum of one or more terms, in which ech term consists of product of constnt nd one or more vribles
More informationUniform convergence and its consequences
Uniform convergence nd its consequences The following issue is centrl in mthemtics: On some domin D, we hve sequence of functions {f n }. This mens tht we relly hve n uncountble set of ordinry sequences,
More informationn + d + q = 24 and.05n +.1d +.25q = 2 { n + d + q = 24 (3) n + 2d + 5q = 40 (2)
MATH 16T Exam 1 : Part I (InClass) Solutons 1. (0 pts) A pggy bank contans 4 cons, all of whch are nckels (5 ), dmes (10 ) or quarters (5 ). The pggy bank also contans a con of each denomnaton. The total
More informationSupport Vector Machines
Support Vector Machnes Max Wellng Department of Computer Scence Unversty of Toronto 10 Kng s College Road Toronto, M5S 3G5 Canada wellng@cs.toronto.edu Abstract Ths s a note to explan support vector machnes.
More informationA linear recurrence sequence of composite numbers
LMS J Comput Math 15 (2012) 360 373 C 2012 Author do:101112/s1461157012001143 A lnear recurrence sequence of composte numbers Jonas Šurys Abstract We prove that for each postve nteger k n the range 2 k
More informationWeek 6 Market Failure due to Externalities
Week 6 Market Falure due to Externaltes 1. Externaltes n externalty exsts when the acton of one agent unavodably affects the welfare of another agent. The affected agent may be a consumer, gvng rse to
More information+ + +   This circuit than can be reduced to a planar circuit
MeshCurrent Method The meshcurrent s analog of the nodeoltage method. We sole for a new set of arables, mesh currents, that automatcally satsfy KCLs. As such, meshcurrent method reduces crcut soluton to
More informationDlNBVRGH + Sickness Absence Monitoring Report. Executive of the Council. Purpose of report
DlNBVRGH + + THE CITY OF EDINBURGH COUNCIL Sickness Absence Monitoring Report Executive of the Council 8fh My 4 I.I...3 Purpose of report This report quntifies the mount of working time lost s result of
More information9 Arithmetic and Geometric Sequence
AAU  Busness Mathematcs I Lecture #5, Aprl 4, 010 9 Arthmetc and Geometrc Sequence Fnte sequence: 1, 5, 9, 13, 17 Fnte seres: 1 + 5 + 9 + 13 +17 Infnte sequence: 1,, 4, 8, 16,... Infnte seres: 1 + + 4
More informationIn our example i = r/12 =.0825/12 At the end of the first month after your payment is received your amount in the account, the balance, is
Payout annutes: Start wth P dollars, e.g., P = 100, 000. Over a 30 year perod you receve equal payments of A dollars at the end of each month. The amount of money left n the account, the balance, earns
More informationQuadratic Equations. Math 99 N1 Chapter 8
Qudrtic Equtions Mth 99 N1 Chpter 8 1 Introduction A qudrtic eqution is n eqution where the unknown ppers rised to the second power t most. In other words, it looks for the vlues of x such tht second degree
More information8 Algorithm for Binary Searching in Trees
8 Algorthm for Bnary Searchng n Trees In ths secton we present our algorthm for bnary searchng n trees. A crucal observaton employed by the algorthm s that ths problem can be effcently solved when the
More informationEE201 Circuit Theory I 2015 Spring. Dr. Yılmaz KALKAN
EE201 Crcut Theory I 2015 Sprng Dr. Yılmaz KALKAN 1. Basc Concepts (Chapter 1 of Nlsson  3 Hrs.) Introducton, Current and Voltage, Power and Energy 2. Basc Laws (Chapter 2&3 of Nlsson  6 Hrs.) Voltage
More informationGeneralized Inverses: How to Invert a NonInvertible Matrix
Generlized Inverses: How to Invert NonInvertible Mtrix S. Swyer September 7, 2006 rev August 6, 2008. Introduction nd Definition. Let A be generl m n mtrix. Then nturl question is when we cn solve Ax
More informationAn Alternative Way to Measure Private Equity Performance
An Alternatve Way to Measure Prvate Equty Performance Peter Todd Parlux Investment Technology LLC Summary Internal Rate of Return (IRR) s probably the most common way to measure the performance of prvate
More informationSection 5.4 Annuities, Present Value, and Amortization
Secton 5.4 Annutes, Present Value, and Amortzaton Present Value In Secton 5.2, we saw that the present value of A dollars at nterest rate per perod for n perods s the amount that must be deposted today
More informationDriver Attitudes and Choices: Speed Limits, Seat Belt Use, and DrinkingandDriving
Drver Atttudes nd Choces: Speed Lmts, Set Belt Use, nd DrnkngndDrvng YoungJun Kweon Assocte Reserch Scentst Vrgn Trnsportton Reserch Councl Young Jun.Kweon@VDOT.Vrgn.gov Vrgn Trnsportton Reserch Councl
More informationFinite Automata. Informatics 2A: Lecture 3. John Longley. 25 September School of Informatics University of Edinburgh
Lnguges nd Automt Finite Automt Informtics 2A: Lecture 3 John Longley School of Informtics University of Edinburgh jrl@inf.ed.c.uk 25 September 2015 1 / 30 Lnguges nd Automt 1 Lnguges nd Automt Wht is
More informationSolutions to Section 1
Solutions to Section Exercise. Show tht nd. This follows from the fct tht mx{, } nd mx{, } Exercise. Show tht = { if 0 if < 0 Tht is, the bsolute vlue function is piecewise defined function. Grph this
More information2.4 Bivariate distributions
page 28 2.4 Bvarate dstrbutons 2.4.1 Defntons Let X and Y be dscrete r.v.s defned on the same probablty space (S, F, P). Instead of treatng them separately, t s often necessary to thnk of them actng together
More informationMULTICRITERIA DECISION AIDING IN PROJECT MANAGEMENT OUTRANKING APPROACH AND VERBAL DECISION ANALYSIS
Dorot Górec Deprtment of Econometrcs nd Sttstcs Ncolus Coperncus Unversty n Toruń MULTICRITERIA DECISION AIDING IN PROJECT MANAGEMENT OUTRANKING APPROACH AND VERBAL DECISION ANALYSIS Introducton A proect
More informationgreatest common divisor
4. GCD 1 The greatest common dvsor of two ntegers a and b (not both zero) s the largest nteger whch s a common factor of both a and b. We denote ths number by gcd(a, b), or smply (a, b) when there s no
More information6. EIGENVALUES AND EIGENVECTORS 3 = 3 2
EIGENVALUES AND EIGENVECTORS The Characterstc Polynomal If A s a square matrx and v s a nonzero vector such that Av v we say that v s an egenvector of A and s the correspondng egenvalue Av v Example :
More informationSection 4.3. By the Mean Value Theorem, for every i = 1, 2, 3,..., n, there exists a point c i in the interval [x i 1, x i ] such that
Difference Equtions to Differentil Equtions Section 4.3 The Fundmentl Theorem of Clculus We re now redy to mke the longpromised connection between differentition nd integrtion, between res nd tngent lines.
More informationGeneralizing the degree sequence problem
Mddlebury College March 2009 Arzona State Unversty Dscrete Mathematcs Semnar The degree sequence problem Problem: Gven an nteger sequence d = (d 1,...,d n ) determne f there exsts a graph G wth d as ts
More informationNONCONSTANT SUM REDANDBLACK GAMES WITH BETDEPENDENT WIN PROBABILITY FUNCTION LAURA PONTIGGIA, University of the Sciences in Philadelphia
To appear n Journal o Appled Probablty June 2007 OCOSTAT SUM REDADBLACK GAMES WITH BETDEPEDET WI PROBABILITY FUCTIO LAURA POTIGGIA, Unversty o the Scences n Phladelpha Abstract In ths paper we nvestgate
More informationSolution of Algebraic and Transcendental Equations
CHAPTER Soluton of Algerac and Transcendental Equatons. INTRODUCTION One of the most common prolem encountered n engneerng analyss s that gven a functon f (, fnd the values of for whch f ( = 0. The soluton
More informationMultiMarket Trading and Liquidity: Theory and Evidence
MultMrket Trdng nd Lqudty: Theory nd Evdence Shmuel Bruch, G. Andrew Kroly, b* Mchel L. Lemmon Eccles School of Busness, Unversty of Uth, Slt Lke Cty, UT 84, USA b Fsher College of Busness, Oho Stte Unversty,
More informationb) The mean of the fitted (predicted) values of Y is equal to the mean of the Y values: c) The residuals of the regression line sum up to zero: = ei
Mathematcal Propertes of the Least Squares Regresson The least squares regresson lne obeys certan mathematcal propertes whch are useful to know n practce. The followng propertes can be establshed algebracally:
More information1 Numerical Solution to Quadratic Equations
cs42: introduction to numericl nlysis 09/4/0 Lecture 2: Introduction Prt II nd Solving Equtions Instructor: Professor Amos Ron Scribes: Yunpeng Li, Mrk Cowlishw Numericl Solution to Qudrtic Equtions Recll
More informationTHE DISTRIBUTION OF LOAN PORTFOLIO VALUE * Oldrich Alfons Vasicek
HE DISRIBUION OF LOAN PORFOLIO VALUE * Oldrch Alfons Vascek he amount of captal necessary to support a portfolo of debt securtes depends on the probablty dstrbuton of the portfolo loss. Consder a portfolo
More informationFINANCIAL MATHEMATICS. A Practical Guide for Actuaries. and other Business Professionals
FINANCIAL MATHEMATICS A Practcal Gude for Actuares and other Busness Professonals Second Edton CHRIS RUCKMAN, FSA, MAAA JOE FRANCIS, FSA, MAAA, CFA Study Notes Prepared by Kevn Shand, FSA, FCIA Assstant
More informationState function: eigenfunctions of hermitian operators> normalization, orthogonality completeness
Schroednger equaton Basc postulates of quantum mechancs. Operators: Hermtan operators, commutators State functon: egenfunctons of hermtan operators> normalzaton, orthogonalty completeness egenvalues and
More informationMath 31 Lesson Plan. Day 27: Fundamental Theorem of Finite Abelian Groups. Elizabeth Gillaspy. November 11, 2011
Math 31 Lesson Plan Day 27: Fundamental Theorem of Fnte Abelan Groups Elzabeth Gllaspy November 11, 2011 Supples needed: Colored chal Quzzes Homewor 4 envelopes: evals, HW, presentaton rubrcs, * probs
More informationSequences and Series
Centre for Eduction in Mthemtics nd Computing Euclid eworkshop # 5 Sequences nd Series c 014 UNIVERSITY OF WATERLOO While the vst mjority of Euclid questions in this topic re use formule for rithmetic
More informationChapter 6 Solving equations
Chpter 6 Solving equtions Defining n eqution 6.1 Up to now we hve looked minly t epressions. An epression is n incomplete sttement nd hs no equl sign. Now we wnt to look t equtions. An eqution hs n = sign
More informationSPECIAL PRODUCTS AND FACTORIZATION
MODULE  Specil Products nd Fctoriztion 4 SPECIAL PRODUCTS AND FACTORIZATION In n erlier lesson you hve lernt multipliction of lgebric epressions, prticulrly polynomils. In the study of lgebr, we come
More informationWhat is Candidate Sampling
What s Canddate Samplng Say we have a multclass or mult label problem where each tranng example ( x, T ) conssts of a context x a small (mult)set of target classes T out of a large unverse L of possble
More information9.1 The Cumulative Sum Control Chart
Learnng Objectves 9.1 The Cumulatve Sum Control Chart 9.1.1 Basc Prncples: Cusum Control Chart for Montorng the Process Mean If s the target for the process mean, then the cumulatve sum control chart s
More informationWe are now ready to answer the question: What are the possible cardinalities for finite fields?
Chapter 3 Fnte felds We have seen, n the prevous chapters, some examples of fnte felds. For example, the resdue class rng Z/pZ (when p s a prme) forms a feld wth p elements whch may be dentfed wth the
More informationTreatment Spring Late Summer Fall 0.10 5.56 3.85 0.61 6.97 3.01 1.91 3.01 2.13 2.99 5.33 2.50 1.06 3.53 6.10 Mean = 1.33 Mean = 4.88 Mean = 3.
The nlysis of vrince (ANOVA) Although the ttest is one of the most commonly used sttisticl hypothesis tests, it hs limittions. The mjor limittion is tht the ttest cn be used to compre the mens of only
More informationEN3: Introduction to Engineering. Teach Yourself Vectors. 1. Definition. Problems
EN3: Introducton to Engneerng Tech Yourself Vectors Dvson of Engneerng Brown Unversty. Defnton vector s mthemtcl obect tht hs mgntude nd drecton, nd stsfes the lws of vector ddton. Vectors re used to represent
More informationA Mathematical Modelling Technique for the Analysis of the Dynamics of a Simple Continuous EDA
A Mthemtcl Modellng Technque for the Anlyss of the Dynmcs of Smple Contnuous EDA Bo Yun, Student Member, IEEE, nd Mrcus Gllgher, Member, IEEE Abstrct Ths pper presents some ntl ttempts to mthemtclly model
More informationExponents base exponent power exponentiation
Exonents We hve seen counting s reeted successors ddition s reeted counting multiliction s reeted ddition so it is nturl to sk wht we would get by reeting multiliction. For exmle, suose we reetedly multily
More informationThe OC Curve of Attribute Acceptance Plans
The OC Curve of Attrbute Acceptance Plans The Operatng Characterstc (OC) curve descrbes the probablty of acceptng a lot as a functon of the lot s qualty. Fgure 1 shows a typcal OC Curve. 10 8 6 4 1 3 4
More informationAppendix D: Completing the Square and the Quadratic Formula. In Appendix A, two special cases of expanding brackets were considered:
Appendi D: Completing the Squre nd the Qudrtic Formul Fctoring qudrtic epressions such s: + 6 + 8 ws one of the topics introduced in Appendi C. Fctoring qudrtic epressions is useful skill tht cn help you
More informationJ. Parallel Distrib. Comput.
J. Parallel Dstrb. Comput. 71 (2011) 62 76 Contents lsts avalable at ScenceDrect J. Parallel Dstrb. Comput. journal homepage: www.elsever.com/locate/jpdc Optmzng server placement n dstrbuted systems n
More information