OUTOFBAG ESTIMATION. Leo Breiman* Statistics Department University of California Berkeley, CA


 Eunice Dortha Conley
 3 years ago
 Views:
Transcription
1 1 OUTOFBAG ESTIMATION Leo Breiman* Saisics Deparmen Universiy of California Berkeley, CA Absrac In bagging, predicors are consruced using boosrap samples from he raining se and hen aggregaed o form a bagged predicor. Each boosrap sample leaves ou abou 37% of he examples. These lefou examples can be used o form accurae esimaes of imporan quaniies. For insance, hey can be used o give much improved esimaes of node probabiliies and node error raes in decision rees. Using esimaed oupus insead of he observed oupus improves accuracy in regression rees. They can also be used o give nearly opimal esimaes of generalizaion errors for bagged predicors. * Parially suppored by NSF Gran Inroducion: We assume ha here is a raining se T= {(yn,xn), n=1,...,n} and a mehod for consrucing a predicor Q(x,T) using he given raining se. The oupu variable y can eiher be a class label (classificaion) or numerical (regression). In bagging (Breiman[1996a]) a sequence of raining ses TB,1,..., TB,K are generaed of he same size as T by boosrap selecion from T. Then K predicors are consruced such ha he kh predicor Q(x,Tk,B) is based on he kh boosrap raining se. I was shown ha if hese predicors are aggregaedaveraging in regression or voing in classificaion, hen he resulan predicor can be considerably more accurae han he original predicor. Accuracy is increased if he predicion mehod is unsable, i.e. if small changes in he raining se or in he parameers used in consrucion can resul in large changes in he resuling predicor. The examples generaed in Breiman[1996a] were based on rees and subse selecion in regression, bu i is known ha neural nes are also unsable, as are oher wellknown predicion mehods. Oher mehods such as neares neighbors, are sable. I urns ou ha bagging, besides is primary purpose of increasing accuracy, has valuable byproducs. Roughly 37% of he examples in he raining se T do no appear in a paricular boosrap raining se TB. Thus, o he predicor Q(x,TB) hese examples are unused es examples. Thus, if K = 100, each paricular example (y,x) in he raining se has abou 37 predicions among he Q(x,Tk,B) such ha Tk,B does no conain (y,x). The predicions for examples "ha are ouofhebag" can be used o form accurae esimaes for imporan quaniies. For example, in classificaion, he ouofbag predicions can be used o esimae he probabiliies ha he example belongs o any one of he J possible classes. Applied o CART his gives a mehod for esimaing node probabiliies more accuraely han anyhing available o dae. Applied o regression rees, we ge an improved mehod for esimaing he expeced error in a node predicion. In regression, using he ouofbag esimaed values for he oupus insead of he acual raining se oupus gives more accurae rees. Simple and accurae
2 2 ouofbag esimaes can be given for he generalizaion error of bagged predicors. Unlike crossvalidaion, hese require no addiional compuing. In his paper, we firs look a esimaes of node class probabiliies in CART (Secion 2), and hen a esimaes of meansquared nodes errors in he regression version of CART (Secion 3). Secion 4 looks a how much accuracy is los by using esimaes ha are averaged over erminal nodes. Indicaions from synheic daa are ha he averaging can accoun for a major componen of he error. Secion 5 gives some heoreical jusificaion for he accuracy of ouofbag esimaes in erms of a poinwise biasvariance decomposiion. Secion 6 gives he effec of consrucing regression rees using he ouofbag oupu esimaes. In Secion 7 he ouofbag esimaes of generalizaion error for bagged predicors are defined and sudied. The Appendix gives some saisical deails. The presen work came from wo simuli. One was he dissaisfacion, over many years, bu growing sronger more recenly, wih he biased node class probabiliy and error esimaes in CART. The oher consised of wo papers. One, by Tibshirani[1996], proposes an ouofbag esimae as par of a mehod for esimaing generalizaion error for any classifier. The second, by Wolper and Macready [1996], looks a a number of mehods for esimaing generalizaion error for bagged regressionsamong hem, a mehod using ouofbag predicions equivalen o he mehod we give in Secion Esimaing node class probabiliies Assume ha he raining se T consiss of independen draws from an Y,X disribuion where Y is a Jclass oupu label and X is a mulivariae inpu vecor. Define p*(x) as ha probabiliy vecor wih componens p*(j x) = P(Y=j X=x). Mos classificaion algorihms use he raining se T o consruc a probabiliy predicor p R (x,t) ha oupus a nonnegaive sumone Jvecor p R (x,t) = (p R (1 x),...,p R (J x)) and hen classify x as ha class for which p R( j x) is maximum. In many applicaions, he componens of p R as well as he classificaion is imporan. For insance, in medical survival analysis, esimaes of he survival probabiliy is imporan. In some consrucion mehods, he resubsiuion values p R (x) are inrinsically biased esimaes of p*(x). This is rue of mehods like rees or neural nes where he opimizaion over T ries o drive all componens of p R o zero excep for a single componen ha goes o one. The resuling vecors p R are poor esimaes of he rue class probabiliies p*. Wih rees, he p R esimaes are consan over each erminal node and are given by he proporion of class j examples in he erminal node. In Breiman e. al. [1984] wo mehods were proposed o improve esimaes. In his hesis, Walker[1992] showed ha he firs of he wo mehods worked reasonably well on some synheic daa. However, he mehod only esimaes maxjp*(j ), and he resuls are difficul o compare wih hose given below. To define he problem beerhere is he arge: assume again ha he raining se T consiss of independen draws from an Y,X disribuion. Assume ha a ree C(x,T) wih erminal nodes {} has already been consruced. For a given erminal node, define p*(j ) = P(Y=j X ). The vecor p*() is wha we wan o esimae. The resubsiuion probabiliy esimae p R (x, T) is consan over each erminal node and consiss of he relaive class proporions of he raining se examples in. The ouofbag esimae p B is goen as follows: draw 100 boosrap replicaes of T geing T1,B,...,T100,B. For each k, build he ree classifier C(x,Tk,B). For each (y,x) in T, define p B (x) as he average of he p R (x, Tk,B) over all k such ha (y,x) is no in Tk,B. Then for any erminal node, le p B () be he average of p B (x) over all x in.
3 3 2.1 Experimenal resuls We illusrae, by experimen, he improved accuracy of he ouofbag esimaes compared o he resubsiuion mehod using synheic and real daa. For any wo Jprobabiliies p and p' denoe p p' = p( j) p'( j) j p p' 2 = ( p( j) p'( j)) 2 j Le q*() = P(X ) be he probabiliy ha an example falls ino he erminal node. For any esimae {p()] of he {p*()} define wo error measures: E 1 = q* ( ) p*() p() E 2 = ( q*() p*() p() The difference beween he wo measures is ha large differences are weighed more heavily by E2. To simplify he inerpreaion we divide E1 by J and E2 by J. Then E1 measures he absolue average error in esimaing each componen of he probabiliy vecor, while E2 measures he corresponding rms average error. We use a es se o esimae q*() as he proporion q'() of he es se falling ino node and esimae p*() by he proporions of classes p'() in hose es se examples in. This les us esimae he wo error measures. Wih E2, i is possible o derive a correcion ha adjuss for he error in using p'() insead of p*(). The correcion is generally small if he es se is large and is derived in he Appendix. Synheic Daa We give resuls for four ses of synheic daa (see Breiman[1996b]) for specific definiions): Table 1 Synheic Daa Se Summary 2 ) 1 2 Daa Se Classes Inpus Training Tes waveform wonorm hreenorm ringnorm In all cases, here were 50 ieraions wih he raining and es ses generaed anew in each ieraion and 100 replicaions in he bagging. The resuls given are he averages over he 50 ieraions: Table 2 Node Probabiliy Errors Daa Se EB1 ER1 EB1/ER1 EB2 ER2 EB2/ER2 waveform, wonorm hreenorm ringnorm The raios of errors in he 3rd and 6h columns shows ha he ouofbag esimaes are giving significan error reducions.
4 4 Real Daa The daa ses we used in his experimen are available in he UCI reposiory. We used some of he larger daa ses o insure es ses large enough o give adequae esimaes of q* and p*. Table 3 Daa Se Summary Daa Se Classes Inpus Training Tes breascancer diabees vehicle saellie dna The daa ses lised in Table 3 consised examples whose number was he oal of he es and raining se numbers. So, for example, he breascancer daa se had 699 examples. The las wo daa ses lised came preseparaed ino es and raining ses. For insance, he saellie daa came as a 4435 example raining se and a 2000 example es se. These were pu ogeher o creae a single daa se wih 6435 examples. Noe ha he raining se sizes are 100 per class. There were 50 runs on each daa se. In each run, he daa se was randomly divided ino raining and es ses wih sizes as lised in Table 3, and 100 boosrap replicaes generaed wih each raining se. The resuls, averaged over he 50 runs, are given in Table 4. Table 4 Node Probabiliy Errors Daa Se EB1 ER1 EB1/ER1 EB2 ER2 EB2/ER2 breas cancer diabees vehicle saellie dna The resuls generally show a significan decrease in esimaion error when he ouofbag esimaes are used. 3. Esimaing node error in regression Assume here ha he raining se consiss of independen draws from he disribuion Y,X where Y is a numerical oupu, and X a mulivariae inpu. Some mehods for consrucing a predicor f(x,t) of y using he raining se also ry o consruc an esimae of he average error in he predicionfor insance by giving an esimae of he rms error in he predicion. When hese error esimaes are based on he raining se error, hey are ofen biased oward he low side. In rees, he prediced value f(x,t) is consan over each erminal node and is equal o he average y() of he raining se oupus over he node. The wihin node error esimae e R () for is compued as he rms error over all examples in he raining se falling ino. However, since he recursive spliing in CART is based on rying o minimize his error measure, i is clearly biased low as an esimae of he rue error rae e*() defined as:
5 5. e*()=(e((y y()) 2 X )) 1/2 The ouofbag esimaes are goen his way: draw 100 boosrap replicaes of T geing T1,B,...,T100,B. For each k, build he ree predicor f(x,tk,b). For each (y,x) in T, define s B (x) as he average of (y  f(x,tk,b)) 2 over all k such ha (y,x) is no in Tk,B. Then for any node define e B () as he square roo of he average over all x in of s B (x). 3.1 Experimenal resuls For any esimae e() of e*(), define wo error measures: E 1 = q*() e*() e() E 2 = ( q*() (e*() e()) 2 ) 1 2 To illusrae he improved accuracy of he ouofbag esimaes of e*(), five daa ses are usedhe same five ha were used in Breiman[1996a]. The firs hree of he daa ses are synheic daa, he las wo real. Table 5 Daa Se Summary Daa Se Inpus Training Tes Friedman # Friedman # Friedman # Ozone Boson There were 50 runs of he procedure on each daa se, and 100 boosrap baggings in each run. In he synheic daa ses, he raining and es se was freshly generaed for each run. Wih he real daa ses, for each run a differen random spli ino raining and es se was used. The values of q* and e* were esimaed using he es se. For E2 an adjusmen was used o correc for his approximaion (see Appendix). The resuls, averaged over he 50 runs, are given in Table 6. For inerpreabiliy, he error measures displayed have been divided by he sandard deviaion of he combined raining and es se. Table 4 Node Esimaion Errors Daa Se EB1 ER1 EB1/ER1 EB2 ER2 EB2/ER2 Friedman# Friedman # Freidman # Ozone Boson Again, here are significan reducions in esimaion error. 4. Error due o wihinnode variabiliy
6 6 Suppose ha we wan o esimae a funcion of he inpus h*(x). Only if we wan o say in he srucure of a single ree wih predicions consan over each erminal node, does i make sense o esimae h*(x) by some esimae of h*(). The arge funcion h*(x) may have considerable variabiliy over he region defined by a erminal node in a ree. Given a ree wih erminal nodes and esimaes h() of h*(), denoe he corresponding esimae of h by h(x,t). The squared error in esimaing h* given ha he inpus x are drawn from he disribuion of he random vecor X can be decomposed as: E X (h(x) h(x, T )) 2 = E X (h(x) h*( ) 2 X )P(X ) + (h*() h()) 2 P(X ) The firs erm in his decomposiion we call he error due o wihinnode variabiliy, he second is he node esimaion error. The relevan quesion is how large he wihinnode variabiliy error is compared o he node esimaion error. Obviously, his will be problem dependen, bu we give some evidence below ha i may be a major porion of he error. We look a he problem of esimaing he condiional probabiliies p*(x). The expression analogous o he above decomposiion is: E X p*(x) p(x,t) 2 = q*()e X ( p*(x) p*() 2 X ) + q*() p*() p() 2 (4.1) For he four synheic classificaion daa ses used in Secion 3, p*(x) can be evaluaed exacly. Therefore, replacing he expecaions over X by averages over a large es se (5000), he error E V due o wihinnode variabiliy (firs erm in (4.1) and he error E N due o node esimaion (second erm in (4.1))can be evaluaed. There are wo mehods of node esimaionhe sandard mehod leads o error E NR and he ouofbag mehod o error E NB. Anoher mehod of esimaing p* is by uilizing he sequence of bagged predicors. For each (y,x) in he es se, define p B (x) as he average of he p R (x, Tk,B) over all k. Then defining E B as: E B = E X p*(x) p B (X) 2, his quaniy is also evaluaed for he synheic daa by averaging over he es daa. The experimenal procedure consiss of 50 ieraions for each synheic daa se. In each ieraion, a 5000 examples es se and 100J example raining se is generaed, and he following raios evaluaed: R 1 = 100*E NR /(E NR +E V ), R 2 = 100*(E NB E NR )/(E NR +E V ), R 3 = 100*E NB /(E NB +E V ), R 4 = 100*E B /E V. Thus, R 1 is he percen of he oal error due o node esimaion when he resubsiuion mehod of esimaing p*() is used: R 2 is he percen of reducion in he oal error when he bagging esimae p B () is used. When p B () is used, R 3 is he percen of he oal error due o node esimaion. Finally, R 4 is he raio*100 of he error using he poinwise bagging esimae of p* o he error using esimaes consan over he erminal nodes bu using he opimal node esimae p*(). Table 5 gives he resuls.
7 7 Table 5 Error Raios(%) in Esimaing Class Probabiliies Daa Se R 1 R 2 R 3 R 4 waveform wonorm hreenorm ringnorm For hese synheic daa ses, he values for R 1 shows ha wihinnode variabiliy accouns for abou wohirds of he error. The second column ( R 2 ) shows ha use of he bagging esimae p B () eliminaes mos of he errors due o node esimaion, bu ha he reducion is relaively modes because of he srong conribuion of wihinnode variabiliy. The resuls for R 3 show ha when p B () is used, only abou 10% of he oal error is due o node esimaion, so ha we are close o he limi of wha can be accomplished using esimaes of p* consan over nodes. The final column gives he good news ha using he poinwise bagging esimaes p B (x) gives abou 50% reducion as compared o he bes possible node esimae. I is a bi disconcering o see how much accuracy is los by he averaging of esimaes over nodes. Smyh e.al.[1996] avoid his averaging by using a kernel densiy mehod o esimae variable wihinnode densiies. However, poinwise bagging esimaes may give comparable or beer resuls. Care mus be aken in generalizing from hese synheic daa ses as I suspec hey may have more wihinnode variabiliy han ypical real daa ses. 5. Why i workshe poinwise biasvariance decomposiion Suppose here is some underlying funcion h*(x) ha we wan o esimae using he raining se T and ha we have some mehod h(x,t) for esimaing h*(x). Then for x fixed, we can wrie, using ET o denoe expecaion over replicae raining ses of he same size drawn from he same disribuion E T (h*(x) h(x,t)) 2 =(h*(x) E T h(x,t)) 2 +E T (h(x,t) E T h(x,t)) 2. This is a poinwise in x version of he now familar biasvariance decomposiion. The ineresing hing ha i shows is ha a each poin x, ETh(x,T) has lower squared error han does h(x, T)i has zero variance bu he same bias. Tha is, averaging h(x,t) over replicae raining ses improves performance a each individual values of x. Bagging ries o ge an esimae of ETh(x,T) by averaging over he values of h(x,tk,b). Now ETh(x,T) is compued assuming x is held fixed and T is chosen in a way ha does no depend on x. Bu if x is in he raining se, hen he Tk,B ofen conain x, violaing he assumpion. A beer imiaion of ETh(x,T) would be o leave x ou of he raining se and do bagging on he deleed raining se. Bu his is exacly wha ouofbag esimaion does resuling in more accurae esimaes of h*(x) a every example in he raining se. When hese are averaged over any erminal node, more accurae esimaes h B () of h*()=e(h*(x) X ) resul. 6. Trees using ouofbag oupu esimaes. In regression, for y,x an example in he raining se, define he ouofbag esimae y B for he oupu y o be he average of f(x,tk,b) over all k such ha x is no in Tk,B. The ouofbag oupu esimaes will generally be less noisy han he original oupus. This suggess he
8 8 possibiliy of growing a ree using he y B as he oupus values for he raining se. We did his using he daa ses described in Secion 3, and followed he procedure in Breiman[1996]. Wih he real daa ses we randomly subdivided hem so ha 90% served as he raining se, and 10% as a es se. A ree was grown and pruned using he original raining se, and he 10% es se used o ge a meansquared error esimae. Then we did 100 boosrap ieraions and compued he y B. Finally a single ree was grown using he y B as oupus and is error measured using he 10% es se. The random subdivsion was repeaed 50 imes and he es se errors averaged. Wih he hree synheic daa ses, a raining se of 200 and a es se of 2000 were freshly generaed in each of he 50 runs. The resuls are given in Table 6. Table 6. Mean Square Tes Se Error Daa Se ErrorOriginal Oupus ErrorOB Oupus Friedman # Freidman #2* * x1000 Friedman #3** **/1000 Boson Ozone These decreases are no as dramaic as hose given by bagging. On he oher hand, hey involve predicion by a single ree, generally of abou he same size as hose grown on he original raining se. If he desire is o increase accuracy while reaining inerpreabiliy, hen using he ouofbag oupus does quie well. The sory in classificaion is ha using he ouofbag oupu esimaes gives very lile improvemen in accuracy and can acually resul in less accurae rees. The ouofbag oupu esimaes consis of he probabiliy vecors p B (x). CART was modified o accep probabiliy vecors as oupus in ree consrucion, and a procedure similar o ha used in regression was ried on a number of daa ses wih disappoining resuls. The problem is wofold. Firs, while he probabiliy vecor esimaes may be more accurae, he classificaion depends only on he locaion of he maximum componen. Second, for daa ses wih subsanial missclassificaion raes, he ouofbag esimaes may produce more disorion han he original class labels. 7. Ouofbag esimaes for bagged predicors. In his secion, we reinforce he work by Tibshirani [1996] and Wolper and Macready[1996], boh of whom proposed using ouofbag esimaes as an ingredien in esimaes of generalizaion error. Wolper and Macready worked on regression ype problems and proposed a number of mehods for esimaing he generalizaion error of bagged predicors. The mehod hey found ha gave bes performance is a special case of he mehod we propose. Tibshirani used ouofbag esimaes of variance o esimae generalizaion error for arbirary classifiers. We explore esimaes of generalizaion error for bagged predicors. For classificaion, our resuls are new. As Wolper and Macready poin ou in heir paper, crossvalidaing bagged predicors may lead o large compuing effors. The ouofbag esimaes are efficien in ha hey can be compued in he same run ha consrucs he bagged predicor wih lile addiional effor. Our experimens below also give evidence ha hese esimaes are close o opimal. Suppose again, ha we have a raining se T consising of examples wih an oupu variable y ha can be a mulidimensional vecor wih numerical or caegorical coordinaes, and corresponding inpu x. A mehod is used o consruc a predicor f(x,t), and a given loss funcion
9 9 L(y, f) measures he error in predicing y by f. Form boosrap raining ses Tk,B, predicors f(x, Tk,B) and aggregae hese predicors in an appropriae way o form he bagged predicor fb(x). For each y,x in he raining se, aggregae he predicors only over hose k for which Tk,B does no conaining y,x. Denoe hese ouofbag predicors by f OB Then he ouofbag esimae for he generalizaion error is he average of L(y, f OB (x)) over all examples in he raining se. Denoe by e TS he es se error esimae and by e OB he ouofbag error esimae. In all of he runs in Secions 2 and 3, we also accumulaed he average of e TS, e OB and e TS  e OB. We can also compue he expeced value of e TS  e OB under he assumpion ha e OB is compued using a es se of he same size as he raining se and independen of he acual es se used (see Appendix). We claim ha his expeced value is a lower bound for how well we could use he raining se o esimae he generalizaion error of he bagged predicor. Our reasoning is his: given ha he raining se is used o consruc he predicor, he mos accurae esimae for is error is a es se independen of he raining se. If we used a es se of he same size as he raining se, his is as well as can be done using his number of examples. Therefore, we can judge he efficiency of any generalizaion error esimae based on he raining se by comparing is accuracy o he esimae we would ge using a es se of he size of he raining se. Table 7 conains he resuls for he classificaion runs for boh he real and synheic daa. The las column is he raio of he experimenally observed e TS  e OB o he expeced value if he raining se were an independen es se. The closer his raio is o one, he closer o opimal e OB is. Table 8 gives he corresponding resuls for regression. Table 7 Esimaes of Generalisaion Error (% Missclassificaion) Daa Se Av e TS Av e OB Av e TS  e OB Raio waveform wonorm hreenorm ringnorm breascancer diabees vehicle saellie dna Table 8 Esimaes of Generalizaion Error (Mean Squared Error) Daa Se Av e TS Av e OB Av e TS  e OB Raio Friedman # Friedman #2 24.7* 23.6* * x1000 Friedman #3 32.8** 30.5** 6.7** 1.06 **/1000 Boson Ozone Tables 7 and 8 show ha he ouofbag esimaes are remarkably accurae. On he whole, he raio values are close o one, reflecing he accuracy of he ouofbag esimaes of he generalizaion error of he bagged predicors. In classificaion, he ouofbag esimaes
10 10 appear almos unbiased, i.e. he average of e OB is almos equal o he average of e TS. Bu he esimaes in regression may be sysemaically low. The wo values slighly less han one in Table 6 we aribue o random flucuaions. The denominaor in he raio column depends on a parameer which has o be esimaed from he daa. Error in his parameer esimae may drive he raio low )see Appendix for deails). References Breiman, L. [1996a] Bagging Predicors, Machine Learning 26, No. 2, Breiman, L. [1996b] Bias, Variance, and Arcing Classifiers, submied o Annals of Saisics, fp fp.sa.berkeley.edu pub/breiman/arcall.ps Breiman, L., Friedman, J., Olshen R., and Sone, C. [1984] Classificaion and Regression Trees, Wadsworh Smyh, P.,Gray, A. and Fayyad, U.[1996} Rerofiing Tree Classifiers Using Kernel Densiy Esimaion, Proceedings of he 1995 Conference on Machine Learning, San Francisco, CA: Morgan Kaufmann, 1995, pp Tibshirani, R.[1996] Bias, Variance, and Predicion Error for Classificaion Rules, Technical Repor, Saisics Deparmen, Universiy of Torono Walker, Michael G. (1992) Probabiliy Esimaion for ClassificaionTrees and Sequence Analysis. SanCS Ph.D. Disseraion. Deparmens of Compuer Science and Medicine, Sanford Universiy,Sanford, CA. Wolper, D.H. and Macready, W.G.[1996] An Efficien Mehod o Esimae Bagging's Generalizaion Error I. Adjusmen o E2 in classificaion Appendix Wih moderae sized es ses we can ge, a bes, only noisy esimaes of p*. Using hese esimaes o compue error raes may lead o biases in he resuls. However, a simple adjusmen is possible in he E2 error crierion. For {p()} probabiliy esimaes in he erminal nodes depending only on he examples in T, E2 is defined by E2 2 = q() p*() p() 2 (2.1) Le p'() be he class proporions of es se examples in node so ha p'() is an esimae of p*(). We assume ha he examples in S and T are independen. Le N be he number of es se examples falling ino erminal node. Condiional on N, p'(j ) imes N has a binomial disribuion B(p*(j ),N). Hence, p'(j ) has expecaion p*(j ) and variance p*(j )(1p*(j ) )/N. Wrie p' p 2 = p* p 2 + p' p* 2 +2(p* p,p' p*). Taking expecaions of boh sides wih respec o he examples in S holding N consan gives N E p' p 2 =N p* p 2 +1 p* 2 (A.1) Puing p=0 in (A.1) gives N E p' 2 =N p* 2 +1 p* 2 (A.2
11 11 Solving (A.1) and (A.2) for N p* p 2 gives Thus, we esimae he error measure E2 as: N p* p 2 =N E p' p 2 N N 1 (1 E p' 2 ) E2 2 = q'()[ p'() p() 2 (1 p' 2 ) (N() 1)] (A.3) where N() is he number of es se examples in node, q'() is N()/N, and we define he second erm in he brackes o be zero if N()=1. This erm in (A.3) is he adjusmen. In our examples, i had only a small effec on he resuls. II. Adjusmen o E2 in regression In regression, E2 is defined as he square roo of R= q*() (e*() e()) 2. Since e*() is unknown, we esimae i as he square roo of he average over all es se (y,x) falling in of (y y()) 2 and denoe his esimae by e'(). Le R' = q*() (e'() e()) 2. Then we wan o adjus R' so ha i is an unbiased esimae of R, i.e. so ha ER' = R, when he expecaion is aken over he es se examples. To simplify his compuaion, we assume ha: i) es se oupu values in are normally disribued wih rue mean y*(). ii) q*() y*()y() is small. Now, e'() 2 ' = (y n n y()) 2 / N() where he sum is over all es se (y,x) falling ino. By he Cenral Limi Theorem, e'() 2 = e*() 2 + Z/ N() where Z is approximaely normally disribued wih mean zero and variance equal o he variance of (Y y()) 2 condiional on X in. I follows ha Ee'() 2 = e*() 2, and o firs order in N(), Ee'() = e*()  EZ 2 /(8e*() 3 N()). Recall ha for a normally disribued random variable U wih variance σ 2,he variance of U 2 is 2σ 4. Using assumpion i) gives EZ 2 = 2(var(Y y())) 2.By assumpion ii) he variance of Y y() on can be approximaed by e*() 2. Thus, Ee'()=e*()[1.25/ N()] (A.4)
12 12 Wrie. (e'() e()) 2 =(e'() e*()) 2 +(e*() e()) 2 +2(e'() e*())(e*() e()). (A.4) Taking expecaion of (A.5) wih respec o he es se and using (A.4) gives E(e'() e()) 2 E(e*() e()) 2 +e*()e()/2n() (A.5) Approximaing e*()e() by e'() 2 gives he adjused measure: 2 E 2 = q'() [(e'() e()) 2.5e'() 2 / N()] Again, he adjusmen conribues a relaively small correcion in our runs. III. Lower bound for raining se accuracy. Suppose we have a classifier Q(x) wih rue generalizaion missclassificaion rae P*. Tha is, for he disribuion of he r.v. Y,X, e*= P(Y Q(X)). Two ses of daa T'= {(y'n,x'n), n=1,...,n'} and T= {(yn,xn), n=1,...,n} are independenly drawn from he underlying disribuion of Y,X and run hrough he classifier. The firs has has classificaion error rae e' and he second e. We evaluae g(n',n) =E e'e. In he conex of he experimens on ouofbag esimaion, he firs se of daa is he given es se. The second se is he raining se. The raining se is used boh o form he bagged classifier and he ouofbag esimae of he generalizaion error. Suppose we had an unouched es se of he same size as he raining se and used his new es se o esimae he generalizaion error. Cerainly, we would do beer han any way of using he raining se over again o do he same hing. Thus g(n',n) is a lower bound for he accuracy of generalizaion error esimaes using a raining se of N examples, when i is being compared o a es se using N' examples. Now, e is given by e= V n / N (A.6) n where V n is one if he nh case in T is missclssified and zero oherwise. By he Cenral Limi Theorem, e=e* + Z/ N, where Z is approximaely normal wih mean zero and variance P*(1 P*). Similarly, e'=e* + Z' / N' where Z' is approximaely normal mean zero also wih variance e*(1e*) and independen of Z. So e'e is normal wih variance s=e*(1e*)[(1/n)+(1/n')]. The expecaion E U of a mean zero normal variable U wih variance s is 2s/π and i was his las expression ha was used as a comparison in Secion 6, wih s esimaed using e' in place of e*. In regression, he predicor is a numericalvalued funcion f(x). The rue generalizaion error is e* = E(Yf(X)) 2. Expression (A.6) holds wih V n =(y n f (x n )) 2. Again, e=e*+ Z/ N, where Z is approximaely normal wih mean zero and variance c/ N wih c he variance of (Yf(X)) 2. Repeaing he argumen above, e' e is a normal variable wih mean zero and variance
13 s=c[(1/n)+(1/n') so E e'e equals 2s/π. The variance of (Yf(X)) 2 is given by E(Yf(X)) 4  (E(Yf(X)) 2 ) 2. This value is approximaed by he using he corresponding momens over he es se, leading o he evaluaion of he lower bound. 13
Economics 140A Hypothesis Testing in Regression Models
Economics 140A Hypohesis Tesing in Regression Models While i is algebraically simple o work wih a populaion model wih a single varying regressor, mos populaion models have muliple varying regressors 1
More informationChapter 4. Properties of the Least Squares Estimators. Assumptions of the Simple Linear Regression Model. SR3. var(e t ) = σ 2 = var(y t )
Chaper 4 Properies of he Leas Squares Esimaors Assumpions of he Simple Linear Regression Model SR1. SR. y = β 1 + β x + e E(e ) = 0 E[y ] = β 1 + β x SR3. var(e ) = σ = var(y ) SR4. cov(e i, e j ) = cov(y
More informationDuration and Convexity ( ) 20 = Bond B has a maturity of 5 years and also has a required rate of return of 10%. Its price is $613.
Graduae School of Business Adminisraion Universiy of Virginia UVAF38 Duraion and Convexiy he price of a bond is a funcion of he promised paymens and he marke required rae of reurn. Since he promised
More informationGraphing the Von Bertalanffy Growth Equation
file: d:\b1732013\von_beralanffy.wpd dae: Sepember 23, 2013 Inroducion Graphing he Von Beralanffy Growh Equaion Previously, we calculaed regressions of TL on SL for fish size daa and ploed he daa and
More informationSPEC model selection algorithm for ARCH models: an options pricing evaluation framework
Applied Financial Economics Leers, 2008, 4, 419 423 SEC model selecion algorihm for ARCH models: an opions pricing evaluaion framework Savros Degiannakis a, * and Evdokia Xekalaki a,b a Deparmen of Saisics,
More informationTerm Structure of Prices of Asian Options
Term Srucure of Prices of Asian Opions Jirô Akahori, Tsuomu Mikami, Kenji Yasuomi and Teruo Yokoa Dep. of Mahemaical Sciences, Risumeikan Universiy 111 Nojihigashi, Kusasu, Shiga 5258577, Japan Email:
More informationPart 1: White Noise and Moving Average Models
Chaper 3: Forecasing From Time Series Models Par 1: Whie Noise and Moving Average Models Saionariy In his chaper, we sudy models for saionary ime series. A ime series is saionary if is underlying saisical
More informationChapter 8: Regression with Lagged Explanatory Variables
Chaper 8: Regression wih Lagged Explanaory Variables Time series daa: Y for =1,..,T End goal: Regression model relaing a dependen variable o explanaory variables. Wih ime series new issues arise: 1. One
More informationJournal Of Business & Economics Research September 2005 Volume 3, Number 9
Opion Pricing And Mone Carlo Simulaions George M. Jabbour, (Email: jabbour@gwu.edu), George Washingon Universiy YiKang Liu, (yikang@gwu.edu), George Washingon Universiy ABSTRACT The advanage of Mone Carlo
More informationPROFIT TEST MODELLING IN LIFE ASSURANCE USING SPREADSHEETS PART ONE
Profi Tes Modelling in Life Assurance Using Spreadshees PROFIT TEST MODELLING IN LIFE ASSURANCE USING SPREADSHEETS PART ONE Erik Alm Peer Millingon 2004 Profi Tes Modelling in Life Assurance Using Spreadshees
More informationMorningstar Investor Return
Morningsar Invesor Reurn Morningsar Mehodology Paper Augus 31, 2010 2010 Morningsar, Inc. All righs reserved. The informaion in his documen is he propery of Morningsar, Inc. Reproducion or ranscripion
More informationUSE OF EDUCATION TECHNOLOGY IN ENGLISH CLASSES
USE OF EDUCATION TECHNOLOGY IN ENGLISH CLASSES Mehme Nuri GÖMLEKSİZ Absrac Using educaion echnology in classes helps eachers realize a beer and more effecive learning. In his sudy 150 English eachers were
More informationANALYSIS AND COMPARISONS OF SOME SOLUTION CONCEPTS FOR STOCHASTIC PROGRAMMING PROBLEMS
ANALYSIS AND COMPARISONS OF SOME SOLUTION CONCEPTS FOR STOCHASTIC PROGRAMMING PROBLEMS R. Caballero, E. Cerdá, M. M. Muñoz and L. Rey () Deparmen of Applied Economics (Mahemaics), Universiy of Málaga,
More informationThe Transport Equation
The Transpor Equaion Consider a fluid, flowing wih velociy, V, in a hin sraigh ube whose cross secion will be denoed by A. Suppose he fluid conains a conaminan whose concenraion a posiion a ime will be
More informationOn the degrees of irreducible factors of higher order Bernoulli polynomials
ACTA ARITHMETICA LXII.4 (1992 On he degrees of irreducible facors of higher order Bernoulli polynomials by Arnold Adelberg (Grinnell, Ia. 1. Inroducion. In his paper, we generalize he curren resuls on
More informationCointegration: The Engle and Granger approach
Coinegraion: The Engle and Granger approach Inroducion Generally one would find mos of he economic variables o be nonsaionary I(1) variables. Hence, any equilibrium heories ha involve hese variables require
More informationARCH 2013.1 Proceedings
Aricle from: ARCH 213.1 Proceedings Augus 14, 212 Ghislain Leveille, Emmanuel Hamel A renewal model for medical malpracice Ghislain Léveillé École d acuaria Universié Laval, Québec, Canada 47h ARC Conference
More informationPredicting Stock Market Index Trading Signals Using Neural Networks
Predicing Sock Marke Index Trading Using Neural Neworks C. D. Tilakarane, S. A. Morris, M. A. Mammadov, C. P. Hurs Cenre for Informaics and Applied Opimizaion School of Informaion Technology and Mahemaical
More informationIssues Using OLS with Time Series Data. Time series data NOT randomly sampled in same way as cross sectional each obs not i.i.d
These noes largely concern auocorrelaion Issues Using OLS wih Time Series Daa Recall main poins from Chaper 10: Time series daa NOT randomly sampled in same way as cross secional each obs no i.i.d Why?
More informationPremium Income of Indian Life Insurance Industry
Premium Income of Indian Life Insurance Indusry A Toal Facor Produciviy Approach Ram Praap Sinha* Subsequen o he passage of he Insurance Regulaory and Developmen Auhoriy (IRDA) Ac, 1999, he life insurance
More informationA Note on Using the Svensson procedure to estimate the risk free rate in corporate valuation
A Noe on Using he Svensson procedure o esimae he risk free rae in corporae valuaion By Sven Arnold, Alexander Lahmann and Bernhard Schwezler Ocober 2011 1. The risk free ineres rae in corporae valuaion
More informationcooking trajectory boiling water B (t) microwave 0 2 4 6 8 101214161820 time t (mins)
Alligaor egg wih calculus We have a large alligaor egg jus ou of he fridge (1 ) which we need o hea o 9. Now here are wo accepable mehods for heaing alligaor eggs, one is o immerse hem in boiling waer
More informationMarket Liquidity and the Impacts of the Computerized Trading System: Evidence from the Stock Exchange of Thailand
36 Invesmen Managemen and Financial Innovaions, 4/4 Marke Liquidiy and he Impacs of he Compuerized Trading Sysem: Evidence from he Sock Exchange of Thailand Sorasar Sukcharoensin 1, Pariyada Srisopisawa,
More informationThe Greek financial crisis: growing imbalances and sovereign spreads. Heather D. Gibson, Stephan G. Hall and George S. Tavlas
The Greek financial crisis: growing imbalances and sovereign spreads Heaher D. Gibson, Sephan G. Hall and George S. Tavlas The enry The enry of Greece ino he Eurozone in 2001 produced a dividend in he
More informationYTM is positively related to default risk. YTM is positively related to liquidity risk. YTM is negatively related to special tax treatment.
. Two quesions for oday. A. Why do bonds wih he same ime o mauriy have differen YTM s? B. Why do bonds wih differen imes o mauriy have differen YTM s? 2. To answer he firs quesion les look a he risk srucure
More informationHedging with Forwards and Futures
Hedging wih orwards and uures Hedging in mos cases is sraighforward. You plan o buy 10,000 barrels of oil in six monhs and you wish o eliminae he price risk. If you ake he buyside of a forward/fuures
More informationPerformance Center Overview. Performance Center Overview 1
Performance Cener Overview Performance Cener Overview 1 ODJFS Performance Cener ce Cener New Performance Cener Model Performance Cener Projec Meeings Performance Cener Execuive Meeings Performance Cener
More informationUnstructured Experiments
Chaper 2 Unsrucured Experimens 2. Compleely randomized designs If here is no reason o group he plos ino blocks hen we say ha Ω is unsrucured. Suppose ha reamen i is applied o plos, in oher words ha i is
More informationMeasuring macroeconomic volatility Applications to export revenue data, 19702005
FONDATION POUR LES ETUDES ET RERS LE DEVELOPPEMENT INTERNATIONAL Measuring macroeconomic volailiy Applicaions o expor revenue daa, 1970005 by Joël Cariolle Policy brief no. 47 March 01 The FERDI is a
More informationResearch Question Is the average body temperature of healthy adults 98.6 F? Introduction to Hypothesis Testing. Statistical Hypothesis
Inroducion o Hypohesis Tesing Research Quesion Is he average body emperaure of healhy aduls 98.6 F? HT  1 HT  2 Scienific Mehod 1. Sae research hypoheses or quesions. µ = 98.6? 2. Gaher daa or evidence
More informationUsefulness of the Forward Curve in Forecasting Oil Prices
Usefulness of he Forward Curve in Forecasing Oil Prices Akira Yanagisawa Leader Energy Demand, Supply and Forecas Analysis Group The Energy Daa and Modelling Cener Summary When people analyse oil prices,
More informationVector Autoregressions (VARs): Operational Perspectives
Vecor Auoregressions (VARs): Operaional Perspecives Primary Source: Sock, James H., and Mark W. Wason, Vecor Auoregressions, Journal of Economic Perspecives, Vol. 15 No. 4 (Fall 2001), 101115. Macroeconomericians
More informationTEMPORAL PATTERN IDENTIFICATION OF TIME SERIES DATA USING PATTERN WAVELETS AND GENETIC ALGORITHMS
TEMPORAL PATTERN IDENTIFICATION OF TIME SERIES DATA USING PATTERN WAVELETS AND GENETIC ALGORITHMS RICHARD J. POVINELLI AND XIN FENG Deparmen of Elecrical and Compuer Engineering Marquee Universiy, P.O.
More informationThe option pricing framework
Chaper 2 The opion pricing framework The opion markes based on swap raes or he LIBOR have become he larges fixed income markes, and caps (floors) and swapions are he mos imporan derivaives wihin hese markes.
More informationMultiple Structural Breaks in the Nominal Interest Rate and Inflation in Canada and the United States
Deparmen of Economics Discussion Paper 0007 Muliple Srucural Breaks in he Nominal Ineres Rae and Inflaion in Canada and he Unied Saes Frank J. Akins, Universiy of Calgary Preliminary Draf February, 00
More informationRealtime Particle Filters
Realime Paricle Filers Cody Kwok Dieer Fox Marina Meilă Dep. of Compuer Science & Engineering, Dep. of Saisics Universiy of Washingon Seale, WA 9895 ckwok,fox @cs.washingon.edu, mmp@sa.washingon.edu Absrac
More informationA Probability Density Function for Google s stocks
A Probabiliy Densiy Funcion for Google s socks V.Dorobanu Physics Deparmen, Poliehnica Universiy of Timisoara, Romania Absrac. I is an approach o inroduce he Fokker Planck equaion as an ineresing naural
More informationDIFFERENTIAL EQUATIONS with TI89 ABDUL HASSEN and JAY SCHIFFMAN. A. Direction Fields and Graphs of Differential Equations
DIFFERENTIAL EQUATIONS wih TI89 ABDUL HASSEN and JAY SCHIFFMAN We will assume ha he reader is familiar wih he calculaor s keyboard and he basic operaions. In paricular we have assumed ha he reader knows
More informationRandom Walk in 1D. 3 possible paths x vs n. 5 For our random walk, we assume the probabilities p,q do not depend on time (n)  stationary
Random Walk in D Random walks appear in many cones: diffusion is a random walk process undersanding buffering, waiing imes, queuing more generally he heory of sochasic processes gambling choosing he bes
More informationInformation Theoretic Evaluation of Change Prediction Models for LargeScale Software
Informaion Theoreic Evaluaion of Change Predicion Models for LargeScale Sofware Mina Askari School of Compuer Science Universiy of Waerloo Waerloo, Canada maskari@uwaerloo.ca Ric Hol School of Compuer
More informationWhy Did the Demand for Cash Decrease Recently in Korea?
Why Did he Demand for Cash Decrease Recenly in Korea? Byoung Hark Yoo Bank of Korea 26. 5 Absrac We explores why cash demand have decreased recenly in Korea. The raio of cash o consumpion fell o 4.7% in
More informationPrice elasticity of demand for crude oil: estimates for 23 countries
Price elasiciy of demand for crude oil: esimaes for 23 counries John C.B. Cooper Absrac This paper uses a muliple regression model derived from an adapaion of Nerlove s parial adjusmen model o esimae boh
More informationA Reexamination of the Joint Mortality Functions
Norh merican cuarial Journal Volume 6, Number 1, p.166170 (2002) Reeaminaion of he Join Morali Funcions bsrac. Heekung Youn, rkad Shemakin, Edwin Herman Universi of S. Thomas, Sain Paul, MN, US Morali
More informationOption PutCall Parity Relations When the Underlying Security Pays Dividends
Inernaional Journal of Business and conomics, 26, Vol. 5, No. 3, 22523 Opion Puall Pariy Relaions When he Underlying Securiy Pays Dividends Weiyu Guo Deparmen of Finance, Universiy of Nebraska Omaha,
More informationForecasting Sales: A Model and Some Evidence from the Retail Industry. Russell Lundholm Sarah McVay Taylor Randall
Forecasing Sales: A odel and Some Evidence from he eail Indusry ussell Lundholm Sarah cvay aylor andall Why forecas financial saemens? Seems obvious, bu wo common criicisms: Who cares, can we can look
More informationHow to calculate effect sizes from published research: A simplified methodology
WORKLEARNING RESEARCH How o alulae effe sizes from published researh: A simplified mehodology Will Thalheimer Samanha Cook A Publiaion Copyrigh 2002 by Will Thalheimer All righs are reserved wih one exepion.
More informationOptimal Stock Selling/Buying Strategy with reference to the Ultimate Average
Opimal Sock Selling/Buying Sraegy wih reference o he Ulimae Average Min Dai Dep of Mah, Naional Universiy of Singapore, Singapore Yifei Zhong Dep of Mah, Naional Universiy of Singapore, Singapore July
More informationA Brief Introduction to the Consumption Based Asset Pricing Model (CCAPM)
A Brief Inroducion o he Consumpion Based Asse Pricing Model (CCAPM We have seen ha CAPM idenifies he risk of any securiy as he covariance beween he securiy's rae of reurn and he rae of reurn on he marke
More informationFourier Series Solution of the Heat Equation
Fourier Series Soluion of he Hea Equaion Physical Applicaion; he Hea Equaion In he early nineeenh cenury Joseph Fourier, a French scienis and mahemaician who had accompanied Napoleon on his Egypian campaign,
More informationINVESTIGATION OF THE INFLUENCE OF UNEMPLOYMENT ON ECONOMIC INDICATORS
INVESTIGATION OF THE INFLUENCE OF UNEMPLOYMENT ON ECONOMIC INDICATORS Ilona Tregub, Olga Filina, Irina Kondakova Financial Universiy under he Governmen of he Russian Federaion 1. Phillips curve In economics,
More informationIndividual Health Insurance April 30, 2008 Pages 167170
Individual Healh Insurance April 30, 2008 Pages 167170 We have received feedback ha his secion of he e is confusing because some of he defined noaion is inconsisen wih comparable life insurance reserve
More informationWorking Paper No. 482. Net Intergenerational Transfers from an Increase in Social Security Benefits
Working Paper No. 482 Ne Inergeneraional Transfers from an Increase in Social Securiy Benefis By Li Gan Texas A&M and NBER Guan Gong Shanghai Universiy of Finance and Economics Michael Hurd RAND Corporaion
More informationAP Calculus AB 2013 Scoring Guidelines
AP Calculus AB 1 Scoring Guidelines The College Board The College Board is a missiondriven noforprofi organizaion ha connecs sudens o college success and opporuniy. Founded in 19, he College Board was
More information11/6/2013. Chapter 14: Dynamic ADAS. Introduction. Introduction. Keeping track of time. The model s elements
Inroducion Chaper 14: Dynamic DS dynamic model of aggregae and aggregae supply gives us more insigh ino how he economy works in he shor run. I is a simplified version of a DSGE model, used in cuingedge
More informationMACROECONOMIC FORECASTS AT THE MOF A LOOK INTO THE REAR VIEW MIRROR
MACROECONOMIC FORECASTS AT THE MOF A LOOK INTO THE REAR VIEW MIRROR The firs experimenal publicaion, which summarised pas and expeced fuure developmen of basic economic indicaors, was published by he Minisry
More information17 Laplace transform. Solving linear ODE with piecewise continuous right hand sides
7 Laplace ransform. Solving linear ODE wih piecewise coninuous righ hand sides In his lecure I will show how o apply he Laplace ransform o he ODE Ly = f wih piecewise coninuous f. Definiion. A funcion
More informationBALANCE OF PAYMENTS. First quarter 2008. Balance of payments
BALANCE OF PAYMENTS DATE: 20080530 PUBLISHER: Balance of Paymens and Financial Markes (BFM) Lena Finn + 46 8 506 944 09, lena.finn@scb.se Camilla Bergeling +46 8 506 942 06, camilla.bergeling@scb.se
More informationAP Calculus AB 2010 Scoring Guidelines
AP Calculus AB 1 Scoring Guidelines The College Board The College Board is a noforprofi membership associaion whose mission is o connec sudens o college success and opporuniy. Founded in 1, he College
More informationEntropy: From the Boltzmann equation to the Maxwell Boltzmann distribution
Enropy: From he Bolzmann equaion o he Maxwell Bolzmann disribuion A formula o relae enropy o probabiliy Ofen i is a lo more useful o hink abou enropy in erms of he probabiliy wih which differen saes are
More informationSegment and combine approach for nonparametric timeseries classification
Segmen and combine approach for nonparameric imeseries classificaion Pierre Geurs and Louis Wehenkel Universiy of Liège, Deparmen of Elecrical Engineering and Compuer Science, SarTilman B28, B4000 Liège,
More informationWhy Do Real and Nominal. InventorySales Ratios Have Different Trends?
Why Do Real and Nominal InvenorySales Raios Have Differen Trends? By Valerie A. Ramey Professor of Economics Deparmen of Economics Universiy of California, San Diego and Research Associae Naional Bureau
More informationMTH6121 Introduction to Mathematical Finance Lesson 5
26 MTH6121 Inroducion o Mahemaical Finance Lesson 5 Conens 2.3 Brownian moion wih drif........................... 27 2.4 Geomeric Brownian moion........................... 28 2.5 Convergence of random
More informationDistributing Human Resources among Software Development Projects 1
Disribuing Human Resources among Sofware Developmen Proecs Macario Polo, María Dolores Maeos, Mario Piaini and rancisco Ruiz Summary This paper presens a mehod for esimaing he disribuion of human resources
More informationON THURSTONE'S MODEL FOR PAIRED COMPARISONS AND RANKING DATA
ON THUSTONE'S MODEL FO PAIED COMPAISONS AND ANKING DATA Alber MaydeuOlivares Dep. of Psychology. Universiy of Barcelona. Paseo Valle de Hebrón, 171. 08035 Barcelona (Spain). Summary. We invesigae by means
More informationStock Trading with Recurrent Reinforcement Learning (RRL) CS229 Application Project Gabriel Molina, SUID 5055783
Sock raing wih Recurren Reinforcemen Learning (RRL) CS9 Applicaion Projec Gabriel Molina, SUID 555783 I. INRODUCION One relaively new approach o financial raing is o use machine learning algorihms o preic
More informationForecasting, Ordering and Stock Holding for Erratic Demand
ISF 2002 23 rd o 26 h June 2002 Forecasing, Ordering and Sock Holding for Erraic Demand Andrew Eaves Lancaser Universiy / Andalus Soluions Limied Inroducion Erraic and slowmoving demand Demand classificaion
More informationMortality Variance of the Present Value (PV) of Future Annuity Payments
Morali Variance of he Presen Value (PV) of Fuure Annui Pamens Frank Y. Kang, Ph.D. Research Anals a Frank Russell Compan Absrac The variance of he presen value of fuure annui pamens plas an imporan role
More informationChabot College Physics Lab RC Circuits Scott Hildreth
Chabo College Physics Lab Circuis Sco Hildreh Goals: Coninue o advance your undersanding of circuis, measuring resisances, currens, and volages across muliple componens. Exend your skills in making breadboard
More informationThe Real Business Cycle paradigm. The RBC model emphasizes supply (technology) disturbances as the main source of
Prof. Harris Dellas Advanced Macroeconomics Winer 2001/01 The Real Business Cycle paradigm The RBC model emphasizes supply (echnology) disurbances as he main source of macroeconomic flucuaions in a world
More informationCHARGE AND DISCHARGE OF A CAPACITOR
REFERENCES RC Circuis: Elecrical Insrumens: Mos Inroducory Physics exs (e.g. A. Halliday and Resnick, Physics ; M. Sernheim and J. Kane, General Physics.) This Laboraory Manual: Commonly Used Insrumens:
More informationFinance and Economics Discussion Series Divisions of Research & Statistics and Monetary Affairs Federal Reserve Board, Washington, D.C.
Finance and Economics Discussion Series Divisions of Research & Saisics and Moneary Affairs Federal Reserve Board, Washingon, D.C. The Effecs of Unemploymen Benefis on Unemploymen and Labor Force Paricipaion:
More informationAppendix D Flexibility Factor/Margin of Choice Desktop Research
Appendix D Flexibiliy Facor/Margin of Choice Deskop Research Cheshire Eas Council Cheshire Eas Employmen Land Review Conens D1 Flexibiliy Facor/Margin of Choice Deskop Research 2 Final Ocober 2012 \\GLOBAL.ARUP.COM\EUROPE\MANCHESTER\JOBS\200000\22348900\4
More informationEmergence of FokkerPlanck Dynamics within a Closed Finite Spin System
Emergence of FokkerPlanck Dynamics wihin a Closed Finie Spin Sysem H. Niemeyer(*), D. Schmidke(*), J. Gemmer(*), K. Michielsen(**), H. de Raed(**) (*)Universiy of Osnabrück, (**) Supercompuing Cener Juelich
More informationBayesian model comparison with unnormalised likelihoods
Saisics and Compuing manuscrip No. (will be insered by he edior) Bayesian model comparison wih unnormalised likelihoods Richard G. Everi Adam M. Johansen Ellen Rowing Melina EvdemonHogan Each of hese
More informationAn empirical analysis about forecasting Tmall airconditioning sales using time series model Yan Xia
An empirical analysis abou forecasing Tmall aircondiioning sales using ime series model Yan Xia Deparmen of Mahemaics, Ocean Universiy of China, China Absrac Time series model is a hospo in he research
More informationDoes Option Trading Have a Pervasive Impact on Underlying Stock Prices? *
Does Opion Trading Have a Pervasive Impac on Underlying Sock Prices? * Neil D. Pearson Universiy of Illinois a UrbanaChampaign Allen M. Poeshman Universiy of Illinois a UrbanaChampaign Joshua Whie Universiy
More informationThe naive method discussed in Lecture 1 uses the most recent observations to forecast future values. That is, Y ˆ t + 1
Business Condiions & Forecasing Exponenial Smoohing LECTURE 2 MOVING AVERAGES AND EXPONENTIAL SMOOTHING OVERVIEW This lecure inroduces imeseries smoohing forecasing mehods. Various models are discussed,
More informationMaking Use of Gate Charge Information in MOSFET and IGBT Data Sheets
Making Use of ae Charge Informaion in MOSFET and IBT Daa Shees Ralph McArhur Senior Applicaions Engineer Advanced Power Technology 405 S.W. Columbia Sree Bend, Oregon 97702 Power MOSFETs and IBTs have
More informationInformation technology and economic growth in Canada and the U.S.
Canada U.S. Economic Growh Informaion echnology and economic growh in Canada and he U.S. Informaion and communicaion echnology was he larges conribuor o growh wihin capial services for boh Canada and he
More informationMaking a Faster Cryptanalytic TimeMemory TradeOff
Making a Faser Crypanalyic TimeMemory TradeOff Philippe Oechslin Laboraoire de Securié e de Crypographie (LASEC) Ecole Polyechnique Fédérale de Lausanne Faculé I&C, 1015 Lausanne, Swizerland philippe.oechslin@epfl.ch
More informationSetting Accuracy Targets for. ShortTerm Judgemental Sales Forecasting
Seing Accuracy Targes for ShorTerm Judgemenal Sales Forecasing Derek W. Bunn London Business School Sussex Place, Regen s Park London NW1 4SA, UK Tel: +44 (0)171 262 5050 Fax: +44(0)171 724 7875 Email:
More information2.5 Life tables, force of mortality and standard life insurance products
Soluions 5 BS4a Acuarial Science Oford MT 212 33 2.5 Life ables, force of moraliy and sandard life insurance producs 1. (i) n m q represens he probabiliy of deah of a life currenly aged beween ages + n
More information3 RungeKutta Methods
3 RungeKua Mehods In conras o he mulisep mehods of he previous secion, RungeKua mehods are singlesep mehods however, muliple sages per sep. They are moivaed by he dependence of he Taylor mehods on he
More information11. Tire pressure. Here we always work with relative pressure. That s what everybody always does.
11. Tire pressure. The graph You have a hole in your ire. You pump i up o P=400 kilopascals (kpa) and over he nex few hours i goes down ill he ire is quie fla. Draw wha you hink he graph of ire pressure
More informationDefault Risk in Equity Returns
Defaul Risk in Equiy Reurns MRI VSSLOU and YUHNG XING * BSTRCT This is he firs sudy ha uses Meron s (1974) opion pricing model o compue defaul measures for individual firms and assess he effec of defaul
More informationINTEREST RATE FUTURES AND THEIR OPTIONS: SOME PRICING APPROACHES
INTEREST RATE FUTURES AND THEIR OPTIONS: SOME PRICING APPROACHES OPENGAMMA QUANTITATIVE RESEARCH Absrac. Exchangeraded ineres rae fuures and heir opions are described. The fuure opions include hose paying
More informationMathematics in Pharmacokinetics What and Why (A second attempt to make it clearer)
Mahemaics in Pharmacokineics Wha and Why (A second aemp o make i clearer) We have used equaions for concenraion () as a funcion of ime (). We will coninue o use hese equaions since he plasma concenraions
More informationA New Schedule Estimation Technique for Construction Projects
A New Schedule Esimaion Technique for Consrucion Projecs Roger D. H. Warburon Deparmen of Adminisraive Sciences, Meropolian College Boson, MA 02215 hp://people.bu.edu/rwarb DOI 10.5592/omcj.2014.3.1 Research
More informationAnalysis of trends in technical and allocative efficiency: An application to Texas public school districts
European Journal of Operaional Research 154 (2004) 477 491 www.elsevier.com/locae/dsw Analysis of rends in echnical and allocaive efficiency: An applicaion o Texas public school disrics Rajiv D. Baner,
More information4.8 Exponential Growth and Decay; Newton s Law; Logistic Growth and Decay
324 CHAPTER 4 Exponenial and Logarihmic Funcions 4.8 Exponenial Growh and Decay; Newon s Law; Logisic Growh and Decay OBJECTIVES 1 Find Equaions of Populaions Tha Obey he Law of Uninhibied Growh 2 Find
More informationCOMPUTATION OF CENTILES AND ZSCORES FOR HEIGHTFORAGE, WEIGHTFORAGE AND BMIFORAGE
COMPUTATION OF CENTILES AND ZSCORES FOR HEIGHTFORAGE, WEIGHTFORAGE AND BMIFORAGE The mehod used o consruc he 2007 WHO references relied on GAMLSS wih he BoxCox power exponenial disribuion (Rigby
More informationA Robust Exponentially Weighted Moving Average Control Chart for the Process Mean
Journal of Modern Applied Saisical Mehods Volume 5 Issue Aricle 005 A Robus Exponenially Weighed Moving Average Conrol Char for he Process Mean Michael B. C. Khoo Universii Sains, Malaysia, mkbc@usm.my
More informationAs widely accepted performance measures in supply chain management practice, frequencybased service
MANUFACTURING & SERVICE OPERATIONS MANAGEMENT Vol. 6, No., Winer 2004, pp. 53 72 issn 523464 eissn 5265498 04 060 0053 informs doi 0.287/msom.030.0029 2004 INFORMS On Measuring Supplier Performance Under
More informationSmall and Large Trades Around Earnings Announcements: Does Trading Behavior Explain PostEarningsAnnouncement Drift?
Small and Large Trades Around Earnings Announcemens: Does Trading Behavior Explain PosEarningsAnnouncemen Drif? Devin Shanhikumar * Firs Draf: Ocober, 2002 This Version: Augus 19, 2004 Absrac This paper
More informationA Conceptual Framework for Commercial Property Price Indexes
GraninAid for Scienific Research(S) Real Esae Markes, Financial Crisis, and Economic Growh : An Inegraed Economic Approach Working Paper Series No.4 A Concepual Framework for Commercial Propery Price
More informationCLASSICAL TIME SERIES DECOMPOSITION
Time Series Lecure Noes, MSc in Operaional Research Lecure CLASSICAL TIME SERIES DECOMPOSITION Inroducion We menioned in lecure ha afer we calculaed he rend, everyhing else ha remained (according o ha
More informationMath 201 Lecture 12: CauchyEuler Equations
Mah 20 Lecure 2: CauchyEuler Equaions Feb., 202 Many examples here are aken from he exbook. The firs number in () refers o he problem number in he UA Cusom ediion, he second number in () refers o he problem
More information2.6 Limits at Infinity, Horizontal Asymptotes Math 1271, TA: Amy DeCelles. 1. Overview. 2. Examples. Outline: 1. Definition of limits at infinity
.6 Limis a Infiniy, Horizonal Asympoes Mah 7, TA: Amy DeCelles. Overview Ouline:. Definiion of is a infiniy. Definiion of horizonal asympoe 3. Theorem abou raional powers of. Infinie is a infiniy This
More informationINTRODUCTION TO FORECASTING
INTRODUCTION TO FORECASTING INTRODUCTION: Wha is a forecas? Why do managers need o forecas? A forecas is an esimae of uncerain fuure evens (lierally, o "cas forward" by exrapolaing from pas and curren
More informationPATHWISE PROPERTIES AND PERFORMANCE BOUNDS FOR A PERISHABLE INVENTORY SYSTEM
PATHWISE PROPERTIES AND PERFORMANCE BOUNDS FOR A PERISHABLE INVENTORY SYSTEM WILLIAM L. COOPER Deparmen of Mechanical Engineering, Universiy of Minnesoa, 111 Church Sree S.E., Minneapolis, MN 55455 billcoop@me.umn.edu
More information