Multivariate time series analysis: Some essential notions
|
|
- Josephine Black
- 8 years ago
- Views:
Transcription
1 Capter 2 Multivariate time series analysis: Some essential notions An overview of a modeling and learning framework for multivariate time series was presented in Capter 1. In tis capter, some notions on multivariate time series analysis in time and frequency domains are succinctly introduced; tools and conventions used erein are essential to appreciate te contributions later in te tesis. Altoug tey are widely available in textbooks, tey ave been adapted appropriately to suit tis tesis. In Section 2.1, a multivariate time series model and te concept of weak stationarity are formally defined; only tose time series tat are weakly stationary are considered trougout tis tesis. Weak stationarity requires defining te autocovariance function of a time series. Autocovariance caracteristics of a few relevant types of stationary multivariate time series are presented. In Section 2.2, frequency or spectral domain concepts belonging to Fourier analysis are introduced. Te motion of a simple pendulum is used as an example to motivate te presentation of Fourier series; tisissubsequentlyextendedtotefourier transform. Clearly,tisexampletointroduceFourieranalysisisadetour to a continuous time process; butitwillenanceunderstandingofspectraldomaintools,notations, and definitions. In Section 2.3, te discrete time process is introduced as a limiting case of continuous time processes; tis leads to discrete time Fourier transform. Discretetime Fourier transform gives a periodic and continuous spectrum and it underpins important developments in subsequent sections. Tere, discrete Fourier transform of a discrete time process is also discussed. In Section 2.4, after aving defined time and spectral domain caracteristics of adeterministicprocess,spectralanalysisofstationarytime series is presented. Te two most important ideas tat need to be taken from tis capter are presented next: First, te relation between autocovariance function and spectral density function is simply tat of a Fourier transform. Second, te probability distribution of discrete Fourier transform components of a linear process is complex-gaussian witin small subbands of frequencies. Te first idea is a direct application of Fourier analysis derived in earlier sections. For te second idea, te asymptotic teory of spectral 25
2 estimates is involved. In Section 2.5, terefore, te asymptotic probability distribution function of discrete Fourier transform components is provided witout proof. 2.1 Temporal analysis of stationary processes In tis section, an introductory review of te time-domain or temporalanalysisof time series is performed. It starts by adapting some definitions from te literature of random processes [29, 68, 86, 47]; te presented definitions migt be termed differently by various autors elsewere in te literature. An infinite sequence of random variables forms a random process. Ten, a vector random process is defined as an infinite sequence of vector random variables tat is a set of random variables maintaining te same order of te vector components in every realization. Definition 2.1. A(multivariate) time series of a (vector) random process is a connected subsequence formed by its constituent (vector) random variables. Atimeseriesiscalledsobecauseteindexoftesequenceisoften attributed to time instants. If y t is te random variable at time instant t Z of a random process of interest, ten {y t }, t =1,...,τ sall be called a τ-lengt realization of a time series wose t-t sample is y t.anr-dimensional vector random process generates an infinite sequence {y t } of r-dimensional vector random variables y t =[y 1t y rt ],werey it, i =1,...,r are te component random variables at time instant t Z. Figure 2.1 selects a realization of a τ-lengt r-variate time series wose t-t sample is te vector y t R r. It may now be implied tat wen referring to te term process incapter1ina broad sense, it meant te vector random process underlying a multivariate time series. On similar lines, te term model tere referred to te joint probabilitydistribution function of te samples of te time series; tis is because it is a set of random variables tat is dealt wit. Ten, te model of a process corresponding to a τ-lengt r- variate time series requires evaluating te τ r-dimensional joint probability distribution function P(y 1 c 1,..., y τ c τ ) for any constant vector c t R r, t = 1,...,τ, were P denotes probability and te comparison of vectors are component-wise. Of course, direct evaluation of suc a probability distribution is very unwieldy. Terefore, restricting te scope of te studies and bringing fort assumptions to simplify te process is inevitable for modeling a process generating a multivariate time series. Let a few useful terms associated wit random variables be first defined [95]. Definition 2.2. Te probability density function p u of a random variable u is defined as p u (a) = d dap(u a) a R, werevertederivativeexists. In te above definition, p u (a) is any positive finite real number werever te derivative does not exist. Ten te joint probability density function p u 1,...,u r of r random variables u 1,...,u r may be given by p u 1,...,u r (a 1,...,a r )= r P(u 1 a 1,...,u r a r ) / a 1 a r a =[a 1 a r ] R r and p u 1,...,u r (a 1,...,a r ) is any positive finite real number werever te derivative does not exist. 26
3 2 y 2 {y t }, t =1,...,τ realization of 1st random process realization of 2nd random process realization of rt random process 0 1 t τ τ +1 Figure 2.1: Te second sample y 2 of a realization of a τ-lengt r-variate time series {y t } is igligted. Definition 2.3. Te multivariate probability density function p u of an r- dimensional vector random variable u = [u 1 u r ] is defined as te joint probability density function of its r component random variables, i.e., p u (a) = p u 1,...,u r (a 1,...,a r ) a =[a 1 a r ] R r. Definition 2.4. For an r-dimensional vector random variable u wose probability density function p u (b) exists b R r,teexpectation of a function g(u) wit respect to p u is defined as E u [g(u)] = g(b) pu (b) db. Definition 2.5. Te mean µ u R r of an r-dimensional vector random variable u is defined as its expectation wit respect to its r-variate probability density function, i.e., µ u = E u [u]. 27
4 Definition 2.6. Te variance (covariance matrix) Γ u of te (r- dimensional vector) random variable u is defined as te expectation, wit respect to its (multivariate) probability density function p u,ofte(outer)productofte(vector) random variable wit itself about its mean µ u,i.e.,γ u = E u [(u µ u )(u µ u ) ]. Definition 2.7. Te cross-covariance Γ u,v between te (vector) random variables u and v is defined as te expectation, wit respect to teir joint (multivariate) probability density function p u,v,ofte(outer)productofterandomvariables about teir respective means µ u and µ v,i.e.,γ u,v = E u,v [(u µ u )(v µ v ) ]. Definition 2.8. Te cross-covariance between any two constituent (vector) random variables of te same (vector) random process is called te autocovariance function between te (vector) random variables. Terefore, te autocovariance function (acvf) betweenter- dimensionalvectorrandom variables y t and y s t, s Z is (2.1) Γ yt,ys = E yt,ys [(y t µ yt )(y s µ ys ) ]. Note 2.1. Wen it specifically concerns a univariate time series {y t } and not a multivariate time series, its acvf will be denoted by γ yt,ys.ten,foramultivariate time series {y t } = {[y 1t y 2t y rt ] },te(i, j)-t element of its acvf Γ yt,ys may be written as γ y i t,y js,wicaccordingtodefinition2.7,maybeinterpretedaste cross-covariance between y it and y js i, j 1,...,r and t, s Z. Definition 2.9. A(vector)timeseries{y t } t Z is weakly stationary if te mean µ yt is a constant (vector) µ y and its acvf Γ yt,ys between te (vector) random variables y t and y s s Z depends on s and t only troug s t. Te variable = s t of te acvf Γ yt,ys will be referred to as te lag. Itfollowsfrom Definition 2.9 tat te acvf between y t+ and y t of a weakly stationary time series {y t } is (2.2) Γ y Γy t+,y t = E y t+,y t [(y t+ µ y )(y t µ y ) ] Z. It is easy to verify tat γ y i,y j acvf : = γ y j,y i,wicgivesrisetotefollowingpropertyofte Property 2.1. Aweaklystationaryacvfistransposesymmetricabout =0,i.e., (2.3) (Γ y ) =Γ y. In tis tesis, te focus is on time series tat are weakly stationary and te main references on tat topic are [102, 99, 111, 19, 20]. Now, take alookatafewexamples of weakly stationary multivariate time series. 28
5 Property 2.2. Aweaklystationaryr-variate time series {z t } is idiosyncratic if any two components z it and z jt+ Z, i j of its corresponding vector random variable z t = [z 1t z rt ] t Z ave zero cross-covariance, i.e., γ z i t,z jt+ γ z i,z j R is zero wenever i j i, j 1,...,r and Z. Note 2.2. Te diagonal elements of an acvf Γ u of te vector random variable u t =[u 1t u 2t u rt ] will be written simply as γ u i γu i,u i i 1,...,r. Te acvf of an r-variate idiosyncratic time series {z t } due to vector random variable γ z 1 γ z 2,z 1 =0 γ z 1,z 2 =0 γ z 1,z r =0 γ z 2 γ z 2,z r =0 γ z r γ z r,z 1 =0 γ z r,z 2 =0 Figure 2.2: Te structure of te r r acvf matrix Γ z of an r-variate idiosyncratic time series {z t } sows zeros off-diagonal due to no cross-correlation betweenitscomponents. Te plots are ypotetical and interpolated for, an oterwisediscrete, forclarity. z t =[z 1t... z rt ] as an r r matrix structure sown in Figure 2.2. Following Note 2.2, te cross-covariance γ z i,z j of Property 2.2 may be written as te acvf γ z i of z i wenever i = j, wereasγ z i,z j =0is zero oterwise. Tis means tat te off-diagonal elements of suc an acvf are always zero. Let a special case of an idiosyncratic time series wose eac diagonal element of te acvf is an impulse function be now defined. Definition For a weakly stationary (vector) time series {x t },if(tecomponents of) x t are independently and identically distributed t Z, ten{x t } is said to be (multivariate) wite noise. Note tat te acvf Γ x of a q-variate wite noise {x t} is Γ x = 0 q 0 and det(γ x 0 ) 0. Definition 2.10 implies tat mean-subtracted wite noise components may be defined completely by teir component variances σi 2 = σi 2 i = 1,...,q so tat Γ x = diag(σ2 1,...,σ2 q ) Z, wicissaidtobeisotropic if σ i = σ, 29
6 i =1, 2,...,q.Aspecialcaseoftezero-meanisotropicwitenoiseistefollowing: If te component random variables of a q-variate wite noise {x t } ave zero means and unit variances so tat Γ x = diag(1,...,1) Rq q Z, ten{x t } is termed a zero-mean unit-variance wite noise. Te wite noise is used as te ingredient in many weakly stationary time series process models because of te simplicity of its acvf. Defined below is one suc model; refer 11.1 of[20] or 9.2 of[79] among many references for its details. Definition For a q-variate zero-mean wite noise {x t } t Z and matrices C j R q q j Z wit absolutely summable elements, a linear process is defined as te q-variate time series (2.4) u t = j Z C j x t j, wic is weakly stationary wit zero mean and acvf (2.5) Γ u = j Z C j+ Γ x 0C j. 2.2 Spectral analysis of continuous processes Te purpose of tis section is to introduce certain Fourier analysis concepts required for tis tesis. Note 2.3. Tis section deviates momentarily to discuss continuous time processes; te time index is t R; everywereelseintistesist Z. Consider te motion of a simple pendulum as an example of a periodic continuous process. It is assumed for simplicity tat te mass of te string attaced to te bob of te pendulum is negligible. Te oscillation is restricted toaplanesotatte constant string lengt and an angle, viz., te instantaneous angletattestringforms wit respect to its equilibrium position, are sufficient to describe its motion. It is also assumed tat te amplitude α, wicistemaximumdisplacementoftebobfrom its position of equilibrium, is very small relative to te lengt of te pendulum. Refer to Figure 2.3; let τ be te time period of oscillation so tat τ 1 is te frequency of oscillation. Te standard association of 2π radians to be equivalent to one complete oscillation may be made. Let φ radians be te part of 2π radians of an oscillation te pendulum as completed at time t =0;itssigndependsontecoiceofdirectionof reference of te bob s trajectory. If it is assumed tat te pendulum is undamped by any kinds of friction and disturbances, ten te pendulum s displacement wit respect to te equilibrium position of te string at time t R is y t = α cos(2π t τ + φ). Basic trigonometric identities enable writing y t in various combinations of sinusoids, e.g., (2.6) y t = a cos(2πt/τ)+b sin(2πt/τ), were a = α cos(φ) and b = α sin(φ). 30
7 y t α t =0 π 2τ 0 t φ π 2τ τ Figure 2.3: Te motion of te simple pendulum registers a continuous function based on te displacement of its bob. Just seen is te decomposition of a basic equation of oscillation into two sinusoids of frequency τ 1.Considertaty t was expressed as a weigted sum of two basis functions; tis is because te sinusoids ere are ortogonal functions, i.e., 1 2 τ cos(2πt/τ) 1 2 τ sin(2πt/τ) dt =0. Te necessity of ortogonal functions in many problems is analogous to te necessity of ortogonal coordinate axes in expressing te position of a point in a Cartesian plane. Te decomposition of a time-domain process to its frequency components is known as Fourier (spectral) analysis and te definitions presented in tis and Section 2.3 on tis topic can be found in references suc as [99, 44, 93, 89]. Fourier analysis is based on one of te most important contributions to te sciences originally formalized by Josep Fourier in 1807 tat any well-beaved deterministic continuous periodic function y t could be expressed as a sum of ortogonal functions if and only ifteortogonal functions are sinusoids, were a well-beaved function satisfies te following condition: Definition Afunctiony t t R is said to be absolutely summable if (2.7) y t dt <. Te unique decomposition of suc a deterministic periodic function y t into a possibly infinite number of sinusoids is called its Fourier series representation: y t = a n=1 (a n cos(2πnt/τ) +b n sin(2πnt/τ)), werea m = τ τ y 1 2 τ t cos(2mπt/τ) dt, m =0, 1, 2,... and b l = τ τ y 1 2 τ t sin(2lπt/τ) dt, l =1, 2, 3,... It is often con- 31
8 venient to use Euler identity e iθ = cos(θ) +isin(θ) to reac te following definition wic olds for complex-valued functions also. Definition Te Fourier series representation of a deterministic continuous periodic function y t C t R satisfying (2.7) is (2.8) y t = were c m C m Z is m= c m e i2πmt/τ (2.9) c m = 1 τ 1 2 τ 1 2 τ y t e i2πmt/τ dt. Note tat if c m = c m m Z, tentefunctiony t R, elsey t C. Involve frequency spacing u = 2π/τ and write te Fourier series coefficients as c m = u 2π 1 2 τ y 1 2 τ t e imt u dt. Substituting tese coefficients back into te series 1 2 τ y te int u dte imt u.suppose 1 2 τ summation gives y t = m= u 2π y(n u) = 1 2 τ 1 2 τ y t e int u dt, ten y t = m= u 2π y(n u) eimt u.asτ or u 0, y t = 1 2π u= y(u)e itu du. Tis is regarded as te inverse relation of a very important transform in matematics tat is defined below. Te term y(u) in te above development is te result of limiting u 0 in y(n u) and acquires te following definition: Definition Fourier transform of a function y t t R satisfying (2.7) is (2.10) y(u) = y t e itu dt. 2.3 Spectral analysis of discrete processes In te Fourier transform relation of (2.10), a continuous function defined for t R is dealt wit. Consider te continuous time function y t t R suc tat y t =0wenever t m τ m Z for some constant τ > 0. Tis is equivalent to sampling te continuous function y t t R at discrete instants separated by τ and zero at all oter instants. Since only discrete instants are relevant ere from te Fourier transform 32
9 perspective, y t would be called a discrete time function. Terefore, te discrete time Fourier transform using (2.10) becomes y(u) = m= y m τ e ium τ. Denote y m y m τ and refer to it as te m-t sample. Ten a sufficient condition for te existence of suc a relation is y(u) <, i.e., m= y me ium τ m= y m e ium τ <. Tisresultsinteabsolutesummabilitycondition (2.11) m= y m <. Using angular frequency ω as u τ =2πω in te above development results in te following definition of Fourier transform for discrete time functions. Definition Te discrete time Fourier transform of a complex-valued discrete function y m m Z satisfying (2.11) is (2.12) y(ω) = m= y m e i2πωm. Altoug real-valued discrete functions were being discussed, te discrete time Fourier transform is valid for complex-valued functions also. Furtermore, since e i2πk =1 k Z, tefollowingpropertyolds: Property 2.3. Te discrete time Fourier transform as unit periodicity, i.e., (2.13) y(ω) =y(k + ω) k Z. Anoter easily verifiable property, wic olds true for any absolutely summable discrete or continuous function, is due to te following teorem; refer 22.1 of [41] or Capter 3 of [72]: Teorem 2.1. According to te Plancerel-Parseval teorem for te discrete time Fourier transform y(ω) ω [ 1 2, 1 2 ] of te function y m m Z, (2.14) y m 2 = m Z y(ω) 2 dω. Just as te discrete time Fourier transform was defined being valid for complex-valued discrete functions, te Fourier series discussed earlier in (2.8) and(2.9) isapplicable to any complex valued periodic function defined over any continuous domain. Hence, replacing (y, t τ ) (y,ω) in (2.8) makes it equivalent to (2.12). In oter words, te discrete time Fourier transform of a sequence of equally spaced samples of a real function is also a Fourier series wose coefficients form te sequence. Terefore, allowing 33
10 te same replacement in (2.9) gives te differential 1 τ dt dω and te integral limits t = ± 1 2 τ ω = 1 2 resulting in te following inverse of te relation in (2.12): Definition Te inverse discrete time Fourier transform of a complexvalued continuous function y(ω) ω R is defined as (2.15) y m = e i2πmω y(ω)dω. Te Fourier series gave discrete frequency components of a continuous time process and te discrete time Fourier transform gave continuous frequency components of a discrete time process. On te oter and, te following transform gives discrete frequency components of a finite realization of a discrete time process: Definition Te discrete Fourier transform of a series {y t }, t =1,...,τ is defined as (2.16) y(ω j )= 1 τ τ y t e i2πω jt t=1 at discrete frequencies ω j = j τ, j =0,...,τ 1 and te inverse discrete Fourier transform at te discrete instants is defined as (2.17) y t = 1 τ τ y(ω j )e i2πωjt. t=1 Te equivalent of Teorem 2.1 for te discrete Fourier transform is as follows [17]: Property 2.4. According to te Plancerel-Parseval teorem for te discrete Fourier transform y(ω j ) of te sequence y t j, t =1,...,τ, (2.18) τ τ y t 2 = y(ω j ) 2. t=1 j=1 In tis tesis, for a given finite lengt realization of a multivariate time series, certain asymptotic properties of te discrete Fourier transform will be used to define, derive, and optimize te dynamic transformation of te latent time series into commonalities. Tese asymptotic properties will be discussed in Section 2.5. Te Plancerel-Parseval teorem will enable measuring and containing te commonalities tat are retained during te transition between te time-domain and te frequency-domain. In Section 2.4, ow te frequency-domain analysis finds utility in a stationary process will be discussed. Specifically, in Teorem 2.2, it will be learned ow te Fourier transform relates two important statistical properties of a time series. 34
11 2.4 Spectral analysis of stationary processes Suppose te pendulum motion expressed in (2.6) is subject to random amplitude α and pase φ disturbances so tat (a, b) become uncorrelated zero-mean unit-variance random variables (a, b). Moreover,tediscretetimedomainisconsideredsotatte equation of motion in (2.6) takes te form y t = acos(2πωt) +bsin(2πωt) t Z; it will be called te perturbed pendulum. Its mean µ y = E a,b [y t ] = 0. Te acvf is γ y = Ea,b [y t+ y t ], wic due to non-correlated a and b takes te form γ y = Ea,b [a 2 cos(2πω(t + )) cos(2πωt)] + E a,b [b 2 sin(2πω(t + )) sin(2πωt)] Z. Since it was assumed tat E a [a 2 ]=E b [b 2 ]=1,watonegets 1 is γ y = cos(2πω); spectral analysis of suc an acvf could be found in [111, 19]. Since µ y and γ y are independent of t, itisfoundtat{y t } is weakly stationary. And, since weakly stationary {y t } does not satisfy (2.11), its Fourier transform simply does not exist. Using Euler s identity, te acvf of te perturbed pendulum is written as a summation γ y = k i=1 α ig(ω i ),wereg(ω) =e i2πω, k =2, ω 1 = ω, ω 2 = ω, and α 1 = α 2 = 1 2. But suc a summation wit a general g(ω) as an integral representation k i=1 α ig(ω i )= g(ω) ds y (ω), weres y (ω) k i=1 α i 1(ω i ω) is a monotonically increasing function bounded between S y ( ) =0and S y ( ) =1, and 1(ω i ω) is te step function wic jumps from zero to unity at ω = ω i. However, due to periodicity of g(ω) =e i2πω in te above example of a perturbed pendulum, te acvf is essentially represented in te integral form γ y = e i2πω ds y (ω), weres y (ω) is a monotonically increasing function bounded between [ 1 2, 1 2 ] wile S y ( 1 2 )=0and Sy ( 1 2 )=γy 0.Tereaderisreferredto[99,20]fortedetails of tis representation and oter properties tat S y (ω) aderes to. Te notion carried forward is tat wenever te derivate s y (ω) = d dω Sy (ω) exists, it is possible to write te acvf as (2.19) γ y = e i2πω s y (ω) dω. But if tere are discontinuities in S y (ω), e.g.,teperturbedpendulum,itwillnotbe possible to write te acvf according to (2.19) because s y (ω) does not exist. Now refer back to (2.15) to see its analogy wit (2.19) wic requires tat a condition (2.20) = γ y <, equivalent to (2.11) be satisfied by γ y.tisenablestefollowingteoremanddefinition; refer 4.3 of [20]: 1 Using te trigonometric identity cos(θ 1 θ 2)= cosθ 1 cosθ 2 + sinθ 1 sinθ 2 35
12 Teorem 2.2. For acvf γ y of a weakly stationary time series {y t} t Z satisfying (2.20), according to Herglotz s teorem, te spectral density function s y (ω) at te frequency ω R exists and is defined as te discrete time Fourier transform of its acvf, i.e., (2.21) s y (ω) = γ y e i2πω. In tis context, it may be noted tat te perturbed pendulum does not satisfy te absolute sum condition because = γy = = cos(2πf) = and it does not ave a spectral density function. In ligt of (2.21) and similar to Property 2.3, te following property of te spectral density function is arrived at: Property 2.5. Te spectral density function as unit periodicity, i.e.,s y (ω) = s y (k + ω) k Z. For an r-variate time series {y t } t Z, werey t =[y 1t y rt ],letγ y i,y j be te (i, j)-t element of its autocovariance matrix Γ y. Referring to of [102], te condition equivalent to (2.20) for vector random variables becomes (2.22) = γ y i,y j <, wic is valid i, j 1,..., r in defining te matrix of spectral density function S y (ω) C r r wose (i, j)-t element is s y i,y j. Ten, due to te development of Property 2.1 and te relation (2.21), te following is easily got: Property 2.6. Te spectral density function S y (ω) is Hermitian symmetric about ω =0,i.e., (2.23) (S y (ω)) = S y ( ω) =S y (ω). Referring to Teorem of [18], Teorem of [39], and [92, 34], anoter important property of te r-variate time series follows: Property 2.7. If {y t } t Z is a linear process, ten S y (ω) 0 ω [0, 1]. Te above discussion is very relevant to te intention in tis tesistoassesstecommonalities of a multivariate time series via its spectral density function. For te purpose of learning multivariate time series based on te commonalities, te ope is to take te following approaces: Firstly, two multivariate time series are compared by evaluating ow similar te components of teir spectral density functions are. Secondly, te future evolution of a multivariate time series is predicted by estimating te acvf,via its spectral density function, tat inerits maximum commonalities. 36
13 2.5 Asymptotic properties of linear processes In practical problems, it is infeasible to ave a dataset consisting of an infinite collection of samples to compute true statistical properties suc as mean, acvf, variance, etc. Caracteristics of a time series ave to be estimated from a given finite lengt subset of its realization. Wit a limited number of samples, sample estimates may be questioned for teir reliability. Te field of study of asymptotic statisticsstrivestodesign properties, procedures, tests, and estimators in te limit tat te sample size becomes large [122, 58]. A broad review of te asymptotic tecniques will not be resorted to; owever, presented below are te essentials for te tesis s purposes. Consider te scenario in wic, due to computational or limited access to data, time series caracteristics ave to be gleaned from one realization forming a finite lengt data stream. For a weakly stationary time series, tese caracteristics include its mean and acvf for wic, first, te following asymptotic properties referring to 11.2 of [20] are presented: Teorem 2.3. For a finite τ-lengt realization {y t } t = 1,...,τ of a weakly stationary time series {y t } t Z wose acvf Γ y satisfies (2.22), te sample mean (2.24) ŷ = 1 τ τ t=1 y t converges in a mean square sense to te population mean µ y. Teorem 2.4. For a finite τ-lengt realization {y t } t = 1,...,τ of a weakly stationary time series {y t } t Z wit sample mean ŷ, ter r sample acvf τ { 1 (2.25) Γy = τ t=1 (y t+ ŷ)(y t+ ŷ) 0 τ 1, 1 τ τ t= +1 (y t+ ŷ)(y t+ ŷ) τ +1 <0 converges in probability to te population acvf Γ y. Wit te sample acvf Γ y for finite lags, te best ope is for estimates of te spectral density function S y (ω k ) at finite discrete frequencies ω k = k τ k =0,...,τ 1 via inverse discrete Fourier transform. For an oterwise continuous spectral density function S y (ω), 0 ω<1, toseestimatesatdiscretefrequenciesisanapproximation of S y (ω k ) dependent on ow good te sample estimation Γ y is. Terefore, in wat follows, described is te asymptotic property of S y (ω) near any target frequency ω j = j/ĵ j =0,...,ĵ 1, or0 ω j < 1 and ĵ τ. It starts by splitting a period of ω [0, 1) of te spectral density function into ĵ nonoverlapping frequency bands. Suppose tere is a total of τ = nĵ discrete frequencies tat are considered for te splitting so tat eac band will ave n discrete frequencies. By te 0-t frequency band represented by te target frequency ω 0 =0,impliedare n discrete frequencies ω 0,l > 0, l =1,...,n closest to 0. Bytej-t frequency band ω j,l l =1,...,n; j =1,...,ĵ 1, impliedaren frequencies closest to te target frequency ω j = j/ĵ and between ω j b and ω j + b, were2b = n/ĵ is called te 37
14 ω j,1 ω j,2 ω j,l ω j,n 1 ω j,n ω ω band 0 band 1 band j band (ĵ 2) band (ĵ 1) ω 0 ω 1 ω j ωĵ 2 ωĵ 1 ω ω [0, 1) Figure 2.4: Te sceme of splitting te frequency range ω = [0, 1) into ĵ non-overlapping subbands containing n discrete frequency components eac. bandwidt. Suppose 2b <ω 1 b<ωĵ 1 + b<1 and n ĵ is coosen so tat te bandwidt is very low. For proceeding furter, te following definitions are needed; refer to [45]: Definition An r-dimensional complex-valued vector random variable ξ =[ξ 1 ξ r ] = R(ξ) +ii(ξ) C r is defined as te 2r-variate vector random variable η =[R(ξ 1 ) I(ξ 1 ) R(ξ r ) I(ξ r )] R 2r formed by its real and imaginary components. As establised in [45], te covariance matrix Γ ξ of an r-variate complex valued vector random variable ξ is isomorpic, i.e., equivalent upto a row and a column permutation, to te covariance matrix Γ η of its corresponding 2r component vector random variable η via Γ ξ 2Γ η ;(Γ ξ ) (Γη ) 1 ; wereas te means are isomorpic via µ ξ µ η.also,itwassownteretatdet(γ ξ )= 2 r (det(γ η )) 1 2 and ξ Γ ξ ξ = η Γ η η. Ten, following te convention of a Gaussian distribution of an r-variate random variable u wit mean a and covariance matrix B denoted by (2.26) N (u a, B) = exp ( 1 2 (u a) B 1 (u a) ), (2π) r (det(b)) 1 2 te following definition could be arrived at: 38
15 Definition Te r-variate complex Gaussian probability density ofa complex valued random variable u wit mean a C r and covariance matrix B C r r is defined as N C (u a, B) = exp ( (u a) B 1 (u a) ) (2.27) π r. det(b) Now an essential teorem for tis tesis is presented; refer Teorem of [18], C.2 of [111], and [53]. Teorem 2.5. Te discrete Fourier transform components of a realization of an r- variate linear process at frequencies ω j,l suc tat lim ω j ω j,l 0 l 1,...,n; ĵ j =1,...,ĵ n are iid samples of an r-dimensional complex-valued vector random variable y j at frequency ω j [0, 1] wit a probability density (2.28) { p y(ωj) NC (u 0, S (u) = y (ω j )), ω j (0, 1) N (u 0, 2 S y (ω j )), ω j {0, 1}. Teorem 2.5 furnises a probabilistic model for discrete Fourier transform samples obtained from a finite realization of a time series of a linear process. Te teorem simply recommends tat discrete Fourier transform components witin a small bandwidt near a target frequency ω j is Gaussian wit te covariance matrix equal to te spectral density function S y (ω j );atzerofrequencytecovariancematrixistwices y (0). In order to use tis teorem, te following procedure is adered to: Given τ samples of a time series realization, first compute te τ-lengt discrete Fourier transform y(ω k ), k =0,...,τ 1. Ten,n discrete Fourier transform components y(ω j,l ), l =1,...,n; j =0, 1,...,ĵ 1, containedintej-t subband may be assigned as (2.29) ω j,l : ω j ω j,l nτ 1 ; n ĵ. For te j-t frequency band, te sample covariance matrix is computed as (2.30) Ŝ y (ω j )= 1 n n (y(ω j,l ) ŷ(ω j ))(y(ω j,l ) ŷ(ω j )), l=1 and ŷ(ω j )= 1 n n y(ω j,l ) is te sample mean of te discrete Fourier transform y(ω k ) and ω j b<ω k <ω j + b. To ensure robustness of te estimate Ŝy (ω j ),typically,onewouldalsowanttomaintain l=1 (2.31) n r 2, refer [106, 12]. It could be sown, as done in 4.2 of [18] or 12.4 of [25] tat for a linear process (2.32) lim n Ey [Ŝy (ω n)] = S y (ω) ω [0, 1). 39
16 Hence, wile maintaining ĵ n, asufficientlylargen sould provide an unbiased estimate of S y (ω j ) troug (2.30). Tis process is given in Algoritm 1, were care sould be taken to ensure tat tere are sufficient subbands as required by Teorem 2.5. Algoritm 1: PreparediscreteFouriertransformsubbands Input: D = {y t },t =1,...,τ; y t R r ; n;ĵ; Output: {Ŝy (ω j )}; {y(ω j,l )}; j =1,...,ĵ; l =1,...,n; F compute y t y(ω k ); ω k = k τ, k =0,...,τ 1 using (2.16); assign y(ω j,l ); j =1,...,ĵ; l =1,...,n using (2.29); estimate Ŝy (ω j ) using (2.30); 2.6 Summary Tis capter introduced certain frequently sougt after notions pertaining to time and frequency domain analyses of time series. Tese notions include acvf,spectral density function, discrete Fourier transform, wite noise, etc. Terelationbetweente spectral density function and te acvf was recapped on. Also introduced were some of te notations adered to for te remaining capters. As discussed, te spectral density function of a stationary time series is te Fourier transform of its autocovariance function. Te discrete Fourier transform components of a linear process witin a small bandwidt around a target frequency is approximately complex-gaussian wit mean zero and covariance matrix equaling te spectral density function at te target frequency. Our goal for tis tesis is to model and learn a measured multivariate time series by dynamically transforming a low-dimensional latent time series. Te ope is to use classical probabilistic modeling concepts introduced in te next capter to acieve tis goal. Most of tose concepts will be based on fitting popular probability density function models on time and lag independent data; but it is time series data tat is dealt wit. In order to elicit a similar and manageable probability density function tat applies to a wide class of time series, te asymptotic teory of discrete Fourier transform components was approaced. Tis is because tose components witin a small bandwidt may be considered as realizations of a complex-valued Gaussian vector random variable. Tis enables te possibility of applying standard probabilistic modeling tecniques, as reviewed in te next capter, to multivariate timeseriesmodeling. 40
The EOQ Inventory Formula
Te EOQ Inventory Formula James M. Cargal Matematics Department Troy University Montgomery Campus A basic problem for businesses and manufacturers is, wen ordering supplies, to determine wat quantity of
More informationFINITE DIFFERENCE METHODS
FINITE DIFFERENCE METHODS LONG CHEN Te best known metods, finite difference, consists of replacing eac derivative by a difference quotient in te classic formulation. It is simple to code and economic to
More informationHow To Ensure That An Eac Edge Program Is Successful
Introduction Te Economic Diversification and Growt Enterprises Act became effective on 1 January 1995. Te creation of tis Act was to encourage new businesses to start or expand in Newfoundland and Labrador.
More informationComputer Science and Engineering, UCSD October 7, 1999 Goldreic-Levin Teorem Autor: Bellare Te Goldreic-Levin Teorem 1 Te problem We æx a an integer n for te lengt of te strings involved. If a is an n-bit
More informationVerifying Numerical Convergence Rates
1 Order of accuracy Verifying Numerical Convergence Rates We consider a numerical approximation of an exact value u. Te approximation depends on a small parameter, suc as te grid size or time step, and
More informationCan a Lump-Sum Transfer Make Everyone Enjoy the Gains. from Free Trade?
Can a Lump-Sum Transfer Make Everyone Enjoy te Gains from Free Trade? Yasukazu Icino Department of Economics, Konan University June 30, 2010 Abstract I examine lump-sum transfer rules to redistribute te
More informationMATHEMATICS FOR ENGINEERING DIFFERENTIATION TUTORIAL 1 - BASIC DIFFERENTIATION
MATHEMATICS FOR ENGINEERING DIFFERENTIATION TUTORIAL 1 - BASIC DIFFERENTIATION Tis tutorial is essential pre-requisite material for anyone stuing mecanical engineering. Tis tutorial uses te principle of
More information2 Limits and Derivatives
2 Limits and Derivatives 2.7 Tangent Lines, Velocity, and Derivatives A tangent line to a circle is a line tat intersects te circle at exactly one point. We would like to take tis idea of tangent line
More informationDerivatives Math 120 Calculus I D Joyce, Fall 2013
Derivatives Mat 20 Calculus I D Joyce, Fall 203 Since we ave a good understanding of its, we can develop derivatives very quickly. Recall tat we defined te derivative f x of a function f at x to be te
More informationSAMPLE DESIGN FOR THE TERRORISM RISK INSURANCE PROGRAM SURVEY
ASA Section on Survey Researc Metods SAMPLE DESIG FOR TE TERRORISM RISK ISURACE PROGRAM SURVEY G. ussain Coudry, Westat; Mats yfjäll, Statisticon; and Marianne Winglee, Westat G. ussain Coudry, Westat,
More informationDistances in random graphs with infinite mean degrees
Distances in random graps wit infinite mean degrees Henri van den Esker, Remco van der Hofstad, Gerard Hoogiemstra and Dmitri Znamenski April 26, 2005 Abstract We study random graps wit an i.i.d. degree
More information2.23 Gambling Rehabilitation Services. Introduction
2.23 Gambling Reabilitation Services Introduction Figure 1 Since 1995 provincial revenues from gambling activities ave increased over 56% from $69.2 million in 1995 to $108 million in 2004. Te majority
More informationOPTIMAL DISCONTINUOUS GALERKIN METHODS FOR THE ACOUSTIC WAVE EQUATION IN HIGHER DIMENSIONS
OPTIMAL DISCONTINUOUS GALERKIN METHODS FOR THE ACOUSTIC WAVE EQUATION IN HIGHER DIMENSIONS ERIC T. CHUNG AND BJÖRN ENGQUIST Abstract. In tis paper, we developed and analyzed a new class of discontinuous
More informationIn other words the graph of the polynomial should pass through the points
Capter 3 Interpolation Interpolation is te problem of fitting a smoot curve troug a given set of points, generally as te grap of a function. It is useful at least in data analysis (interpolation is a form
More informationStrategic trading in a dynamic noisy market. Dimitri Vayanos
LSE Researc Online Article (refereed) Strategic trading in a dynamic noisy market Dimitri Vayanos LSE as developed LSE Researc Online so tat users may access researc output of te Scool. Copyrigt and Moral
More informationGeometric Stratification of Accounting Data
Stratification of Accounting Data Patricia Gunning * Jane Mary Horgan ** William Yancey *** Abstract: We suggest a new procedure for defining te boundaries of te strata in igly skewed populations, usual
More informationLecture 10: What is a Function, definition, piecewise defined functions, difference quotient, domain of a function
Lecture 10: Wat is a Function, definition, piecewise defined functions, difference quotient, domain of a function A function arises wen one quantity depends on anoter. Many everyday relationsips between
More informationON LOCAL LIKELIHOOD DENSITY ESTIMATION WHEN THE BANDWIDTH IS LARGE
ON LOCAL LIKELIHOOD DENSITY ESTIMATION WHEN THE BANDWIDTH IS LARGE Byeong U. Park 1 and Young Kyung Lee 2 Department of Statistics, Seoul National University, Seoul, Korea Tae Yoon Kim 3 and Ceolyong Park
More informationResearch on the Anti-perspective Correction Algorithm of QR Barcode
Researc on te Anti-perspective Correction Algoritm of QR Barcode Jianua Li, Yi-Wen Wang, YiJun Wang,Yi Cen, Guoceng Wang Key Laboratory of Electronic Tin Films and Integrated Devices University of Electronic
More informationAn inquiry into the multiplier process in IS-LM model
An inquiry into te multiplier process in IS-LM model Autor: Li ziran Address: Li ziran, Room 409, Building 38#, Peing University, Beijing 00.87,PRC. Pone: (86) 00-62763074 Internet Address: jefferson@water.pu.edu.cn
More informationCHAPTER 7. Di erentiation
CHAPTER 7 Di erentiation 1. Te Derivative at a Point Definition 7.1. Let f be a function defined on a neigborood of x 0. f is di erentiable at x 0, if te following it exists: f 0 fx 0 + ) fx 0 ) x 0 )=.
More informationCyber Epidemic Models with Dependences
Cyber Epidemic Models wit Dependences Maocao Xu 1, Gaofeng Da 2 and Souuai Xu 3 1 Department of Matematics, Illinois State University mxu2@ilstu.edu 2 Institute for Cyber Security, University of Texas
More information100 Austrian Journal of Statistics, Vol. 32 (2003), No. 1&2, 99-129
AUSTRIAN JOURNAL OF STATISTICS Volume 3 003, Number 1&, 99 19 Adaptive Regression on te Real Line in Classes of Smoot Functions L.M. Artiles and B.Y. Levit Eurandom, Eindoven, te Neterlands Queen s University,
More informationProbability and Random Variables. Generation of random variables (r.v.)
Probability and Random Variables Method for generating random variables with a specified probability distribution function. Gaussian And Markov Processes Characterization of Stationary Random Process Linearly
More informationThe modelling of business rules for dashboard reporting using mutual information
8 t World IMACS / MODSIM Congress, Cairns, Australia 3-7 July 2009 ttp://mssanz.org.au/modsim09 Te modelling of business rules for dasboard reporting using mutual information Gregory Calbert Command, Control,
More informationSchedulability Analysis under Graph Routing in WirelessHART Networks
Scedulability Analysis under Grap Routing in WirelessHART Networks Abusayeed Saifulla, Dolvara Gunatilaka, Paras Tiwari, Mo Sa, Cenyang Lu, Bo Li Cengjie Wu, and Yixin Cen Department of Computer Science,
More informationACT Math Facts & Formulas
Numbers, Sequences, Factors Integers:..., -3, -2, -1, 0, 1, 2, 3,... Rationals: fractions, tat is, anyting expressable as a ratio of integers Reals: integers plus rationals plus special numbers suc as
More informationProjective Geometry. Projective Geometry
Euclidean versus Euclidean geometry describes sapes as tey are Properties of objects tat are uncanged by rigid motions» Lengts» Angles» Parallelism Projective geometry describes objects as tey appear Lengts,
More informationTangent Lines and Rates of Change
Tangent Lines and Rates of Cange 9-2-2005 Given a function y = f(x), ow do you find te slope of te tangent line to te grap at te point P(a, f(a))? (I m tinking of te tangent line as a line tat just skims
More informationImproved dynamic programs for some batcing problems involving te maximum lateness criterion A P M Wagelmans Econometric Institute Erasmus University Rotterdam PO Box 1738, 3000 DR Rotterdam Te Neterlands
More information- 1 - Handout #22 May 23, 2012 Huffman Encoding and Data Compression. CS106B Spring 2012. Handout by Julie Zelenski with minor edits by Keith Schwarz
CS106B Spring 01 Handout # May 3, 01 Huffman Encoding and Data Compression Handout by Julie Zelenski wit minor edits by Keit Scwarz In te early 1980s, personal computers ad ard disks tat were no larger
More informationNotes: Most of the material in this chapter is taken from Young and Freedman, Chap. 12.
Capter 6. Fluid Mecanics Notes: Most of te material in tis capter is taken from Young and Freedman, Cap. 12. 6.1 Fluid Statics Fluids, i.e., substances tat can flow, are te subjects of tis capter. But
More informationChannel Allocation in Non-Cooperative Multi-Radio Multi-Channel Wireless Networks
Cannel Allocation in Non-Cooperative Multi-Radio Multi-Cannel Wireless Networks Dejun Yang, Xi Fang, Guoliang Xue Arizona State University Abstract Wile tremendous efforts ave been made on cannel allocation
More informationTo motivate the notion of a variogram for a covariance stationary process, { Ys ( ): s R}
4. Variograms Te covariogram and its normalized form, te correlogram, are by far te most intuitive metods for summarizing te structure of spatial dependencies in a covariance stationary process. However,
More informationInstantaneous Rate of Change:
Instantaneous Rate of Cange: Last section we discovered tat te average rate of cange in F(x) can also be interpreted as te slope of a scant line. Te average rate of cange involves te cange in F(x) over
More informationSection 3.3. Differentiation of Polynomials and Rational Functions. Difference Equations to Differential Equations
Difference Equations to Differential Equations Section 3.3 Differentiation of Polynomials an Rational Functions In tis section we begin te task of iscovering rules for ifferentiating various classes of
More informationEquilibria in sequential bargaining games as solutions to systems of equations
Economics Letters 84 (2004) 407 411 www.elsevier.com/locate/econbase Equilibria in sequential bargaining games as solutions to systems of equations Tasos Kalandrakis* Department of Political Science, Yale
More informationMatrices and Polynomials
APPENDIX 9 Matrices and Polynomials he Multiplication of Polynomials Let α(z) =α 0 +α 1 z+α 2 z 2 + α p z p and y(z) =y 0 +y 1 z+y 2 z 2 + y n z n be two polynomials of degrees p and n respectively. hen,
More informationTheoretical calculation of the heat capacity
eoretical calculation of te eat capacity Principle of equipartition of energy Heat capacity of ideal and real gases Heat capacity of solids: Dulong-Petit, Einstein, Debye models Heat capacity of metals
More informationComparison between two approaches to overload control in a Real Server: local or hybrid solutions?
Comparison between two approaces to overload control in a Real Server: local or ybrid solutions? S. Montagna and M. Pignolo Researc and Development Italtel S.p.A. Settimo Milanese, ITALY Abstract Tis wor
More informationf(a + h) f(a) f (a) = lim
Lecture 7 : Derivative AS a Function In te previous section we defined te derivative of a function f at a number a (wen te function f is defined in an open interval containing a) to be f (a) 0 f(a + )
More informationChapter 8 - Power Density Spectrum
EE385 Class Notes 8/8/03 John Stensby Chapter 8 - Power Density Spectrum Let X(t) be a WSS random process. X(t) has an average power, given in watts, of E[X(t) ], a constant. his total average power is
More informationWelfare, financial innovation and self insurance in dynamic incomplete markets models
Welfare, financial innovation and self insurance in dynamic incomplete markets models Paul Willen Department of Economics Princeton University First version: April 998 Tis version: July 999 Abstract We
More informationSAT Subject Math Level 1 Facts & Formulas
Numbers, Sequences, Factors Integers:..., -3, -2, -1, 0, 1, 2, 3,... Reals: integers plus fractions, decimals, and irrationals ( 2, 3, π, etc.) Order Of Operations: Aritmetic Sequences: PEMDAS (Parenteses
More informationChapter 6 Tail Design
apter 6 Tail Design Moammad Sadraey Daniel Webster ollege Table of ontents apter 6... 74 Tail Design... 74 6.1. Introduction... 74 6.. Aircraft Trim Requirements... 78 6..1. Longitudinal Trim... 79 6...
More informationResearch on Risk Assessment of PFI Projects Based on Grid-fuzzy Borda Number
Researc on Risk Assessent of PFI Projects Based on Grid-fuzzy Borda Nuber LI Hailing 1, SHI Bensan 2 1. Scool of Arcitecture and Civil Engineering, Xiua University, Cina, 610039 2. Scool of Econoics and
More informationUnivariate and Multivariate Methods PEARSON. Addison Wesley
Time Series Analysis Univariate and Multivariate Methods SECOND EDITION William W. S. Wei Department of Statistics The Fox School of Business and Management Temple University PEARSON Addison Wesley Boston
More informationOn Distributed Key Distribution Centers and Unconditionally Secure Proactive Verifiable Secret Sharing Schemes Based on General Access Structure
On Distributed Key Distribution Centers and Unconditionally Secure Proactive Verifiable Secret Saring Scemes Based on General Access Structure (Corrected Version) Ventzislav Nikov 1, Svetla Nikova 2, Bart
More informationCollege Planning Using Cash Value Life Insurance
College Planning Using Cas Value Life Insurance CAUTION: Te advisor is urged to be extremely cautious of anoter college funding veicle wic provides a guaranteed return of premium immediately if funded
More informationOptimized Data Indexing Algorithms for OLAP Systems
Database Systems Journal vol. I, no. 2/200 7 Optimized Data Indexing Algoritms for OLAP Systems Lucian BORNAZ Faculty of Cybernetics, Statistics and Economic Informatics Academy of Economic Studies, Bucarest
More informationTRADING AWAY WIDE BRANDS FOR CHEAP BRANDS. Swati Dhingra London School of Economics and CEP. Online Appendix
TRADING AWAY WIDE BRANDS FOR CHEAP BRANDS Swati Dingra London Scool of Economics and CEP Online Appendix APPENDIX A. THEORETICAL & EMPIRICAL RESULTS A.1. CES and Logit Preferences: Invariance of Innovation
More informationUnemployment insurance/severance payments and informality in developing countries
Unemployment insurance/severance payments and informality in developing countries David Bardey y and Fernando Jaramillo z First version: September 2011. Tis version: November 2011. Abstract We analyze
More informationA New Cement to Glue Nonconforming Grids with Robin Interface Conditions: The Finite Element Case
A New Cement to Glue Nonconforming Grids wit Robin Interface Conditions: Te Finite Element Case Martin J. Gander, Caroline Japet 2, Yvon Maday 3, and Frédéric Nataf 4 McGill University, Dept. of Matematics
More informationMath 113 HW #5 Solutions
Mat 3 HW #5 Solutions. Exercise.5.6. Suppose f is continuous on [, 5] and te only solutions of te equation f(x) = 6 are x = and x =. If f() = 8, explain wy f(3) > 6. Answer: Suppose we ad tat f(3) 6. Ten
More informationTraining Robust Support Vector Regression via D. C. Program
Journal of Information & Computational Science 7: 12 (2010) 2385 2394 Available at ttp://www.joics.com Training Robust Support Vector Regression via D. C. Program Kuaini Wang, Ping Zong, Yaoong Zao College
More informationAbstract. Introduction
Fast solution of te Sallow Water Equations using GPU tecnology A Crossley, R Lamb, S Waller JBA Consulting, Sout Barn, Brougton Hall, Skipton, Nort Yorksire, BD23 3AE. amanda.crossley@baconsulting.co.uk
More informationA system to monitor the quality of automated coding of textual answers to open questions
Researc in Official Statistics Number 2/2001 A system to monitor te quality of automated coding of textual answers to open questions Stefania Maccia * and Marcello D Orazio ** Italian National Statistical
More informationA Multigrid Tutorial part two
A Multigrid Tutorial part two William L. Briggs Department of Matematics University of Colorado at Denver Van Emden Henson Center for Applied Scientific Computing Lawrence Livermore National Laboratory
More informationReferendum-led Immigration Policy in the Welfare State
Referendum-led Immigration Policy in te Welfare State YUJI TAMURA Department of Economics, University of Warwick, UK First version: 12 December 2003 Updated: 16 Marc 2004 Abstract Preferences of eterogeneous
More informationOn a Satellite Coverage
I. INTRODUCTION On a Satellite Coverage Problem DANNY T. CHI Kodak Berkeley Researc Yu T. su National Ciao Tbng University Te eart coverage area for a satellite in an Eart syncronous orbit wit a nonzero
More informationChapter 7 Numerical Differentiation and Integration
45 We ave a abit in writing articles publised in scientiþc journals to make te work as Þnised as possible, to cover up all te tracks, to not worry about te blind alleys or describe ow you ad te wrong idea
More informationArea-Specific Recreation Use Estimation Using the National Visitor Use Monitoring Program Data
United States Department of Agriculture Forest Service Pacific Nortwest Researc Station Researc Note PNW-RN-557 July 2007 Area-Specific Recreation Use Estimation Using te National Visitor Use Monitoring
More informationDynamic Competitive Insurance
Dynamic Competitive Insurance Vitor Farina Luz June 26, 205 Abstract I analyze long-term contracting in insurance markets wit asymmetric information and a finite or infinite orizon. Risk neutral firms
More informationCatalogue no. 12-001-XIE. Survey Methodology. December 2004
Catalogue no. 1-001-XIE Survey Metodology December 004 How to obtain more information Specific inquiries about tis product and related statistics or services sould be directed to: Business Survey Metods
More informationMULTY BINARY TURBO CODED WOFDM PERFORMANCE IN FLAT RAYLEIGH FADING CHANNELS
Volume 49, Number 3, 28 MULTY BINARY TURBO CODED WOFDM PERFORMANCE IN FLAT RAYLEIGH FADING CHANNELS Marius OLTEAN Maria KOVACI Horia BALTA Andrei CAMPEANU Faculty of, Timisoara, Romania Bd. V. Parvan,
More information1 The Collocation Method
CS410 Assignment 7 Due: 1/5/14 (Fri) at 6pm You must wor eiter on your own or wit one partner. You may discuss bacground issues and general solution strategies wit oters, but te solutions you submit must
More informationMATHEMATICAL MODELS OF LIFE SUPPORT SYSTEMS Vol. I - Mathematical Models for Prediction of Climate - Dymnikov V.P.
MATHEMATICAL MODELS FOR PREDICTION OF CLIMATE Institute of Numerical Matematics, Russian Academy of Sciences, Moscow, Russia. Keywords: Modeling, climate system, climate, dynamic system, attractor, dimension,
More informationChapter 11. Limits and an Introduction to Calculus. Selected Applications
Capter Limits and an Introduction to Calculus. Introduction to Limits. Tecniques for Evaluating Limits. Te Tangent Line Problem. Limits at Infinit and Limits of Sequences.5 Te Area Problem Selected Applications
More informationChapter 10 Introduction to Time Series Analysis
Chapter 1 Introduction to Time Series Analysis A time series is a collection of observations made sequentially in time. Examples are daily mortality counts, particulate air pollution measurements, and
More informationPre-trial Settlement with Imperfect Private Monitoring
Pre-trial Settlement wit Imperfect Private Monitoring Mostafa Beskar University of New Hampsire Jee-Hyeong Park y Seoul National University July 2011 Incomplete, Do Not Circulate Abstract We model pretrial
More information1.6. Analyse Optimum Volume and Surface Area. Maximum Volume for a Given Surface Area. Example 1. Solution
1.6 Analyse Optimum Volume and Surface Area Estimation and oter informal metods of optimizing measures suc as surface area and volume often lead to reasonable solutions suc as te design of te tent in tis
More informationPart II: Finite Difference/Volume Discretisation for CFD
Part II: Finite Difference/Volume Discretisation for CFD Finite Volume Metod of te Advection-Diffusion Equation A Finite Difference/Volume Metod for te Incompressible Navier-Stokes Equations Marker-and-Cell
More informationModel Quality Report in Business Statistics
Model Quality Report in Business Statistics Mats Bergdal, Ole Blac, Russell Bowater, Ray Cambers, Pam Davies, David Draper, Eva Elvers, Susan Full, David Holmes, Pär Lundqvist, Sixten Lundström, Lennart
More informationSAT Math Must-Know Facts & Formulas
SAT Mat Must-Know Facts & Formuas Numbers, Sequences, Factors Integers:..., -3, -2, -1, 0, 1, 2, 3,... Rationas: fractions, tat is, anyting expressabe as a ratio of integers Reas: integers pus rationas
More informationBonferroni-Based Size-Correction for Nonstandard Testing Problems
Bonferroni-Based Size-Correction for Nonstandard Testing Problems Adam McCloskey Brown University October 2011; Tis Version: October 2012 Abstract We develop powerful new size-correction procedures for
More informationFINANCIAL SECTOR INEFFICIENCIES AND THE DEBT LAFFER CURVE
INTERNATIONAL JOURNAL OF FINANCE AND ECONOMICS Int. J. Fin. Econ. 10: 1 13 (2005) Publised online in Wiley InterScience (www.interscience.wiley.com). DOI: 10.1002/ijfe.251 FINANCIAL SECTOR INEFFICIENCIES
More informationCITY UNIVERSITY LONDON. BEng Degree in Computer Systems Engineering Part II BSc Degree in Computer Systems Engineering Part III PART 2 EXAMINATION
No: CITY UNIVERSITY LONDON BEng Degree in Computer Systems Engineering Part II BSc Degree in Computer Systems Engineering Part III PART 2 EXAMINATION ENGINEERING MATHEMATICS 2 (resit) EX2005 Date: August
More informationSolutions by: KARATUĞ OZAN BiRCAN. PROBLEM 1 (20 points): Let D be a region, i.e., an open connected set in
KOÇ UNIVERSITY, SPRING 2014 MATH 401, MIDTERM-1, MARCH 3 Instructor: BURAK OZBAGCI TIME: 75 Minutes Solutions by: KARATUĞ OZAN BiRCAN PROBLEM 1 (20 points): Let D be a region, i.e., an open connected set
More informationGovernment Debt and Optimal Monetary and Fiscal Policy
Government Debt and Optimal Monetary and Fiscal Policy Klaus Adam Manneim University and CEPR - preliminary version - June 7, 21 Abstract How do di erent levels of government debt a ect te optimal conduct
More informationArtificial Neural Networks for Time Series Prediction - a novel Approach to Inventory Management using Asymmetric Cost Functions
Artificial Neural Networks for Time Series Prediction - a novel Approac to Inventory Management using Asymmetric Cost Functions Sven F. Crone University of Hamburg, Institute of Information Systems crone@econ.uni-amburg.de
More informationTime Series Analysis in WinIDAMS
Time Series Analysis in WinIDAMS P.S. Nagpaul, New Delhi, India April 2005 1 Introduction A time series is a sequence of observations, which are ordered in time (or space). In electrical engineering literature,
More informationStaffing and routing in a two-tier call centre. Sameer Hasija*, Edieal J. Pinker and Robert A. Shumsky
8 Int. J. Operational Researc, Vol. 1, Nos. 1/, 005 Staffing and routing in a two-tier call centre Sameer Hasija*, Edieal J. Pinker and Robert A. Sumsky Simon Scool, University of Rocester, Rocester 1467,
More informationCommunication on the Grassmann Manifold: A Geometric Approach to the Noncoherent Multiple-Antenna Channel
IEEE TRANSACTIONS ON INFORMATION THEORY, VOL. 48, NO. 2, FEBRUARY 2002 359 Communication on the Grassmann Manifold: A Geometric Approach to the Noncoherent Multiple-Antenna Channel Lizhong Zheng, Student
More informationNote nine: Linear programming CSE 101. 1 Linear constraints and objective functions. 1.1 Introductory example. Copyright c Sanjoy Dasgupta 1
Copyrigt c Sanjoy Dasgupta Figure. (a) Te feasible region for a linear program wit two variables (see tet for details). (b) Contour lines of te objective function: for different values of (profit). Te
More informationf(x + h) f(x) h as representing the slope of a secant line. As h goes to 0, the slope of the secant line approaches the slope of the tangent line.
Derivative of f(z) Dr. E. Jacobs Te erivative of a function is efine as a limit: f (x) 0 f(x + ) f(x) We can visualize te expression f(x+) f(x) as representing te slope of a secant line. As goes to 0,
More information1 Short Introduction to Time Series
ECONOMICS 7344, Spring 202 Bent E. Sørensen January 24, 202 Short Introduction to Time Series A time series is a collection of stochastic variables x,.., x t,.., x T indexed by an integer value t. The
More informationFree Shipping and Repeat Buying on the Internet: Theory and Evidence
Free Sipping and Repeat Buying on te Internet: eory and Evidence Yingui Yang, Skander Essegaier and David R. Bell 1 June 13, 2005 1 Graduate Scool of Management, University of California at Davis (yiyang@ucdavis.edu)
More informationOrchestrating Bulk Data Transfers across Geo-Distributed Datacenters
Tis article as been accepted for publication in a future issue of tis journal, but as not been fully edited Content may cange prior to final publication Citation information: DOI 101109/TCC20152389842,
More informationChapter 12 Modal Decomposition of State-Space Models 12.1 Introduction The solutions obtained in previous chapters, whether in time domain or transfor
Lectures on Dynamic Systems and Control Mohammed Dahleh Munther A. Dahleh George Verghese Department of Electrical Engineering and Computer Science Massachuasetts Institute of Technology 1 1 c Chapter
More informationWriting Mathematics Papers
Writing Matematics Papers Tis essay is intended to elp your senior conference paper. It is a somewat astily produced amalgam of advice I ave given to students in my PDCs (Mat 4 and Mat 9), so it s not
More information2.12 Student Transportation. Introduction
Introduction Figure 1 At 31 Marc 2003, tere were approximately 84,000 students enrolled in scools in te Province of Newfoundland and Labrador, of wic an estimated 57,000 were transported by scool buses.
More informationNew Vocabulary volume
-. Plan Objectives To find te volume of a prism To find te volume of a cylinder Examples Finding Volume of a Rectangular Prism Finding Volume of a Triangular Prism 3 Finding Volume of a Cylinder Finding
More informationMath Test Sections. The College Board: Expanding College Opportunity
Taking te SAT I: Reasoning Test Mat Test Sections Te materials in tese files are intended for individual use by students getting ready to take an SAT Program test; permission for any oter use must be sougt
More informationInner Product Spaces and Orthogonality
Inner Product Spaces and Orthogonality week 3-4 Fall 2006 Dot product of R n The inner product or dot product of R n is a function, defined by u, v a b + a 2 b 2 + + a n b n for u a, a 2,, a n T, v b,
More information6. Differentiating the exponential and logarithm functions
1 6. Differentiating te exponential and logaritm functions We wis to find and use derivatives for functions of te form f(x) = a x, were a is a constant. By far te most convenient suc function for tis purpose
More informationPressure. Pressure. Atmospheric pressure. Conceptual example 1: Blood pressure. Pressure is force per unit area:
Pressure Pressure is force per unit area: F P = A Pressure Te direction of te force exerted on an object by a fluid is toward te object and perpendicular to its surface. At a microscopic level, te force
More informationFEGYVERNEKI SÁNDOR, PROBABILITY THEORY AND MATHEmATICAL
FEGYVERNEKI SÁNDOR, PROBABILITY THEORY AND MATHEmATICAL STATIsTICs 4 IV. RANDOm VECTORs 1. JOINTLY DIsTRIBUTED RANDOm VARIABLEs If are two rom variables defined on the same sample space we define the joint
More informationTis Problem and Retail Inventory Management
Optimizing Inventory Replenisment of Retail Fasion Products Marsall Fiser Kumar Rajaram Anant Raman Te Warton Scool, University of Pennsylvania, 3620 Locust Walk, 3207 SH-DH, Piladelpia, Pennsylvania 19104-6366
More informationHis solution? Federal law that requires government agencies and private industry to encrypt, or digitally scramble, sensitive data.
NET GAIN Scoring points for your financial future AS SEEN IN USA TODAY S MONEY SECTION, FEBRUARY 9, 2007 Tec experts plot to catc identity tieves Politicians to security gurus offer ideas to prevent data
More informationShell and Tube Heat Exchanger
Sell and Tube Heat Excanger MECH595 Introduction to Heat Transfer Professor M. Zenouzi Prepared by: Andrew Demedeiros, Ryan Ferguson, Bradford Powers November 19, 2009 1 Abstract 2 Contents Discussion
More information