Summary Nonstationary Time Series Multitude of Representations Possibilities from Applied Computational Harmonic Analysis Tests of Stationarity

Size: px
Start display at page:

Download "Summary Nonstationary Time Series Multitude of Representations Possibilities from Applied Computational Harmonic Analysis Tests of Stationarity"

Transcription

1 Nonstationary Time Series, Priestley s Evolutionary Spectra and Wavelets Guy Nason, School of Mathematics, University of Bristol Summary Nonstationary Time Series Multitude of Representations Possibilities from Applied Computational Harmonic Analysis Tests of Stationarity Nonstationary Time Series. c U. Bristol 1 / 32

2 Nonstationary Time Series, Priestley s Evolutionary Spectra and Wavelets Guy Nason, School of Mathematics, University of Bristol Summary Nonstationary Time Series Multitude of Representations Possibilities from Applied Computational Harmonic Analysis Tests of Stationarity Nonstationary Time Series. c U. Bristol 1 / 32

3 Nonstationary Time Series, Priestley s Evolutionary Spectra and Wavelets Guy Nason, School of Mathematics, University of Bristol Summary Nonstationary Time Series Multitude of Representations Possibilities from Applied Computational Harmonic Analysis Tests of Stationarity Nonstationary Time Series. c U. Bristol 1 / 32

4 Nonstationary Time Series, Priestley s Evolutionary Spectra and Wavelets Guy Nason, School of Mathematics, University of Bristol Summary Nonstationary Time Series Multitude of Representations Possibilities from Applied Computational Harmonic Analysis Tests of Stationarity Nonstationary Time Series. c U. Bristol 1 / 32

5 Nonstationary Time Series, Priestley s Evolutionary Spectra and Wavelets Guy Nason, School of Mathematics, University of Bristol Summary Nonstationary Time Series Multitude of Representations Possibilities from Applied Computational Harmonic Analysis Tests of Stationarity Nonstationary Time Series. c U. Bristol 1 / 32

6 Nonstationary Time Series, Priestley s Evolutionary Spectra and Wavelets Guy Nason, School of Mathematics, University of Bristol Summary Nonstationary Time Series Multitude of Representations Possibilities from Applied Computational Harmonic Analysis Tests of Stationarity Nonstationary Time Series. c U. Bristol 1 / 32

7 Time Series Time series are everywhere. We want to model them, estimate parameters, check model fit, and try other models. forecast future values. We need models! Or change the data, or the sampling mechanism: another story. Nonstationary Time Series. c U. Bristol 2 / 32

8 Time Series Time series are everywhere. We want to model them, estimate parameters, check model fit, and try other models. forecast future values. We need models! Or change the data, or the sampling mechanism: another story. Nonstationary Time Series. c U. Bristol 2 / 32

9 Time Series Time series are everywhere. We want to model them, estimate parameters, check model fit, and try other models. forecast future values. We need models! Or change the data, or the sampling mechanism: another story. Nonstationary Time Series. c U. Bristol 2 / 32

10 Time Series Time series are everywhere. We want to model them, estimate parameters, check model fit, and try other models. forecast future values. We need models! Or change the data, or the sampling mechanism: another story. Nonstationary Time Series. c U. Bristol 2 / 32

11 Time Series Time series are everywhere. We want to model them, estimate parameters, check model fit, and try other models. forecast future values. We need models! Or change the data, or the sampling mechanism: another story. Nonstationary Time Series. c U. Bristol 2 / 32

12 Time Series Time series are everywhere. We want to model them, estimate parameters, check model fit, and try other models. forecast future values. We need models! Or change the data, or the sampling mechanism: another story. Nonstationary Time Series. c U. Bristol 2 / 32

13 Time Series Time series are everywhere. We want to model them, estimate parameters, check model fit, and try other models. forecast future values. We need models! Or change the data, or the sampling mechanism: another story. Nonstationary Time Series. c U. Bristol 2 / 32

14 Time Series Time series are everywhere. We want to model them, estimate parameters, check model fit, and try other models. forecast future values. We need models! Or change the data, or the sampling mechanism: another story. Nonstationary Time Series. c U. Bristol 2 / 32

15 Example Time Series: Data Source MIDAS: Met Office Integrated Data Archive System Originates from the UK Meteorological Office Distributed through the NERC British Atmospheric Data Centre Acknowledgement and thanks is due. Nonstationary Time Series. c U. Bristol 3 / 32

16 Example Time Series: Data Source MIDAS: Met Office Integrated Data Archive System Originates from the UK Meteorological Office Distributed through the NERC British Atmospheric Data Centre Acknowledgement and thanks is due. Nonstationary Time Series. c U. Bristol 3 / 32

17 Example Time Series: Data Source MIDAS: Met Office Integrated Data Archive System Originates from the UK Meteorological Office Distributed through the NERC British Atmospheric Data Centre Acknowledgement and thanks is due. Nonstationary Time Series. c U. Bristol 3 / 32

18 Example Time Series: Data Source MIDAS: Met Office Integrated Data Archive System Originates from the UK Meteorological Office Distributed through the NERC British Atmospheric Data Centre Acknowledgement and thanks is due. Nonstationary Time Series. c U. Bristol 3 / 32

19 Hourly Wind Speeds at Cardinham, Bodmin, Cornwall Wind Speed at Cardinham (knots) Hour (Days since 1st January 2009) Nonstationary Time Series. c U. Bristol 4 / 32

20 First Differences of Wind Speed First Difference Wind Speed at Cardinham (knots) Hour (Days since 1st January 2009) Nonstationary Time Series. c U. Bristol 5 / 32

21 Time Series Models The classical methods of time series analysis... are all based on two crucial assumptions, namely that: (a) all series are stationary (at least to order 2), or can be reduced to stationarity... (b) all models are linear,... Priestley (1981), page 816. Nonstationary Time Series. c U. Bristol 6 / 32

22 Nonstationary Series and However, stationarity and linearity are... approximations to the real situation.... first establish some method of characterizing... non-stationary processes,... we describe... non-stationary processes based on the theory of evolutionary spectra. This approach was developed by Priestley (1965b, 1966, 1967) Priestley (1981), page 816. Nonstationary Time Series. c U. Bristol 7 / 32

23 Nonstationary Series and However, stationarity and linearity are... approximations to the real situation.... first establish some method of characterizing... non-stationary processes,... we describe... non-stationary processes based on the theory of evolutionary spectra. This approach was developed by Priestley (1965b, 1966, 1967) Priestley (1981), page 816. Nonstationary Time Series. c U. Bristol 7 / 32

24 Oscillatory Function (Priestley, 1981, Def ) The function of t, φ t (ω) will be said to be an oscillatory function if, for some (necessarily unique) θ(ω), it may be written in the form where A t (ω) is of the form φ t (ω) = A t (ω)e iθ(ω)t, A t (ω) = e itu dk ω (u), with dk ω (u) having an absolute maximum at u = 0. Nonstationary Time Series. c U. Bristol 8 / 32

25 Oscillatory Process (Priestley, 1981, Def ) If there exists a family of oscillatory functions {φ t (ω)} in terms of which the process {X (t)} has a representation of the form X (t) = φ t (ω)dz(ω), where Z(ω) is an orthogonal process with E[ dz(ω) 2 ] = dµ(ω), then {X (t)} will be termed an oscillatory process. Nonstationary Time Series. c U. Bristol 9 / 32

26 Evolutionary Power Spectra (Priestley, 1981, Def ) We define the evolutionary power spectrum at time t dh t (ω) by dh t (ω) = A t (ω) 2 dµ(ω). When X (t) is stationary and θ(ω) = ω then dh t (ω) reduces to the regular spectrum, h(ω). H t (ω) is the integrated time-frequency spectrum. Assuming smoothness the evolutionary spectral density function is h t (ω) = H t(ω). Nonstationary Time Series. c U. Bristol 10 / 32

27 Evolutionary Power Spectra (Priestley, 1981, Def ) We define the evolutionary power spectrum at time t dh t (ω) by dh t (ω) = A t (ω) 2 dµ(ω). When X (t) is stationary and θ(ω) = ω then dh t (ω) reduces to the regular spectrum, h(ω). H t (ω) is the integrated time-frequency spectrum. Assuming smoothness the evolutionary spectral density function is h t (ω) = H t(ω). Nonstationary Time Series. c U. Bristol 10 / 32

28 Evolutionary Power Spectra (Priestley, 1981, Def ) We define the evolutionary power spectrum at time t dh t (ω) by dh t (ω) = A t (ω) 2 dµ(ω). When X (t) is stationary and θ(ω) = ω then dh t (ω) reduces to the regular spectrum, h(ω). H t (ω) is the integrated time-frequency spectrum. Assuming smoothness the evolutionary spectral density function is h t (ω) = H t(ω). Nonstationary Time Series. c U. Bristol 10 / 32

29 Evolutionary Power Spectra (Priestley, 1981, Def ) We define the evolutionary power spectrum at time t dh t (ω) by dh t (ω) = A t (ω) 2 dµ(ω). When X (t) is stationary and θ(ω) = ω then dh t (ω) reduces to the regular spectrum, h(ω). H t (ω) is the integrated time-frequency spectrum. Assuming smoothness the evolutionary spectral density function is h t (ω) = H t(ω). Nonstationary Time Series. c U. Bristol 10 / 32

30 Stationarity Tests (Priestley & Subba Rao, 1969, JRSS-B) 1 Use Priestley s (1965) double-window estimator: ĥ t (ω). 2 Define Y (t, ω) = log ĥ t (ω). 3 Then, approximately, E{Y (t, ω)} = log h t (ω), 4 And, crucially, var{y (t, ω)} = σ 2. In other words Y (t, ω) = log h t (ω) + ɛ(t, ω), which we can discretize over a set of times t 1,..., t I and frequencies ω 1,..., ω J to get the nice linear model: in an obvious way. H : Y ij = µ + α i + β j + γ ij + ɛ ij. Approximately ɛ ij iid N(0, σ 2 ) if t i, ω j spaced out enough. Nonstationary Time Series. c U. Bristol 11 / 32

31 Stationarity Tests (Priestley & Subba Rao, 1969, JRSS-B) 1 Use Priestley s (1965) double-window estimator: ĥ t (ω). 2 Define Y (t, ω) = log ĥ t (ω). 3 Then, approximately, E{Y (t, ω)} = log h t (ω), 4 And, crucially, var{y (t, ω)} = σ 2. In other words Y (t, ω) = log h t (ω) + ɛ(t, ω), which we can discretize over a set of times t 1,..., t I and frequencies ω 1,..., ω J to get the nice linear model: in an obvious way. H : Y ij = µ + α i + β j + γ ij + ɛ ij. Approximately ɛ ij iid N(0, σ 2 ) if t i, ω j spaced out enough. Nonstationary Time Series. c U. Bristol 11 / 32

32 Stationarity Tests (Priestley & Subba Rao, 1969, JRSS-B) 1 Use Priestley s (1965) double-window estimator: ĥ t (ω). 2 Define Y (t, ω) = log ĥ t (ω). 3 Then, approximately, E{Y (t, ω)} = log h t (ω), 4 And, crucially, var{y (t, ω)} = σ 2. In other words Y (t, ω) = log h t (ω) + ɛ(t, ω), which we can discretize over a set of times t 1,..., t I and frequencies ω 1,..., ω J to get the nice linear model: in an obvious way. H : Y ij = µ + α i + β j + γ ij + ɛ ij. Approximately ɛ ij iid N(0, σ 2 ) if t i, ω j spaced out enough. Nonstationary Time Series. c U. Bristol 11 / 32

33 Stationarity Tests (Priestley & Subba Rao, 1969, JRSS-B) 1 Use Priestley s (1965) double-window estimator: ĥ t (ω). 2 Define Y (t, ω) = log ĥ t (ω). 3 Then, approximately, E{Y (t, ω)} = log h t (ω), 4 And, crucially, var{y (t, ω)} = σ 2. In other words Y (t, ω) = log h t (ω) + ɛ(t, ω), which we can discretize over a set of times t 1,..., t I and frequencies ω 1,..., ω J to get the nice linear model: in an obvious way. H : Y ij = µ + α i + β j + γ ij + ɛ ij. Approximately ɛ ij iid N(0, σ 2 ) if t i, ω j spaced out enough. Nonstationary Time Series. c U. Bristol 11 / 32

34 Stationarity Tests (Priestley & Subba Rao, 1969, JRSS-B) 1 Use Priestley s (1965) double-window estimator: ĥ t (ω). 2 Define Y (t, ω) = log ĥ t (ω). 3 Then, approximately, E{Y (t, ω)} = log h t (ω), 4 And, crucially, var{y (t, ω)} = σ 2. In other words Y (t, ω) = log h t (ω) + ɛ(t, ω), which we can discretize over a set of times t 1,..., t I and frequencies ω 1,..., ω J to get the nice linear model: in an obvious way. H : Y ij = µ + α i + β j + γ ij + ɛ ij. Approximately ɛ ij iid N(0, σ 2 ) if t i, ω j spaced out enough. Nonstationary Time Series. c U. Bristol 11 / 32

35 Stationarity Tests (Priestley & Subba Rao, 1969, JRSS-B) 1 Use Priestley s (1965) double-window estimator: ĥ t (ω). 2 Define Y (t, ω) = log ĥ t (ω). 3 Then, approximately, E{Y (t, ω)} = log h t (ω), 4 And, crucially, var{y (t, ω)} = σ 2. In other words Y (t, ω) = log h t (ω) + ɛ(t, ω), which we can discretize over a set of times t 1,..., t I and frequencies ω 1,..., ω J to get the nice linear model: in an obvious way. H : Y ij = µ + α i + β j + γ ij + ɛ ij. Approximately ɛ ij iid N(0, σ 2 ) if t i, ω j spaced out enough. Nonstationary Time Series. c U. Bristol 11 / 32

36 Stationarity Tests (Priestley & Subba Rao, 1969, JRSS-B) 1 Use Priestley s (1965) double-window estimator: ĥ t (ω). 2 Define Y (t, ω) = log ĥ t (ω). 3 Then, approximately, E{Y (t, ω)} = log h t (ω), 4 And, crucially, var{y (t, ω)} = σ 2. In other words Y (t, ω) = log h t (ω) + ɛ(t, ω), which we can discretize over a set of times t 1,..., t I and frequencies ω 1,..., ω J to get the nice linear model: in an obvious way. H : Y ij = µ + α i + β j + γ ij + ɛ ij. Approximately ɛ ij iid N(0, σ 2 ) if t i, ω j spaced out enough. Nonstationary Time Series. c U. Bristol 11 / 32

37 Test Procedure and Modern Implementation Test stationarity by inferring whether α i = 0 and γ ij = 0, i, j. Implementation: stationarity() in fractal R package. Uses improved multitaper estimate: reduces bias. fractal posted in By Bill Constantine & Donald Percival of the Applied Physics Laboratory, U of Washington, USA. Thirty-eight years after the Priestley and Subba Rao paper! Way ahead of their time! p-value for Cardinham data using stationarity() is Nonstationary Time Series. c U. Bristol 12 / 32

38 Test Procedure and Modern Implementation Test stationarity by inferring whether α i = 0 and γ ij = 0, i, j. Implementation: stationarity() in fractal R package. Uses improved multitaper estimate: reduces bias. fractal posted in By Bill Constantine & Donald Percival of the Applied Physics Laboratory, U of Washington, USA. Thirty-eight years after the Priestley and Subba Rao paper! Way ahead of their time! p-value for Cardinham data using stationarity() is Nonstationary Time Series. c U. Bristol 12 / 32

39 Test Procedure and Modern Implementation Test stationarity by inferring whether α i = 0 and γ ij = 0, i, j. Implementation: stationarity() in fractal R package. Uses improved multitaper estimate: reduces bias. fractal posted in By Bill Constantine & Donald Percival of the Applied Physics Laboratory, U of Washington, USA. Thirty-eight years after the Priestley and Subba Rao paper! Way ahead of their time! p-value for Cardinham data using stationarity() is Nonstationary Time Series. c U. Bristol 12 / 32

40 Test Procedure and Modern Implementation Test stationarity by inferring whether α i = 0 and γ ij = 0, i, j. Implementation: stationarity() in fractal R package. Uses improved multitaper estimate: reduces bias. fractal posted in By Bill Constantine & Donald Percival of the Applied Physics Laboratory, U of Washington, USA. Thirty-eight years after the Priestley and Subba Rao paper! Way ahead of their time! p-value for Cardinham data using stationarity() is Nonstationary Time Series. c U. Bristol 12 / 32

41 Test Procedure and Modern Implementation Test stationarity by inferring whether α i = 0 and γ ij = 0, i, j. Implementation: stationarity() in fractal R package. Uses improved multitaper estimate: reduces bias. fractal posted in By Bill Constantine & Donald Percival of the Applied Physics Laboratory, U of Washington, USA. Thirty-eight years after the Priestley and Subba Rao paper! Way ahead of their time! p-value for Cardinham data using stationarity() is Nonstationary Time Series. c U. Bristol 12 / 32

42 Test Procedure and Modern Implementation Test stationarity by inferring whether α i = 0 and γ ij = 0, i, j. Implementation: stationarity() in fractal R package. Uses improved multitaper estimate: reduces bias. fractal posted in By Bill Constantine & Donald Percival of the Applied Physics Laboratory, U of Washington, USA. Thirty-eight years after the Priestley and Subba Rao paper! Way ahead of their time! p-value for Cardinham data using stationarity() is Nonstationary Time Series. c U. Bristol 12 / 32

43 Test Procedure and Modern Implementation Test stationarity by inferring whether α i = 0 and γ ij = 0, i, j. Implementation: stationarity() in fractal R package. Uses improved multitaper estimate: reduces bias. fractal posted in By Bill Constantine & Donald Percival of the Applied Physics Laboratory, U of Washington, USA. Thirty-eight years after the Priestley and Subba Rao paper! Way ahead of their time! p-value for Cardinham data using stationarity() is Nonstationary Time Series. c U. Bristol 12 / 32

44 c Nonstationary Time Series. U. Bristol 13 / 32

45 Parzen and Priestley s Vision Parzen (1959) has pointed out that if there exists a representation X (t) = φ t (ω)dz(ω), then there is a multitude of different representations of the process, each representation based on a different family of functions. The situation is in some ways similar to the selection of a basis for a vector space. However, if the process is non-stationary this choice [complex exponential family] of family of functions is no longer valid. Priestley (1981) p Nonstationary Time Series. c U. Bristol 14 / 32

46 Parzen and Priestley s Vision Parzen (1959) has pointed out that if there exists a representation X (t) = φ t (ω)dz(ω), then there is a multitude of different representations of the process, each representation based on a different family of functions. The situation is in some ways similar to the selection of a basis for a vector space. However, if the process is non-stationary this choice [complex exponential family] of family of functions is no longer valid. Priestley (1981) p Nonstationary Time Series. c U. Bristol 14 / 32

47 Parzen and Priestley s Vision Parzen (1959) has pointed out that if there exists a representation X (t) = φ t (ω)dz(ω), then there is a multitude of different representations of the process, each representation based on a different family of functions. The situation is in some ways similar to the selection of a basis for a vector space. However, if the process is non-stationary this choice [complex exponential family] of family of functions is no longer valid. Priestley (1981) p Nonstationary Time Series. c U. Bristol 14 / 32

48 Priestley s Oscillatory Functions From p. 824 Priestley settles on θ(ω) = ω and φ t (ω) = A t (ω)e iωt. This captures uniformly modulated processes A t (ω) = C(t). Nonstationary Time Series. c U. Bristol 15 / 32

49 Priestley s Oscillatory Functions From p. 824 Priestley settles on θ(ω) = ω and φ t (ω) = A t (ω)e iωt. This captures uniformly modulated processes A t (ω) = C(t). Nonstationary Time Series. c U. Bristol 15 / 32

50 Semi-Stationary Processes Consider linear filter with frequency response function Γ(ω). Stationary processes have useful property that h (Y ) (ω 1 ) is unaffected by ω ω 1, i.e. h (Y ) (ω 1 ) = Γ(ω 1 ) 2 h (X ) (ω 1 ),... Priestley mimics stationary case and approx. useful property. He achieves this by A t (ω) slowly evolving fn. of t = semi-stationary processes. Today, related to locally stationary processes; also has the advantage of permitting estimation. Nonstationary Time Series. c U. Bristol 16 / 32

51 Semi-Stationary Processes Consider linear filter with frequency response function Γ(ω). Stationary processes have useful property that h (Y ) (ω 1 ) is unaffected by ω ω 1, i.e. h (Y ) (ω 1 ) = Γ(ω 1 ) 2 h (X ) (ω 1 ),... Priestley mimics stationary case and approx. useful property. He achieves this by A t (ω) slowly evolving fn. of t = semi-stationary processes. Today, related to locally stationary processes; also has the advantage of permitting estimation. Nonstationary Time Series. c U. Bristol 16 / 32

52 Semi-Stationary Processes Consider linear filter with frequency response function Γ(ω). Stationary processes have useful property that h (Y ) (ω 1 ) is unaffected by ω ω 1, i.e. h (Y ) (ω 1 ) = Γ(ω 1 ) 2 h (X ) (ω 1 ),... Priestley mimics stationary case and approx. useful property. He achieves this by A t (ω) slowly evolving fn. of t = semi-stationary processes. Today, related to locally stationary processes; also has the advantage of permitting estimation. Nonstationary Time Series. c U. Bristol 16 / 32

53 Semi-Stationary Processes Consider linear filter with frequency response function Γ(ω). Stationary processes have useful property that h (Y ) (ω 1 ) is unaffected by ω ω 1, i.e. h (Y ) (ω 1 ) = Γ(ω 1 ) 2 h (X ) (ω 1 ),... Priestley mimics stationary case and approx. useful property. He achieves this by A t (ω) slowly evolving fn. of t = semi-stationary processes. Today, related to locally stationary processes; also has the advantage of permitting estimation. Nonstationary Time Series. c U. Bristol 16 / 32

54 Semi-Stationary Processes Consider linear filter with frequency response function Γ(ω). Stationary processes have useful property that h (Y ) (ω 1 ) is unaffected by ω ω 1, i.e. h (Y ) (ω 1 ) = Γ(ω 1 ) 2 h (X ) (ω 1 ),... Priestley mimics stationary case and approx. useful property. He achieves this by A t (ω) slowly evolving fn. of t = semi-stationary processes. Today, related to locally stationary processes; also has the advantage of permitting estimation. Nonstationary Time Series. c U. Bristol 16 / 32

55 Heisenberg-Gabor uncertainty principle more accurately we estimate h t (ω) as a function of time the less accurately we can determine it as a function of frequency, Priestley, 1981, p. 835 (Daniells, 1965 and Tjøstheim, 1976). To estimate time-varying behaviour, we will necessarily have to sacrifice some frequency resolution. In some situations local Fourier highly inappropriate Nonstationary Time Series. c U. Bristol 17 / 32

56 Heisenberg-Gabor uncertainty principle more accurately we estimate h t (ω) as a function of time the less accurately we can determine it as a function of frequency, Priestley, 1981, p. 835 (Daniells, 1965 and Tjøstheim, 1976). To estimate time-varying behaviour, we will necessarily have to sacrifice some frequency resolution. In some situations local Fourier highly inappropriate Nonstationary Time Series. c U. Bristol 17 / 32

57 Heisenberg-Gabor uncertainty principle more accurately we estimate h t (ω) as a function of time the less accurately we can determine it as a function of frequency, Priestley, 1981, p. 835 (Daniells, 1965 and Tjøstheim, 1976). To estimate time-varying behaviour, we will necessarily have to sacrifice some frequency resolution. In some situations local Fourier highly inappropriate Nonstationary Time Series. c U. Bristol 17 / 32

58 Other Possibilities Single Bases: Fourier Nonstationary Time Series. c U. Bristol 18 / 32

59 Other Possibilities Single Bases: Fourier (of course). Nonstationary Time Series. c U. Bristol 18 / 32

60 Other Possibilities Single Bases: Fourier (of course). T /2 frequencies, T time steps Nonstationary Time Series. c U. Bristol 18 / 32

61 Other Possibilities Single Bases: Fourier (of course). T /2 frequencies, T time steps Wavelets, O(N). Nonstationary Time Series. c U. Bristol 18 / 32

62 Other Possibilities Single Bases: Fourier (of course). T /2 frequencies, T time steps Wavelets, O(N). log T frequency bands, T time steps Nonstationary Time Series. c U. Bristol 18 / 32

63 Other Possibilities Single Bases: Fourier (of course). T /2 frequencies, T time steps Wavelets, O(N). log T frequency bands, T time steps Walsh series Nonstationary Time Series. c U. Bristol 18 / 32

64 Other Possibilities Single Bases: Fourier (of course). T /2 frequencies, T time steps Wavelets, O(N). log T frequency bands, T time steps Walsh series Libraries or Dictionaries of Bases (richer signal analysis) Nonstationary Time Series. c U. Bristol 18 / 32

65 Other Possibilities Single Bases: Fourier (of course). T /2 frequencies, T time steps Wavelets, O(N). log T frequency bands, T time steps Walsh series Libraries or Dictionaries of Bases (richer signal analysis) Local Cosine or Sine bases Nonstationary Time Series. c U. Bristol 18 / 32

66 Other Possibilities Single Bases: Fourier (of course). T /2 frequencies, T time steps Wavelets, O(N). log T frequency bands, T time steps Walsh series Libraries or Dictionaries of Bases (richer signal analysis) Local Cosine or Sine bases Wavelet packet library Nonstationary Time Series. c U. Bristol 18 / 32

67 Other Possibilities Single Bases: Fourier (of course). T /2 frequencies, T time steps Wavelets, O(N). log T frequency bands, T time steps Walsh series Libraries or Dictionaries of Bases (richer signal analysis) Local Cosine or Sine bases Wavelet packet library Adapted waveform analysis of Coifman, fast O(N log N) transforms. Nonstationary Time Series. c U. Bristol 18 / 32

68 Bell Function for Local Cosine Bases Figure 7.4 A bell used for a local cosine basis 37 Nonstationary Time Series. c U. Bristol 19 / 32

69 Local Cosine Basis Let {a k } be a sequence of real numbers and {ɛ k } of positive numbers such that a ±k ± and a k + ɛ k < a k+1 ɛ k+1 ; let b k (x) be the (ɛ k, ɛ k+1 ) bell over [a k, a k+1 ]; then {u k,j } where { } u k,j (x) = {2/(a k+1 a k )} 1/2 (2j + 1)π(x ak ) b k (x) cos, 2(a k+1 a k ) k Z, j N is an orthonormal basis of L 2 (R). Walter and Shen (2001) Theorem 7.3 (Originally Coifman and Meyer (1991)). Nonstationary Time Series. c U. Bristol 20 / 32

70 Local Cosine Basis Let {a k } be a sequence of real numbers and {ɛ k } of positive numbers such that a ±k ± and a k + ɛ k < a k+1 ɛ k+1 ; let b k (x) be the (ɛ k, ɛ k+1 ) bell over [a k, a k+1 ]; then {u k,j } where u k,j (x) = { 2/(a k+1 a k ) } { } 1/2 (2j + 1)π(x ak ) bk (x) cos, 2(a k+1 a k ) k Z, j N is an orthonormal basis of L 2 (R). Walter and Shen (2001) Theorem 7.3 Nonstationary Time Series. c U. Bristol 21 / 32

71 Local Cosine Basis Let {a k } be a sequence of real numbers and {ɛ k } of positive numbers such that a ±k ± and a k + ɛ k < a k+1 ɛ k+1 ; let b k (x) be the (ɛ k, ɛ k+1 ) bell over [a k, a k+1 ]; then {u k,j } where { } (2j + 1)π(x u k,j (x) = {2/(a k+1 a k )} 1/2 ak ) b k (x) cos, 2(a k+1 a k ) k Z, j N is an orthonormal basis of L 2 (R). Walter and Shen (2001) Theorem 7.3 Nonstationary Time Series. c U. Bristol 22 / 32

72 Figure 7.5 Three elements in the local cosine basis with bell of Figure Nonstationary Time Series. c U. Bristol 23 / 32

73 Figure 7.6 Two additional elements of the local cosine basis showing the bell 39 Nonstationary Time Series. c U. Bristol 24 / 32

74 Different Families... Back to Priestley: there is a multitude of different representations of the process, each representation based on a different family of functions. So, there are many things we might try. Not all of them are oscillatory functions, or we don t know E.g. wavelets, Locally Stationary Wavelet Processes: X t = w j,k ψ j,k t ξ j,k, j=1 k Z w j,k = amplitude, ψ = oscillation, ξ = randomness. Nonstationary Time Series. c U. Bristol 25 / 32

75 Different Families... Back to Priestley: there is a multitude of different representations of the process, each representation based on a different family of functions. So, there are many things we might try. Not all of them are oscillatory functions, or we don t know E.g. wavelets, Locally Stationary Wavelet Processes: X t = w j,k ψ j,k t ξ j,k, j=1 k Z w j,k = amplitude, ψ = oscillation, ξ = randomness. Nonstationary Time Series. c U. Bristol 25 / 32

76 Different Families... Back to Priestley: there is a multitude of different representations of the process, each representation based on a different family of functions. So, there are many things we might try. Not all of them are oscillatory functions, or we don t know E.g. wavelets, Locally Stationary Wavelet Processes: X t = w j,k ψ j,k t ξ j,k, j=1 k Z w j,k = amplitude, ψ = oscillation, ξ = randomness. Nonstationary Time Series. c U. Bristol 25 / 32

77 Different Families... Back to Priestley: there is a multitude of different representations of the process, each representation based on a different family of functions. So, there are many things we might try. Not all of them are oscillatory functions, or we don t know E.g. wavelets, Locally Stationary Wavelet Processes: X t = w j,k ψ j,k t ξ j,k, j=1 k Z w j,k = amplitude, ψ = oscillation, ξ = randomness. Nonstationary Time Series. c U. Bristol 25 / 32

78 A Wavelet Based Test for Stationarity (Nason 2013) Use raw wavelet periodogram, I j,k = d 2 j,k where d j,k = t X tψ j,k t Time-scale analogue of regular periodogram. Define β j (z) = EI j,k, where z = k/t Under stationarity H 0 function β j (z) is constant. In mind locally stationary wavelet process alternative, but not necessary Nonstationary Time Series. c U. Bristol 26 / 32

79 A Wavelet Based Test for Stationarity (Nason 2013) Use raw wavelet periodogram, I j,k = d 2 j,k where d j,k = t X tψ j,k t Time-scale analogue of regular periodogram. Define β j (z) = EI j,k, where z = k/t Under stationarity H 0 function β j (z) is constant. In mind locally stationary wavelet process alternative, but not necessary Nonstationary Time Series. c U. Bristol 26 / 32

80 A Wavelet Based Test for Stationarity (Nason 2013) Use raw wavelet periodogram, I j,k = d 2 j,k where d j,k = t X tψ j,k t Time-scale analogue of regular periodogram. Define β j (z) = EI j,k, where z = k/t Under stationarity H 0 function β j (z) is constant. In mind locally stationary wavelet process alternative, but not necessary Nonstationary Time Series. c U. Bristol 26 / 32

81 A Wavelet Based Test for Stationarity (Nason 2013) Use raw wavelet periodogram, I j,k = d 2 j,k where d j,k = t X tψ j,k t Time-scale analogue of regular periodogram. Define β j (z) = EI j,k, where z = k/t Under stationarity H 0 function β j (z) is constant. In mind locally stationary wavelet process alternative, but not necessary Nonstationary Time Series. c U. Bristol 26 / 32

82 A Wavelet Based Test for Stationarity (Nason 2013) Use raw wavelet periodogram, I j,k = d 2 j,k where d j,k = t X tψ j,k t Time-scale analogue of regular periodogram. Define β j (z) = EI j,k, where z = k/t Under stationarity H 0 function β j (z) is constant. In mind locally stationary wavelet process alternative, but not necessary Nonstationary Time Series. c U. Bristol 26 / 32

83 A Wavelet Based Test for Stationarity (Nason 2013) Use raw wavelet periodogram, I j,k = d 2 j,k where d j,k = t X tψ j,k t Time-scale analogue of regular periodogram. Define β j (z) = EI j,k, where z = k/t Under stationarity H 0 function β j (z) is constant. In mind locally stationary wavelet process alternative, but not necessary Nonstationary Time Series. c U. Bristol 26 / 32

84 A Wavelet Based Test for Stationarity, 2 Use Neumann and von Sachs (2000) to test constancy of β j (z) Uses Haar wavelet coefficients of I j,k as fn. of k, which are ˆv l,m Test H 0 : v l,m = 0 for all l, m, asymptotic Gaussian theory Use multiple test control, Bonferroni, FDR R package locits contains the software Nonstationary Time Series. c U. Bristol 27 / 32

85 A Wavelet Based Test for Stationarity, 2 Use Neumann and von Sachs (2000) to test constancy of β j (z) Uses Haar wavelet coefficients of I j,k as fn. of k, which are ˆv l,m Test H 0 : v l,m = 0 for all l, m, asymptotic Gaussian theory Use multiple test control, Bonferroni, FDR R package locits contains the software Nonstationary Time Series. c U. Bristol 27 / 32

86 A Wavelet Based Test for Stationarity, 2 Use Neumann and von Sachs (2000) to test constancy of β j (z) Uses Haar wavelet coefficients of I j,k as fn. of k, which are ˆv l,m Test H 0 : v l,m = 0 for all l, m, asymptotic Gaussian theory Use multiple test control, Bonferroni, FDR R package locits contains the software Nonstationary Time Series. c U. Bristol 27 / 32

87 A Wavelet Based Test for Stationarity, 2 Use Neumann and von Sachs (2000) to test constancy of β j (z) Uses Haar wavelet coefficients of I j,k as fn. of k, which are ˆv l,m Test H 0 : v l,m = 0 for all l, m, asymptotic Gaussian theory Use multiple test control, Bonferroni, FDR R package locits contains the software Nonstationary Time Series. c U. Bristol 27 / 32

88 A Wavelet Based Test for Stationarity, 2 Use Neumann and von Sachs (2000) to test constancy of β j (z) Uses Haar wavelet coefficients of I j,k as fn. of k, which are ˆv l,m Test H 0 : v l,m = 0 for all l, m, asymptotic Gaussian theory Use multiple test control, Bonferroni, FDR R package locits contains the software Nonstationary Time Series. c U. Bristol 27 / 32

89 Wavelet Test of Stationarity on Cardinham 1st Diffs First Difference Wind Speed at Cardinham (knots) Hour (Days since 1st January 2009) MC Type: FDR. 7 rejected. Nonstationary Time Series. c U. Bristol 28 / 32

90 Cardinham Localized Autocovariance Localized Autocovariance of Cardinham Wind First Differences Hour (Days since 1st January 2009) Nonstationary Time Series. c U. Bristol 29 / 32

91 Localized Autocovariance for Cardinham: 4 days 0400 Local Autocovariance of Cardinham Wind First Differences Lag c('4 days 04:00', lag) Nonstationary Time Series. c U. Bristol 30 / 32

92 Localized Autocovariance for Cardinham: 16 days 1600 Local Autocovariance of Cardinham Wind First Differences Lag c('16 days 16:00', lag) Nonstationary Time Series. c U. Bristol 31 / 32

93 Summary Nonstationary time series models Oscillatory & Semi-Stationary processes Multitude of representations, which one? Wavelets, Computational Harmonic Analysis Essential for picking up alternatives. Priestley: major contributions to statistics and time series. Nonstationary Time Series. c U. Bristol 32 / 32

94 Summary Nonstationary time series models Oscillatory & Semi-Stationary processes Multitude of representations, which one? Wavelets, Computational Harmonic Analysis Essential for picking up alternatives. Priestley: major contributions to statistics and time series. Nonstationary Time Series. c U. Bristol 32 / 32

95 Summary Nonstationary time series models Oscillatory & Semi-Stationary processes Multitude of representations, which one? Wavelets, Computational Harmonic Analysis Essential for picking up alternatives. Priestley: major contributions to statistics and time series. Nonstationary Time Series. c U. Bristol 32 / 32

96 Summary Nonstationary time series models Oscillatory & Semi-Stationary processes Multitude of representations, which one? Wavelets, Computational Harmonic Analysis Essential for picking up alternatives. Priestley: major contributions to statistics and time series. Nonstationary Time Series. c U. Bristol 32 / 32

97 Summary Nonstationary time series models Oscillatory & Semi-Stationary processes Multitude of representations, which one? Wavelets, Computational Harmonic Analysis Essential for picking up alternatives. Priestley: major contributions to statistics and time series. Nonstationary Time Series. c U. Bristol 32 / 32

98 Summary Nonstationary time series models Oscillatory & Semi-Stationary processes Multitude of representations, which one? Wavelets, Computational Harmonic Analysis Essential for picking up alternatives. Priestley: major contributions to statistics and time series. Nonstationary Time Series. c U. Bristol 32 / 32

Chapter 10 Introduction to Time Series Analysis

Chapter 10 Introduction to Time Series Analysis Chapter 1 Introduction to Time Series Analysis A time series is a collection of observations made sequentially in time. Examples are daily mortality counts, particulate air pollution measurements, and

More information

Wavelet analysis. Wavelet requirements. Example signals. Stationary signal 2 Hz + 10 Hz + 20Hz. Zero mean, oscillatory (wave) Fast decay (let)

Wavelet analysis. Wavelet requirements. Example signals. Stationary signal 2 Hz + 10 Hz + 20Hz. Zero mean, oscillatory (wave) Fast decay (let) Wavelet analysis In the case of Fourier series, the orthonormal basis is generated by integral dilation of a single function e jx Every 2π-periodic square-integrable function is generated by a superposition

More information

Short-time FFT, Multi-taper analysis & Filtering in SPM12

Short-time FFT, Multi-taper analysis & Filtering in SPM12 Short-time FFT, Multi-taper analysis & Filtering in SPM12 Computational Psychiatry Seminar, FS 2015 Daniel Renz, Translational Neuromodeling Unit, ETHZ & UZH 20.03.2015 Overview Refresher Short-time Fourier

More information

ANALYZER BASICS WHAT IS AN FFT SPECTRUM ANALYZER? 2-1

ANALYZER BASICS WHAT IS AN FFT SPECTRUM ANALYZER? 2-1 WHAT IS AN FFT SPECTRUM ANALYZER? ANALYZER BASICS The SR760 FFT Spectrum Analyzer takes a time varying input signal, like you would see on an oscilloscope trace, and computes its frequency spectrum. Fourier's

More information

WAVEFORM DICTIONARIES AS APPLIED TO THE AUSTRALIAN EXCHANGE RATE

WAVEFORM DICTIONARIES AS APPLIED TO THE AUSTRALIAN EXCHANGE RATE Sunway Academic Journal 3, 87 98 (26) WAVEFORM DICTIONARIES AS APPLIED TO THE AUSTRALIAN EXCHANGE RATE SHIRLEY WONG a RAY ANDERSON Victoria University, Footscray Park Campus, Australia ABSTRACT This paper

More information

ITSM-R Reference Manual

ITSM-R Reference Manual ITSM-R Reference Manual George Weigt June 5, 2015 1 Contents 1 Introduction 3 1.1 Time series analysis in a nutshell............................... 3 1.2 White Noise Variance.....................................

More information

Nonlinear Signal Analysis: Time-Frequency Perspectives

Nonlinear Signal Analysis: Time-Frequency Perspectives TECHNICAL NOTES Nonlinear Signal Analysis: Time-Frequency Perspectives T. Kijewski-Correa 1 and A. Kareem 2 Abstract: Recently, there has been growing utilization of time-frequency transformations for

More information

Advanced Signal Processing and Digital Noise Reduction

Advanced Signal Processing and Digital Noise Reduction Advanced Signal Processing and Digital Noise Reduction Saeed V. Vaseghi Queen's University of Belfast UK WILEY HTEUBNER A Partnership between John Wiley & Sons and B. G. Teubner Publishers Chichester New

More information

WAVELET ANALYSES OF SOME ATMOSPHERIC PARAMETERS AT BLACK SEA REGION Zafer ASLAN, Zehra Nevin ÇAĞLAR and D.Nail YENİÇERİ

WAVELET ANALYSES OF SOME ATMOSPHERIC PARAMETERS AT BLACK SEA REGION Zafer ASLAN, Zehra Nevin ÇAĞLAR and D.Nail YENİÇERİ INTERNATIONAL JOURNAL OF ELECTRONICS; MECHANICAL and MECHATRONICS ENGINEERING Vol.3 Num.1 pp.(419-426) WAVELET ANALYSES OF SOME ATMOSPHERIC PARAMETERS AT BLACK SEA REGION Zafer, ASLAN 1 ; Zehra Nevin,

More information

Wavelet Analysis Based Estimation of Probability Density function of Wind Data

Wavelet Analysis Based Estimation of Probability Density function of Wind Data , pp.23-34 http://dx.doi.org/10.14257/ijeic.2014.5.3.03 Wavelet Analysis Based Estimation of Probability Density function of Wind Data Debanshee Datta Department of Mechanical Engineering Indian Institute

More information

Software Review: ITSM 2000 Professional Version 6.0.

Software Review: ITSM 2000 Professional Version 6.0. Lee, J. & Strazicich, M.C. (2002). Software Review: ITSM 2000 Professional Version 6.0. International Journal of Forecasting, 18(3): 455-459 (June 2002). Published by Elsevier (ISSN: 0169-2070). http://0-

More information

Probability and Random Variables. Generation of random variables (r.v.)

Probability and Random Variables. Generation of random variables (r.v.) Probability and Random Variables Method for generating random variables with a specified probability distribution function. Gaussian And Markov Processes Characterization of Stationary Random Process Linearly

More information

5 Signal Design for Bandlimited Channels

5 Signal Design for Bandlimited Channels 225 5 Signal Design for Bandlimited Channels So far, we have not imposed any bandwidth constraints on the transmitted passband signal, or equivalently, on the transmitted baseband signal s b (t) I[k]g

More information

Probabilistic properties and statistical analysis of network traffic models: research project

Probabilistic properties and statistical analysis of network traffic models: research project Probabilistic properties and statistical analysis of network traffic models: research project The problem: It is commonly accepted that teletraffic data exhibits self-similarity over a certain range of

More information

11. Time series and dynamic linear models

11. Time series and dynamic linear models 11. Time series and dynamic linear models Objective To introduce the Bayesian approach to the modeling and forecasting of time series. Recommended reading West, M. and Harrison, J. (1997). models, (2 nd

More information

L9: Cepstral analysis

L9: Cepstral analysis L9: Cepstral analysis The cepstrum Homomorphic filtering The cepstrum and voicing/pitch detection Linear prediction cepstral coefficients Mel frequency cepstral coefficients This lecture is based on [Taylor,

More information

Wavelet Analysis on Stochastic Time Series A visual introduction with an examination of long term financial time series

Wavelet Analysis on Stochastic Time Series A visual introduction with an examination of long term financial time series Wavelet Analysis on Stochastic Time Series A visual introduction with an examination of long term financial time series Tobias Setz supervised by PD Diethelm Würtz ETH Zürich Computational Science and

More information

3. Regression & Exponential Smoothing

3. Regression & Exponential Smoothing 3. Regression & Exponential Smoothing 3.1 Forecasting a Single Time Series Two main approaches are traditionally used to model a single time series z 1, z 2,..., z n 1. Models the observation z t as a

More information

Statistical Modeling by Wavelets

Statistical Modeling by Wavelets Statistical Modeling by Wavelets BRANI VIDAKOVIC Duke University A Wiley-Interscience Publication JOHN WILEY & SONS, INC. New York / Chichester / Weinheim / Brisbane / Singapore / Toronto Contents Preface

More information

Co-integration of Stock Markets using Wavelet Theory and Data Mining

Co-integration of Stock Markets using Wavelet Theory and Data Mining Co-integration of Stock Markets using Wavelet Theory and Data Mining R.Sahu P.B.Sanjeev rsahu@iiitm.ac.in sanjeev@iiitm.ac.in ABV-Indian Institute of Information Technology and Management, India Abstract

More information

How To Solve A Save Problem With Time T

How To Solve A Save Problem With Time T Bayesian Functional Data Analysis for Computer Model Validation Fei Liu Institute of Statistics and Decision Sciences Duke University Transition Workshop on Development, Assessment and Utilization of Complex

More information

SOFTWARE FOR GENERATION OF SPECTRUM COMPATIBLE TIME HISTORY

SOFTWARE FOR GENERATION OF SPECTRUM COMPATIBLE TIME HISTORY 3 th World Conference on Earthquake Engineering Vancouver, B.C., Canada August -6, 24 Paper No. 296 SOFTWARE FOR GENERATION OF SPECTRUM COMPATIBLE TIME HISTORY ASHOK KUMAR SUMMARY One of the important

More information

Univariate and Multivariate Methods PEARSON. Addison Wesley

Univariate and Multivariate Methods PEARSON. Addison Wesley Time Series Analysis Univariate and Multivariate Methods SECOND EDITION William W. S. Wei Department of Statistics The Fox School of Business and Management Temple University PEARSON Addison Wesley Boston

More information

Filtering method in wireless sensor network management based on EMD algorithm and multi scale wavelet analysis

Filtering method in wireless sensor network management based on EMD algorithm and multi scale wavelet analysis Available online www.ocpr.com Journal of Chemical and Pharmaceutical Research, 2014, 6(6):912-918 Research Article ISSN : 0975-7384 CODEN(USA) : JCPRC5 Filtering method in wireless sensor network management

More information

COURSE DESCRIPTOR Signal Processing II Signalbehandling II 7.5 ECTS credit points (7,5 högskolepoäng)

COURSE DESCRIPTOR Signal Processing II Signalbehandling II 7.5 ECTS credit points (7,5 högskolepoäng) Blekinge Institute of Technology School of Engineering, ASB Andhra University College of Engineering (A) TWO YEAR DOUBLE DEGREE MASTERS PROGRAM MS (SIGNAL PROCESSING) FIRST YEAR I SEMESTER CODE Name of

More information

Time Series Analysis for Directional Data

Time Series Analysis for Directional Data Time Series Analysis for Directional Data Peter S. Craig Thesis submitted for the degree of Ph.D. Trinity College Dublin Dept. of Statistics September, 988 I declare that this thesis has not been submitted

More information

A course in Time Series Analysis. Suhasini Subba Rao Email: suhasini.subbarao@stat.tamu.edu

A course in Time Series Analysis. Suhasini Subba Rao Email: suhasini.subbarao@stat.tamu.edu A course in Time Series Analysis Suhasini Subba Rao Email: suhasini.subbarao@stat.tamu.edu August 5, 205 Contents Introduction 8. Time Series data................................. 8.. R code....................................2

More information

Singular Spectrum Analysis with Rssa

Singular Spectrum Analysis with Rssa Singular Spectrum Analysis with Rssa Maurizio Sanarico Chief Data Scientist SDG Consulting Milano R June 4, 2014 Motivation Discover structural components in complex time series Working hypothesis: a signal

More information

Time Series Analysis

Time Series Analysis JUNE 2012 Time Series Analysis CONTENT A time series is a chronological sequence of observations on a particular variable. Usually the observations are taken at regular intervals (days, months, years),

More information

Introduction to time series analysis

Introduction to time series analysis Introduction to time series analysis Margherita Gerolimetto November 3, 2010 1 What is a time series? A time series is a collection of observations ordered following a parameter that for us is time. Examples

More information

Moving Holidays and Seasonality: An Application in the Time and the Frequency Domains For Turkey

Moving Holidays and Seasonality: An Application in the Time and the Frequency Domains For Turkey This version: 04/02/01 Comments are welcome. Moving Holidays and Seasonality: An Application in the Time and the Frequency Domains For Turkey C. Emre Alper Department of Economics and Center for Economics

More information

Part II Redundant Dictionaries and Pursuit Algorithms

Part II Redundant Dictionaries and Pursuit Algorithms Aisenstadt Chair Course CRM September 2009 Part II Redundant Dictionaries and Pursuit Algorithms Stéphane Mallat Centre de Mathématiques Appliquées Ecole Polytechnique Sparsity in Redundant Dictionaries

More information

Admin stuff. 4 Image Pyramids. Spatial Domain. Projects. Fourier domain 2/26/2008. Fourier as a change of basis

Admin stuff. 4 Image Pyramids. Spatial Domain. Projects. Fourier domain 2/26/2008. Fourier as a change of basis Admin stuff 4 Image Pyramids Change of office hours on Wed 4 th April Mon 3 st March 9.3.3pm (right after class) Change of time/date t of last class Currently Mon 5 th May What about Thursday 8 th May?

More information

Spectrum Level and Band Level

Spectrum Level and Band Level Spectrum Level and Band Level ntensity, ntensity Level, and ntensity Spectrum Level As a review, earlier we talked about the intensity of a sound wave. We related the intensity of a sound wave to the acoustic

More information

Time Series Analysis in WinIDAMS

Time Series Analysis in WinIDAMS Time Series Analysis in WinIDAMS P.S. Nagpaul, New Delhi, India April 2005 1 Introduction A time series is a sequence of observations, which are ordered in time (or space). In electrical engineering literature,

More information

Time Series Analysis III

Time Series Analysis III Lecture 12: Time Series Analysis III MIT 18.S096 Dr. Kempthorne Fall 2013 MIT 18.S096 Time Series Analysis III 1 Outline Time Series Analysis III 1 Time Series Analysis III MIT 18.S096 Time Series Analysis

More information

Matrices and Polynomials

Matrices and Polynomials APPENDIX 9 Matrices and Polynomials he Multiplication of Polynomials Let α(z) =α 0 +α 1 z+α 2 z 2 + α p z p and y(z) =y 0 +y 1 z+y 2 z 2 + y n z n be two polynomials of degrees p and n respectively. hen,

More information

Outline. Time Series Analysis. Difficulties in astronomical time series

Outline. Time Series Analysis. Difficulties in astronomical time series Page 347 Outline Time Series Analysis 1 Time series in astronomy 2 Frequency domain methods 3 Time domain methods 4 References Time series in astronomy Difficulties in astronomical time series Periodic

More information

CS 591.03 Introduction to Data Mining Instructor: Abdullah Mueen

CS 591.03 Introduction to Data Mining Instructor: Abdullah Mueen CS 591.03 Introduction to Data Mining Instructor: Abdullah Mueen LECTURE 3: DATA TRANSFORMATION AND DIMENSIONALITY REDUCTION Chapter 3: Data Preprocessing Data Preprocessing: An Overview Data Quality Major

More information

A Wavelet Based Prediction Method for Time Series

A Wavelet Based Prediction Method for Time Series A Wavelet Based Prediction Method for Time Series Cristina Stolojescu 1,2 Ion Railean 1,3 Sorin Moga 1 Philippe Lenca 1 and Alexandru Isar 2 1 Institut TELECOM; TELECOM Bretagne, UMR CNRS 3192 Lab-STICC;

More information

Very Preliminary Program

Very Preliminary Program Very Preliminary Program Two of the participants will give Colloquium talks before the meeting. The workshop it self starts on Friday morning. All talks will take place in Lockett, 277. The room is equipped

More information

Five years of gravity measurement at Onsala Space Observatory: The absolute scale

Five years of gravity measurement at Onsala Space Observatory: The absolute scale Five years of gravity measurement at Onsala Space Observatory: The absolute scale Hans-Georg Scherneck, Chalmers Andreas Engfeldt, Lantmäteriet Per-Anders Olsson, Lantmäteriet Ludger Timmen, IfE, Leibnitz

More information

Time Series - ARIMA Models. Instructor: G. William Schwert

Time Series - ARIMA Models. Instructor: G. William Schwert APS 425 Fall 25 Time Series : ARIMA Models Instructor: G. William Schwert 585-275-247 schwert@schwert.ssb.rochester.edu Topics Typical time series plot Pattern recognition in auto and partial autocorrelations

More information

RANDOM VIBRATION AN OVERVIEW by Barry Controls, Hopkinton, MA

RANDOM VIBRATION AN OVERVIEW by Barry Controls, Hopkinton, MA RANDOM VIBRATION AN OVERVIEW by Barry Controls, Hopkinton, MA ABSTRACT Random vibration is becoming increasingly recognized as the most realistic method of simulating the dynamic environment of military

More information

This document is downloaded from DR-NTU, Nanyang Technological University Library, Singapore.

This document is downloaded from DR-NTU, Nanyang Technological University Library, Singapore. This document is downloaded from DR-NTU, Nanyang Technological University Library, Singapore. Title Transcription of polyphonic signals using fast filter bank( Accepted version ) Author(s) Foo, Say Wei;

More information

NRZ Bandwidth - HF Cutoff vs. SNR

NRZ Bandwidth - HF Cutoff vs. SNR Application Note: HFAN-09.0. Rev.2; 04/08 NRZ Bandwidth - HF Cutoff vs. SNR Functional Diagrams Pin Configurations appear at end of data sheet. Functional Diagrams continued at end of data sheet. UCSP

More information

Thick-pen transformation for time series

Thick-pen transformation for time series Thick-pen transformation for time series P. Fryzlewicz H.-S. Oh January 1, 2011 Abstract Traditional visualisation of time series data often consists of plotting the time series values against time and

More information

- Short term variability: 27 day cycle (clearest periodicity within satellite data time series)

- Short term variability: 27 day cycle (clearest periodicity within satellite data time series) Impact of short-term solar variability on middle atmospheric ozone S. Bossay, M. Marchand, G. Thuillier, A. Hauchecorne, P. Keckhut, C. Claud & S. Bekki - Short term variability: 27 day cycle (clearest

More information

2 The wireless channel

2 The wireless channel CHAPTER The wireless channel A good understanding of the wireless channel, its key physical parameters and the modeling issues, lays the foundation for the rest of the book. This is the goal of this chapter.

More information

Sales forecasting # 2

Sales forecasting # 2 Sales forecasting # 2 Arthur Charpentier arthur.charpentier@univ-rennes1.fr 1 Agenda Qualitative and quantitative methods, a very general introduction Series decomposition Short versus long term forecasting

More information

Financial TIme Series Analysis: Part II

Financial TIme Series Analysis: Part II Department of Mathematics and Statistics, University of Vaasa, Finland January 29 February 13, 2015 Feb 14, 2015 1 Univariate linear stochastic models: further topics Unobserved component model Signal

More information

Introduction to Time Series Analysis. Lecture 1.

Introduction to Time Series Analysis. Lecture 1. Introduction to Time Series Analysis. Lecture 1. Peter Bartlett 1. Organizational issues. 2. Objectives of time series analysis. Examples. 3. Overview of the course. 4. Time series models. 5. Time series

More information

Appendix 1: Time series analysis of peak-rate years and synchrony testing.

Appendix 1: Time series analysis of peak-rate years and synchrony testing. Appendix 1: Time series analysis of peak-rate years and synchrony testing. Overview The raw data are accessible at Figshare ( Time series of global resources, DOI 10.6084/m9.figshare.929619), sources are

More information

VCO Phase noise. Characterizing Phase Noise

VCO Phase noise. Characterizing Phase Noise VCO Phase noise Characterizing Phase Noise The term phase noise is widely used for describing short term random frequency fluctuations of a signal. Frequency stability is a measure of the degree to which

More information

Linear Filtering Part II

Linear Filtering Part II Linear Filtering Part II Selim Aksoy Department of Computer Engineering Bilkent University saksoy@cs.bilkent.edu.tr Fourier theory Jean Baptiste Joseph Fourier had a crazy idea: Any periodic function can

More information

1. INTRODUCTION. In many structural economic or time-series models, the errors may have heterogeneity and temporal dependence of unknown form.

1. INTRODUCTION. In many structural economic or time-series models, the errors may have heterogeneity and temporal dependence of unknown form. A PRACIIONER S GUIDE O ROBUS COVARIANCE MARIX ESIMAION Wouter J. den Haan Department of Economics, University of California at San Diego, and National Bureau of Economic Research and Andrew Levin International

More information

The Math in Laser Light Math

The Math in Laser Light Math The Math in Laser Light Math When graphed, many mathematical curves are eautiful to view. These curves are usually rought into graphic form y incorporating such devices as a plotter, printer, video screen,

More information

Time Series Analysis

Time Series Analysis Time Series 1 April 9, 2013 Time Series Analysis This chapter presents an introduction to the branch of statistics known as time series analysis. Often the data we collect in environmental studies is collected

More information

Should we Really Care about Building Business. Cycle Coincident Indexes!

Should we Really Care about Building Business. Cycle Coincident Indexes! Should we Really Care about Building Business Cycle Coincident Indexes! Alain Hecq University of Maastricht The Netherlands August 2, 2004 Abstract Quite often, the goal of the game when developing new

More information

Correlation and Convolution Class Notes for CMSC 426, Fall 2005 David Jacobs

Correlation and Convolution Class Notes for CMSC 426, Fall 2005 David Jacobs Correlation and Convolution Class otes for CMSC 46, Fall 5 David Jacobs Introduction Correlation and Convolution are basic operations that we will perform to extract information from images. They are in

More information

Test for I-DEAS FEATURES APPLICATIONS 83-0056-000 14A TRANSIENT POST-PROCESSING SOFTWARE FOR FIXED SAMPLE ORDER TRACKING

Test for I-DEAS FEATURES APPLICATIONS 83-0056-000 14A TRANSIENT POST-PROCESSING SOFTWARE FOR FIXED SAMPLE ORDER TRACKING 83-0056-000 14A Test for I-DEAS TRANSIENT POST-PROCESSING SOFTWARE FOR FIXED SAMPLE ORDER TRACKING FEATURES Advanced User Interface Providing Ease-of-Use In Post-Processing Time History Data Real-Time

More information

Principles of Digital Communication

Principles of Digital Communication Principles of Digital Communication Robert G. Gallager January 5, 2008 ii Preface: introduction and objectives The digital communication industry is an enormous and rapidly growing industry, roughly comparable

More information

Survey of the Mathematics of Big Data

Survey of the Mathematics of Big Data Survey of the Mathematics of Big Data Philippe B. Laval KSU September 12, 2014 Philippe B. Laval (KSU) Math & Big Data September 12, 2014 1 / 23 Introduction We survey some mathematical techniques used

More information

Linear regression methods for large n and streaming data

Linear regression methods for large n and streaming data Linear regression methods for large n and streaming data Large n and small or moderate p is a fairly simple problem. The sufficient statistic for β in OLS (and ridge) is: The concept of sufficiency is

More information

Possibilities of Automation of the Caterpillar -SSA Method for Time Series Analysis and Forecast. Th.Alexandrov, N.Golyandina

Possibilities of Automation of the Caterpillar -SSA Method for Time Series Analysis and Forecast. Th.Alexandrov, N.Golyandina Possibilities of Automation of the Caterpillar -SSA Method for Time Series Analysis and Forecast Th.Alexandrov, N.Golyandina theo@pdmi.ras.ru, nina@ng1174.spb.edu St.Petersburg State University, Russia

More information

Pulsed Fourier Transform NMR The rotating frame of reference. The NMR Experiment. The Rotating Frame of Reference.

Pulsed Fourier Transform NMR The rotating frame of reference. The NMR Experiment. The Rotating Frame of Reference. Pulsed Fourier Transform NR The rotating frame of reference The NR Eperiment. The Rotating Frame of Reference. When we perform a NR eperiment we disturb the equilibrium state of the sstem and then monitor

More information

Time Series Analysis by Higher Order Crossings. Benjamin Kedem Department of Mathematics & ISR University of Maryland College Park, MD

Time Series Analysis by Higher Order Crossings. Benjamin Kedem Department of Mathematics & ISR University of Maryland College Park, MD Time Series Analysis by Higher Order Crossings Benjamin Kedem Department of Mathematics & ISR University of Maryland College Park, MD 1 Stochastic Process A stochastic or random process {Z t },, 1,0,1,,

More information

Institute of Actuaries of India Subject CT3 Probability and Mathematical Statistics

Institute of Actuaries of India Subject CT3 Probability and Mathematical Statistics Institute of Actuaries of India Subject CT3 Probability and Mathematical Statistics For 2015 Examinations Aim The aim of the Probability and Mathematical Statistics subject is to provide a grounding in

More information

Time series analysis of data from stress ECG

Time series analysis of data from stress ECG Communications to SIMAI Congress, ISSN 827-905, Vol. 3 (2009) DOI: 0.685/CSC09XXX Time series analysis of data from stress ECG Camillo Cammarota Dipartimento di Matematica La Sapienza Università di Roma,

More information

INFERRING TRADING STRATEGIES FROM PROBABILITY DISTRIBUTION FUNCTIONS

INFERRING TRADING STRATEGIES FROM PROBABILITY DISTRIBUTION FUNCTIONS INFERRING TRADING STRATEGIES FROM PROBABILITY DISTRIBUTION FUNCTIONS INFERRING TRADING STRATEGIES FROM PROBABILITY DISTRIBUTION FUNCTIONS BACKGROUND The primary purpose of technical analysis is to observe

More information

4F7 Adaptive Filters (and Spectrum Estimation) Least Mean Square (LMS) Algorithm Sumeetpal Singh Engineering Department Email : sss40@eng.cam.ac.

4F7 Adaptive Filters (and Spectrum Estimation) Least Mean Square (LMS) Algorithm Sumeetpal Singh Engineering Department Email : sss40@eng.cam.ac. 4F7 Adaptive Filters (and Spectrum Estimation) Least Mean Square (LMS) Algorithm Sumeetpal Singh Engineering Department Email : sss40@eng.cam.ac.uk 1 1 Outline The LMS algorithm Overview of LMS issues

More information

Midwest Symposium On Circuits And Systems, 2004, v. 2, p. II137-II140. Creative Commons: Attribution 3.0 Hong Kong License

Midwest Symposium On Circuits And Systems, 2004, v. 2, p. II137-II140. Creative Commons: Attribution 3.0 Hong Kong License Title Adaptive window selection and smoothing of Lomb periodogram for time-frequency analysis of time series Author(s) Chan, SC; Zhang, Z Citation Midwest Symposium On Circuits And Systems, 2004, v. 2,

More information

Lecture 18: The Time-Bandwidth Product

Lecture 18: The Time-Bandwidth Product WAVELETS AND MULTIRATE DIGITAL SIGNAL PROCESSING Lecture 18: The Time-Bandwih Product Prof.Prof.V.M.Gadre, EE, IIT Bombay 1 Introduction In this lecture, our aim is to define the time Bandwih Product,

More information

Time Series Analysis: Introduction to Signal Processing Concepts. Liam Kilmartin Discipline of Electrical & Electronic Engineering, NUI, Galway

Time Series Analysis: Introduction to Signal Processing Concepts. Liam Kilmartin Discipline of Electrical & Electronic Engineering, NUI, Galway Time Series Analysis: Introduction to Signal Processing Concepts Liam Kilmartin Discipline of Electrical & Electronic Engineering, NUI, Galway Aims of Course To introduce some of the basic concepts of

More information

3.5.1 CORRELATION MODELS FOR FREQUENCY SELECTIVE FADING

3.5.1 CORRELATION MODELS FOR FREQUENCY SELECTIVE FADING Environment Spread Flat Rural.5 µs Urban 5 µs Hilly 2 µs Mall.3 µs Indoors.1 µs able 3.1: ypical delay spreads for various environments. If W > 1 τ ds, then the fading is said to be frequency selective,

More information

Modeling Heterogeneous Network Traffic in Wavelet Domain

Modeling Heterogeneous Network Traffic in Wavelet Domain 634 IEEE/ACM TRANSACTIONS ON NETWORKING, VOL. 9, NO. 5, OCTOBER 2001 Modeling Heterogeneous Network Traffic in Wavelet Domain Sheng Ma, Member, IEEE, Chuanyi Ji Abstract Heterogeneous network traffic possesses

More information

Lecture 4: Seasonal Time Series, Trend Analysis & Component Model Bus 41910, Time Series Analysis, Mr. R. Tsay

Lecture 4: Seasonal Time Series, Trend Analysis & Component Model Bus 41910, Time Series Analysis, Mr. R. Tsay Lecture 4: Seasonal Time Series, Trend Analysis & Component Model Bus 41910, Time Series Analysis, Mr. R. Tsay Business cycle plays an important role in economics. In time series analysis, business cycle

More information

Matlab GUI for WFB spectral analysis

Matlab GUI for WFB spectral analysis Matlab GUI for WFB spectral analysis Jan Nováček Department of Radio Engineering K13137, CTU FEE Prague Abstract In the case of the sound signals analysis we usually use logarithmic scale on the frequency

More information

Computational Optical Imaging - Optique Numerique. -- Deconvolution --

Computational Optical Imaging - Optique Numerique. -- Deconvolution -- Computational Optical Imaging - Optique Numerique -- Deconvolution -- Winter 2014 Ivo Ihrke Deconvolution Ivo Ihrke Outline Deconvolution Theory example 1D deconvolution Fourier method Algebraic method

More information

Booth School of Business, University of Chicago Business 41202, Spring Quarter 2015, Mr. Ruey S. Tsay. Solutions to Midterm

Booth School of Business, University of Chicago Business 41202, Spring Quarter 2015, Mr. Ruey S. Tsay. Solutions to Midterm Booth School of Business, University of Chicago Business 41202, Spring Quarter 2015, Mr. Ruey S. Tsay Solutions to Midterm Problem A: (30 pts) Answer briefly the following questions. Each question has

More information

EEG COHERENCE AND PHASE DELAYS: COMPARISONS BETWEEN SINGLE REFERENCE, AVERAGE REFERENCE AND CURRENT SOURCE DENSITY

EEG COHERENCE AND PHASE DELAYS: COMPARISONS BETWEEN SINGLE REFERENCE, AVERAGE REFERENCE AND CURRENT SOURCE DENSITY Version 1, June 13, 2004 Rough Draft form We apologize while we prepare the manuscript for publication but the data are valid and the conclusions are fundamental EEG COHERENCE AND PHASE DELAYS: COMPARISONS

More information

Performing Unit Root Tests in EViews. Unit Root Testing

Performing Unit Root Tests in EViews. Unit Root Testing Página 1 de 12 Unit Root Testing The theory behind ARMA estimation is based on stationary time series. A series is said to be (weakly or covariance) stationary if the mean and autocovariances of the series

More information

LABEL PROPAGATION ON GRAPHS. SEMI-SUPERVISED LEARNING. ----Changsheng Liu 10-30-2014

LABEL PROPAGATION ON GRAPHS. SEMI-SUPERVISED LEARNING. ----Changsheng Liu 10-30-2014 LABEL PROPAGATION ON GRAPHS. SEMI-SUPERVISED LEARNING ----Changsheng Liu 10-30-2014 Agenda Semi Supervised Learning Topics in Semi Supervised Learning Label Propagation Local and global consistency Graph

More information

Network Traffic Characterization using Energy TF Distributions

Network Traffic Characterization using Energy TF Distributions Network Traffic Characterization using Energy TF Distributions Angelos K. Marnerides a.marnerides@comp.lancs.ac.uk Collaborators: David Hutchison - Lancaster University Dimitrios P. Pezaros - University

More information

Voltage. Oscillator. Voltage. Oscillator

Voltage. Oscillator. Voltage. Oscillator fpa 147 Week 6 Synthesis Basics In the early 1960s, inventors & entrepreneurs (Robert Moog, Don Buchla, Harold Bode, etc.) began assembling various modules into a single chassis, coupled with a user interface

More information

AN1200.04. Application Note: FCC Regulations for ISM Band Devices: 902-928 MHz. FCC Regulations for ISM Band Devices: 902-928 MHz

AN1200.04. Application Note: FCC Regulations for ISM Band Devices: 902-928 MHz. FCC Regulations for ISM Band Devices: 902-928 MHz AN1200.04 Application Note: FCC Regulations for ISM Band Devices: Copyright Semtech 2006 1 of 15 www.semtech.com 1 Table of Contents 1 Table of Contents...2 1.1 Index of Figures...2 1.2 Index of Tables...2

More information

Solutions to Exam in Speech Signal Processing EN2300

Solutions to Exam in Speech Signal Processing EN2300 Solutions to Exam in Speech Signal Processing EN23 Date: Thursday, Dec 2, 8: 3: Place: Allowed: Grades: Language: Solutions: Q34, Q36 Beta Math Handbook (or corresponding), calculator with empty memory.

More information

(2) (3) (4) (5) 3 J. M. Whittaker, Interpolatory Function Theory, Cambridge Tracts

(2) (3) (4) (5) 3 J. M. Whittaker, Interpolatory Function Theory, Cambridge Tracts Communication in the Presence of Noise CLAUDE E. SHANNON, MEMBER, IRE Classic Paper A method is developed for representing any communication system geometrically. Messages and the corresponding signals

More information

Quarterly Progress and Status Report. Measuring inharmonicity through pitch extraction

Quarterly Progress and Status Report. Measuring inharmonicity through pitch extraction Dept. for Speech, Music and Hearing Quarterly Progress and Status Report Measuring inharmonicity through pitch extraction Galembo, A. and Askenfelt, A. journal: STL-QPSR volume: 35 number: 1 year: 1994

More information

Springer Texts in Statistics

Springer Texts in Statistics Springer Texts in Statistics Series Editors G. Casella S. Fienberg I. Olkin For other titles published in this series, go to www.springer.com/series/417 Robert H. Shumway David S. Stoffer Time Series

More information

COMP6053 lecture: Time series analysis, autocorrelation. jn2@ecs.soton.ac.uk

COMP6053 lecture: Time series analysis, autocorrelation. jn2@ecs.soton.ac.uk COMP6053 lecture: Time series analysis, autocorrelation jn2@ecs.soton.ac.uk Time series analysis The basic idea of time series analysis is simple: given an observed sequence, how can we build a model that

More information

DDS. 16-bit Direct Digital Synthesizer / Periodic waveform generator Rev. 1.4. Key Design Features. Block Diagram. Generic Parameters.

DDS. 16-bit Direct Digital Synthesizer / Periodic waveform generator Rev. 1.4. Key Design Features. Block Diagram. Generic Parameters. Key Design Features Block Diagram Synthesizable, technology independent VHDL IP Core 16-bit signed output samples 32-bit phase accumulator (tuning word) 32-bit phase shift feature Phase resolution of 2π/2

More information

INTRODUCTION TO GEOSTATISTICS And VARIOGRAM ANALYSIS

INTRODUCTION TO GEOSTATISTICS And VARIOGRAM ANALYSIS INTRODUCTION TO GEOSTATISTICS And VARIOGRAM ANALYSIS C&PE 940, 17 October 2005 Geoff Bohling Assistant Scientist Kansas Geological Survey geoff@kgs.ku.edu 864-2093 Overheads and other resources available

More information

Assessment Plan for Learning Outcomes for BA/BS in Physics

Assessment Plan for Learning Outcomes for BA/BS in Physics Department of Physics and Astronomy Goals and Learning Outcomes 1. Students know basic physics principles [BS, BA, MS] 1.1 Students can demonstrate an understanding of Newton s laws 1.2 Students can demonstrate

More information

3. Interpolation. Closing the Gaps of Discretization... Beyond Polynomials

3. Interpolation. Closing the Gaps of Discretization... Beyond Polynomials 3. Interpolation Closing the Gaps of Discretization... Beyond Polynomials Closing the Gaps of Discretization... Beyond Polynomials, December 19, 2012 1 3.3. Polynomial Splines Idea of Polynomial Splines

More information

Jeff Thomas Tom Holmes Terri Hightower. Learn RF Spectrum Analysis Basics

Jeff Thomas Tom Holmes Terri Hightower. Learn RF Spectrum Analysis Basics Jeff Thomas Tom Holmes Terri Hightower Learn RF Spectrum Analysis Basics Learning Objectives Name the major measurement strengths of a swept-tuned spectrum analyzer Explain the importance of frequency

More information

Research Article Time-Frequency Analysis of Horizontal Vibration for Vehicle-Track System Based on Hilbert-Huang Transform

Research Article Time-Frequency Analysis of Horizontal Vibration for Vehicle-Track System Based on Hilbert-Huang Transform Hindawi Publishing Corporation Advances in Mechanical Engineering Volume 3, Article ID 954, 5 pages http://dx.doi.org/.55/3/954 Research Article Time-Frequency Analysis of Horizontal Vibration for Vehicle-Track

More information

SWISS ARMY KNIFE INDICATOR John F. Ehlers

SWISS ARMY KNIFE INDICATOR John F. Ehlers SWISS ARMY KNIFE INDICATOR John F. Ehlers The indicator I describe in this article does all the common functions of the usual indicators, such as smoothing and momentum generation. It also does some unusual

More information

Chapter 5: Bivariate Cointegration Analysis

Chapter 5: Bivariate Cointegration Analysis Chapter 5: Bivariate Cointegration Analysis 1 Contents: Lehrstuhl für Department Empirische of Wirtschaftsforschung Empirical Research and und Econometrics Ökonometrie V. Bivariate Cointegration Analysis...

More information

EECS 556 Image Processing W 09. Interpolation. Interpolation techniques B splines

EECS 556 Image Processing W 09. Interpolation. Interpolation techniques B splines EECS 556 Image Processing W 09 Interpolation Interpolation techniques B splines What is image processing? Image processing is the application of 2D signal processing methods to images Image representation

More information