Iroduio o Saisial Aalysis of Time Series Rihard A. Davis Deparme of Saisis Oulie Modelig obeives i ime series Geeral feaures of eologial/eviromeal ime series Compoes of a ime series Frequey domai aalysis-he sperum Esimaig ad removig seasoal ompoes Oher ylial ompoes Puig i all ogeher
Time Series: A olleio of observaios x, eah oe beig reorded a ime. (Time ould be disree,,,3,, or oiuous > 0.) Obeive of Time Series Aalaysis Daa ompressio -provide ompa desripio of he daa. Explaaory -seasoal faors -relaioships wih oher variables (emperaure, humidiy, polluio, e) Sigal proessig -exraig a sigal i he presee of oise Prediio -use he model o predi fuure values of he ime series
Geeral feaures of eologial/eviromeal ime series Examples.. Maua Loa (CO,, O `58-Sep `90) CO 30 330 340 350 960 970 980 990 Feaures ireasig red (liear, quadrai?) seasoal (mohly) effe. 3
. Ave-max mohly emp (vegeaioudra,, 895-993) emp -5 0 5 0 5 0 0 00 400 600 800 000 00 Feaures seasoal (mohly effe) more variabiliy i Ja ha i July Go o ITSM Demo 4
emp -5 0 5 0 5 0 July: mea.95, var.6305 Ja : mea -.486, var.637 0 0 40 60 80 00 emp 5 6 7 8 9 0 Sep : mea 7.5, var.466 Lie: 6.83 +.00845 0 0 40 60 80 00 5
Compoes of a ime series Classial deomposiio X m + s + Y m red ompoe (slowly hagig i ime) s seasoal ompoe (kow period d4(hourly), d(mohly)) Y radom oise ompoe (migh oai irregular ylial ompoes of ukow frequey + oher suff). Go o ITSM Demo 6
Esimaio of he ompoes. X m + s + Y Tred m filerig. E.g., for mohly daa use mˆ (.5x 6 + x 5 + + x + 5 +.5x + 6) / polyomial fiig m ˆ a + a + + 0 a k k 7
Esimaio of he ompoes (o). Seasoal s X m + s + Y Use seasoal (mohly) averages afer deredig. (sadardize so ha s sums o 0 aross he year. sˆ ( x + x + + x+ 4 ) / N, N umber of years harmoi ompoes fi o he ime series usig leas squares. ˆ s π Aos( ) + π Bsi( ) Irregular ompoe Y Yˆ X mˆ sˆ 8
x s s 0 3 π0 π0 (os( ),, os( 6) )'/sqr(6) 6 6 π π (os( ),, os( 6) )' /sqr(3) 6 6 π π (si( ),, si ( 6) )' /sqr(3) 6 6 π π (os( ),,os( 6))'/sqr(3) 6 6 π π (si( ),, si( 6) )'/sqr(3) 6 6 π π (os( ),,os( 6))'/sqr(6 The sperum ad frequey domai aalysis Toy example. (6) 0 s s 3 X(4.4, 3.6, -3.4, -3.4, 0.739, 3.04) 0 +5( +s )-.5( +s )+.5 3 9
0 Fa: Ay veor of 6 umbers, x (x,..., x 6 ) a be wrie as a liear ombiaio of he veors 0,,, s, s, 3. More geerally, ay ime series x (x,..., x ) of legh (assume is odd) a be wrie as a liear ombiaio of he basis (orhoormal) veors 0,,,, [/], s, s,, s [/]. Tha is, ] / [, 0 0 m b a b a a m m m m + + + + s s x ω ω ω ω ω ω ) si( ) si( ) si(, ) os( ) os( ) os(, / / / 0 s
Properies:. The se of oeffiies {a 0, a, b, } is alled he disree Fourier rasform ] / [, 0 0 m b a b a a m m m m + + + + s s x ω ω x b x a x a / / / / / 0 0 ) si( ), ( ) os( ), ( ), ( s x x x
. Sum of squares. x a 0 + m ( a + ) b 3. ANOVA (aalysis of variae able) Soure DF Sum of Squares Periodgram ω 0 a 0 I(ω 0 ) ω π/ a + b I(ω ) ω m πm/ a m + b m I(ω m ) x
Applied o oy example Soure DF Sum of Squares ω 0 0 (period 0) a 0 4.0 ω π/6 (period 6) a + b 50.0 ω π/6 (period 3) a + b 4.5 ω 3 π3/6 (period ) a 3 0.5 6 58.75 Tes ha period 6 is sigifia H 0 : X µ + ε, {ε } ~ idepede oise H : X µ + A os (π/6) + B si (π/6) + ε Tes Saisi: (-3)I(ω )/(Σ x -I(0)-I(ω )) ~ F(,-3) (6-3)(50/)/(58.75-4-50)5.79 p-value.003 x 3
The sperum ad frequey domai aalysis Ex. Siusoid wih period. x π π 5 os( ) + 3si( ),,,,0. Ex. Siusoid wih periods 4 ad. Ex. Maua Loa ITSM DEMO 4
Differeig a lag Someimes, a seasoal ompoe wih period i he ime series a be removed by differeig a lag. Tha is he differeed series is x y x x Now suppose x is he siusoid wih period + oise. The π π 5 os( ) + 3si( ) + ε,,,,0. y x x ε ε whih has orrelaio a lag. 5
Oher ylial ompoes; searhig for hidde yles Ex. Suspos. period ~ π/.66840.0 years Fisher s es sigifiae Wha model should we use? ITSM DEMO 6
Noise. The ime series {X } is whie or idepede oise if he sequee of radom variables is idepede ad ideially disribued. x_ - 0 4 0 0 40 60 80 00 0 ime Baery of ess for hekig whieess. I ITSM, hoose saisis > residual aalysis > Tess of Radomess 7
Residuals from Maua Loa daa. x_{+} x_{+} x_{+} -.0-0.5 0.0 0.5.0.5 -.0-0.5 0.0 0.5.0.5 -.0-0.5 0.0 0.5.0.5 Cor(X, X +5 ).074 r r + + + +5 -.9 -.4 -.5 -.3 -.4 -.5 -.3 -.3.04 3 -.5 -.3 -.3.0 4 -.3 -.3 -.0.47 Cor(X Cor(X, Cor(X, X +3 ) + ).654.736, X + ).84 -.0-0.5 0.0 0.5.0.5 -.0-0.5 0.0 0.5.0.5 -.0-0.5 0.0 x_ 0.5.0.0.5.5 x_ x_ 8
Auoorrelaio fuio (ACF): ACF 0.0 0. 0.4 0.6 0.8.0 Maua Loa residuals Cof Bds: ±.96/sqr() 0 0 0 30 40 ACF -0. 0.0 0. 0.4 0.6 0.8.0 lag whie oise 0 0 0 30 40 lag 9
irregular par -.0 0.0.0 seasoal -3-3 red 30 340 CO 30 340 Puig i all ogeher Example: Maua Loa 960 970 980 990 960 970 980 990 960 970 980 990 960 970 980 990 0
Sraegies for modelig he irregular par {Y }. Fi a auoregressive proess Fi a movig average proess Fi a ARMA (auoregressive-movig average) proess I ITSM, hoose he bes fiig AR or ARMA usig he meu opio Model > Esimaio > Prelimiary > AR esimaio or Model > Esimaio > Auofi
How well does he model fi he daa?. Ispeio of residuals. Are hey ompaible wih whie (idepede) oise? o diserible red o seasoal ompoe variabiliy does o hage i ime. o orrelaio i residuals or squares of residuals Are hey ormally disribued?. How well does he model predi. values wihi he series (i-sample foreasig) fuure values 3. How well do he simulaed values from he model apure he haraerisis i he observed daa? ITSM DEMO wih Maua Loa
Model refieme ad Simulaio Residual aalysis a ofe lead o model refieme Do simulaed realizaios refle he key feaures prese i he origial daa Two examples Suspos NEE (Ne eosysem exhage). Limiaios of exisig models Seasoal ompoes are fixed from year o year. Saioary hrough he seasos Add ierveio ompoes (fores fires, volai erupios, e.) 3
Oher direios Sruural model formulaio for red ad seasoal ompoes Loal level model m m - + oise Seasoal ompoe wih oise s s - s -... s - +oise X m + s + Y + ε Easy o add ierveio erms i he above formulaio. Periodi models (allows more flexibiliy i modelig rasiios from oe seaso o he ex). 4