TACC Taiwan Analysis Center for COSMIC Five Years Achievements Mark Cheng, Ho-Fang Tsai, Tiffany Ho, Jason Lin, Base Hsu Central Weather Bureau, Meteorological R&D Center 2011/5/3 TACC Five years Achievement Mark Cheng 1
FS3/COSMIC data communication and processing systems S band S band TT&C FORMOSAT-3 6-Satellite Constellation Operations RGS MMC NSPO/RGS S/S band RTS Kiruna RTS Fairbanks L band UHF/VHF 24 GPS S/C RT Fiducial Network NSPO/SCIENCE RT SOH Backup Command TACC(CWB) Taiwan Analysis Center for COSMIC Science data NMC USN TBB Stations (optional) CDAAC COSMIC Data Analysis and Archive Center (UCAR) Universities & Science Teams NSPO Science Research Program Domestic & International Users U.S. Universities & Mission Teams UCAR Science Center U.S. Users Courtesy : NSPO 2011/5/3 TACC Five years Achievement Mark Cheng 2
Expected Role TACC Roles Require communication link to all data providers, can fully take over CDAAC s function 1. Stand alone site, can fully backup CDAAC s function Full FS3/COSMIC data acquisition and processing functions ( Require multi-point connection to all low level data sites) Basic Role 2. Perform scientific processing and data service/archive CDAAC s scientific data processing functions ( Require single-point connection to CDAAC) Require link to CDAAC, but if CDAAC goes down TACC goes down as well 3. Perform data service/archive only Receive CDAAC s all level data/products and perform data redistribution 2011/5/3 TACC Five years Achievement Mark Cheng 3
TACC Context Diagram Toward Full function peer site CWB Forecast systems Global Users WEB data service TACC products web data RT and PP raw data FTP HTTP NSPO & GSP-ARC DVD All data i TACC Fetching high level data CDAAC FTP all data CWB MSS Archive Archive All data TBB data NCU Ion. Science team Software release itacc data ingest 2011/5/3 TACC Five years Achievement Mark Cheng 4
TACC activities in last 5 years (1/3) Year CDAAC version and updates 2005 CDAAC 1.10 (Nov. installed 138 packages) 2006 April launch CDAAC 1.10 (10 updates --130 packages) 2007 CDAAC 1.10 ( 5 updates --49 packages) CDAAC 2.00 (Oct. installed 160 packages) + (3 updates --3 packages) TACC-CDAAC Collaboration CDAAC technique transfer and CDAAC software installation support Strengthen RT level 0 data transfer between CDAAC and TACC FS3/COSMIC data User application procedure Level 0 data ingest subsystem reorganize. Analyze production status of devices, data ingest, process flow, messages, logs, for system monitor Automation. TACC local activities (development and/or operation) TACC hardware establishment TACC website online RT operation check out & SOP CWB NWP & forecast data service Start TACC RT FS3/COSMIC data processing and data service Write TACC system documents Local data archive and service function development TACC 64bits PP HW upgrade and start PP processing & provision CDAAC1.10/2.00 atmospheric / ionospheric RO profiles product comparison Production activities & messages monitoring subsystem prototype 2011/5/3 TACC Five years Achievement Mark Cheng 5
TACC activities in last 5 years (2/3) Year CDAAC version and updates 2008 CDAAC 2.00 (9 updates --109 packages) 2009 CDAAC 2.00 (6 updates --85 packages) TACC/CDAAC Collaboration scientific data processing algorithm discussion and documentation ground based GPS receiver ZTD algorithm comparison and GPS-PW system prototype COSMIC parser rewrite & document refine Bernese package update TACC local activities (development and/or operation) TACC web data users statistics (awstat) itacc level 0 data ingest subsystem prototype Shin-Wu GPS site install (for RT-IGS) ACE (Automatic Control Environment ) online RTMSS (Real Time Monitoring and Statistic System) online RT-IGS data exchange with NRCan EUMETSAT fiducial data exchange Wu-Fan GPS bitarc backup site online itacc RT production verification CWB global/local ZTD system prototype HA tune up & data apl. web security 7/22 Total Solar Eclipse web service 2011/5/3 TACC Five years Achievement Mark Cheng 6
TACC activitiess in last 5 years (3/3) Year CDAAC version and updates 2010 CDAAC 2.00 (2 updates --21 packages) CDAAC 3.00 ( Nov. installed 100 packages) 2011 CDAAC 3.00 (2 updates --3 packages) TACC/CDAAC Collaboration CDAAC 3.00 installation process study and test Multithread Data transfer mechanism development CDAAC web user statistic calculation CDAAC web user statistic calculation FS7/C2 DPC discussion TACC local activities (development and/or operation) TACC atm./ion. high-level product online (850mb-T/RH, ion. ETC, 200~400km ED, Global/local ZTD) TACC FTP service online CWB global/taiwan ZTD online itacc RT/PP processing online bitarc site and sky coverage survey NSPO & GPSARC installation support FS7/C2 DPC discussion itaccgrace & SACC NRT proc. test Global plasmasphere mapping ECMWF model data ingest FS3/COSMIC data user publication registration web page itacc HA design and test FS7/C2 DPC discussion 2011/5/3 TACC Five years Achievement Mark Cheng 7
TACC Hard Ware Architecture Router Science Team users CDAAC data sources L7 (TACCIT1) TACCRD1 TACCRD2 TACCRD3 TACCIT2 3.5T RAID 3.5T RAID TACCIO1 TACCGPS1 TACCIT3 TACCIO2 TACCRD4 Research & Development Backup I/O Primary I/O TACC GPS ACE 12T RAID itacc RT TACCIP1 TACCACE1 TACCPP1 TACCSV4 TACCSV5 TACCGPS2 TACCOP1G TACCPP2 Post-Processing cluster Backup real-time process cluster Primary real-time process cluster Tape Library 2011/5/3 TACCIP3 TACCOP2G itacc PP MSS Server DVD TACCIP2 TACCOP3G TACCUDI CWB TACCOP4G Archive TACC Five years Achievement ZTD Mark Cheng Users 8
TACC 3.00 Data Flow Diagram 2.0 Ground data process 5.0 P5 Ionospheric occ. process 10.0 Fetch raw data 1.0 Process management raw data 3.0 P3 GPS orbit process 4.0 P4 LEO data process Intermediate data 7.0 P7 TIP data process High-level data 6.0 P6 Atmospheric occ. process Data Base 11.0 Monitor System 12.0 System management 13.0 Science R & D 8.0 Data delivery & Archive CWB Model Taiwan Science Team Data Archive raw data Intermediate data High-level data 9.0 Web service Global Users 2011/5/3 TACC Five years Achievement Mark Cheng 9
TACC Daily Atmospheric and Ionospheric occultation profiles in Real-Time and Post Processing Real-Time profiles Atm : >2.5 million (2006 April-2011 March) 2011 March) Ion Ion : >2.6 million PP data online Atm : > 2.6 million (2006 Apr.- 2010 Nov.) 2010 Nov.) Ion : Ion : > 2.6 million 3000 2500 2000 1500 1000 Atmospheric Profile RT : 2,594,783 PP : 2,619672 Occultations per day 500 0 2006.269 2006.298 2006.327 2006.356 2007.020 2007.049 2007.078 2007.107 2007.136 2007.165 2007.194 2007.223 2007.252 2007.281 2007.310 2007.339 2008.003 2008.032 2008.061 2008.090 2008.119 2008.148 2008.177 2008.206 2008.235 2008.264 2008.293 2008.322 2008.351 2009.014 2009.043 2009.072 2009.101 2009.130 2009.159 2009.188 2009.217 2009.246 2009.275 2009.304 2009.333 2009.362 2010.026 2010.055 2010.084 2010.113 2010.142 2010.171 2010.200 2010.229 2010.258 2010.287 2010.316 2010.345 2011.009 2011.038 2011.067 3500 3000 2500 2000 1500 1000 500 Ionospheric Profile RT: 2,630,454 PP:2,688,098 0 2006.111 2006.143 2006.175 2006.207 2006.239 2006.271 2006.303 2006.335 2007.002 2007.034 2007.066 2007.098 2007.130 2007.162 2007.194 2007.226 2007.258 2007.290 2007.322 2007.354 2008.021 2008.053 2008.085 2008.117 2008.149 2008.181 2008.213 2008.245 2008.277 2008.309 2008.341 2009.007 2009.039 2009.071 2009.103 2009.135 2009.167 2009.199 2009.231 2009.263 2009.295 2009.327 2009.359 2010.026 2010.058 2010.090 2010.122 2010.154 2010.186 2010.218 2010.250 2010.282 2010.314 2010.346 2011.013 2011.045 2011.077 Occultations per day 2011/5/3 TACC Five years Achievement Mark Cheng 10
Distribution of FORMOSAT-3 Global Users Korea:34 Vietnam:18 Indonesia:24 Japan:59 TOP 10 Germany:39 6 Canada:37 China:102 U.K. :36 1 Korea:34 U.S.A.:514 Australia:25 Russia:32 Others:44 India:156 Taiwan:207 4 2 Asia 669 users Taiwan:207 5 Japan :59 China:102 44% Europe& India :156 3 1508 FORMOSAT-3 users span on 55 countries. (~2011 March) America 602 users 40% Africa 237 users Spain:10 Austria:14 Others:58 France:22 brasil:28 Canada:37 others:23 Germany:39 Russia:32 U.S.A.:514 Italy:26 U.K.:36 2011/5/3 TACC Five years Achievement Mark Cheng 11 16%
How users will use FORMOSAT-3 data Other Undergraduate Graduate Education Hydrology Gravity Climate Space weather Weather Use in non-real time LDM feed requested 122(8%) 206(14%) 172(11%) 190(13%) 76(5%) 441(29%) 585(39%) 621(41%) 695(46%) 1056(70%) ~ 26 new users per month (2006) 62 289 (2009) 45 38 27 374 280(2007) 280 (2008) 44 31 48 49 30 35 21 33 289 271 271 241(2010) 241 53 (2011) 37 36 38 20 21 21 23 24 21 22 24 26 31 34 19 23 27 21 22 23 27 22 21 24 15 14 17 16 19 14 16 21 24 16 20 23 25 28 12 15 18 21 25 23 18 14 12 12 2011/5/3 TACC Five years Achievement Mark Cheng 12
Most Popular Downloaded file types on TACC avnprf atmphs ionphs leoatt scnlv1 podtec podobs atmprf ionprf wetprf 2736035(7GB) 3062039(2919GB) 3310282 ( 299G) 4171191 (252GB) 5081282(174GB) 5203723 (479GB) 6213924(720GB) 15185710(5906GB) 15241039 (169GB) Real-time data 108 million files 11 TB 47157762 (651GB) ncpprf podobs podtec ecmprf ionphs scnlv1 atmprf ionprf 1507382(4GB) 1687677(45011GB) 2100149(114GB) 2997417(8GB) 6522080(995GB) 17616627 (765GB) Post-Process 109 million files 56 TB 21563367(8112GB) 25391674 (293GB) 27770816 wetprf (368GB) 13 2011/5/3 TACC Five years Achievement Mark Cheng 13
FS3/COSMIC user behavior on TACC web & ftp server 3 month 6 Month 12 month 24 month Activeness 67 103 177 270 inactiveness 1441 1405 1331 1238 dormancy 203 167 93 X (1) Activeness : How many users have logged in to TACC Web or FTP in the latest 3 / 6 / 12 / 24 month (2) Inactiveness : How many users have not logged in to TACC Web or FTP in the latest 3/ 6 /12/ 24 month (3) Dormancy : Some users have been login to TACC in the past,but the latest 3/ 6 / 12 month did not login to TACC Web or FTP site. Last 3 month Last 6 month Last 12 month Consistency 16 10 8 (4) Consistency : In the last 3/ 5/ 12 month, how many users login to TACC Web or FTP sites every month 1-3 months 4-6 months 7-9 months 10-12 months frequency 137 19 7 14 (5) Frequency : In the past 12 month, how frequency are users login to TACC Web or FTP site 2011/5/3 TACC Five years Achievement Mark Cheng 14
High Level Products on TACC web Last 24 hours Space and Atmospheric weather observe via FORMOSAT-3 2011/5/3 TACC Five years Achievement Mark Cheng 15
Ionospheric TEC Map and Electron Density 400 km 350 km 300 km 250 km 200 km 2011/5/3 TACC Five years Achievement Mark Cheng 16
Global Temperature and Relative Humidity at 850 hpa 2011/5/3 TACC Five years Achievement Mark Cheng 17
Global and Taiwan ZTD Maps Taiwan 2011/5/3 TACC Five years Achievement Mark Cheng 18
FS3/COSMIC Data User Publications http://tacc.cwb.gov.tw/ref/ref.cgi Share your research Search by Author, Title and Publication 2011/5/3 TACC Five years Achievement Mark Cheng 19
To collaborate with CDAAC-UCAR-NOAA-NSPO-GPSARC Be ready for FS7/C2 TDPC Questions? Comments? Suggestions? 2011/5/3 TACC Five years Achievement Mark Cheng 20