Using the IEA IDB Analyzer II Andrés Sandoval-Hernández IEA DPC Workshop on using PISA, PIAAC, TIMSS & PIRLS, TALIS datasets Ispra, Italy- June 24-27, 2014 Note: These slides were prepared as part of the IEA training portfolio with the collaboration of IEA staff and resource persons. 1
How Do We Make Sense of All This Data?! 1 part patience 1 part know-how and the IEA IDB Analyzer! 2
Table of contents Percentages and means with PISA Without PV s With PV s Percentages only with TALIS 2013 3
Immigration status and wealth What is the percentage of native, first generation, and second generation immigrant students and the mean of the wealth index associated to each category? Variables of interest Native First Generation Second Generation IMMIG WEALTH 4
What Do we Need to Do? Analysis for IMMIG Start the IDB Analyzer Analysis module using PISA_Merged.sav under C:\EU_Workshop\Work Countries in the merged data file: Austria Denmark Netherlands Slovak Republic Spain 5
Analysis: Percentages and Means (PISA) Analysis File: C:\EU_Workshop\Work\PISA_Merged.sav Analysis Type: PISA age 15 (Using Student Weights) Statistic Type: Percentages and Means Plausible Value Option: None used Grouping Variable CNT, IMMIG Analysis Variable: WEALTH Weighting variable: W_FSTUWT 6
IDB Analyzer: Percentages and Means C:\EU_Workshop\Work\PISA_Merged.sav PISA age 15 (Using Student Weights) Percentages and Means Exclude Missing from Analysis CNT IMMIG WEALTH W_FSTUWT C:\EU_Workshop\Work\Immig.* 7
IDB Analyzer: Percentages and Means 8
Outcome As a result IDB Analyzer creates the following in the working directory (C:\EU_Workshop\Work): SPSS Syntax file contains the syntax with the commands SPSS Data file contains statistics from the analysis MS Excel Output file contains statistics from the analysis 9
SPSS: Output 10
SPSS: Excel Output List of countries Analysis variable used WEALTH Number of students Final student weight contains estimates in the population that belong to the groups defined by the classification variables (CNT, IMMIG) 11
SPSS: Excel Output Weighted percentage of students for the groups defined by the classification variables (CNT, IMMIG) Standard error of the percentages 12
SPSS: Excel Output Mean of the analysis variable Standard error of the mean of the analysis variable Standard deviation of the analysis variable 13
SPSS: Excel Output Standard error of the standard deviation Percent of cases within the group with missing values for the analysis variable 14
Table of contents Percentages and means with PISA Without PV s With PV s Percentages only with TALIS 2013 15
Immigration status and math achievement What is the percentage of native, first generation, and second generation immigrant students and the mean achievement in math associated to each category? IMMIG PV1MATH01-05 Variables of interest 16
What Do we Need to Do? Analysis for IMMIG Start the IDB Analyzer Analysis module using PISA_Merged.sav under C:\EU_Workshop\Work Countries in the merged data file: Austria Denmark Netherlands Slovak Republic Spain 17
Analysis: Percentages and Means with PV s (PISA) Analysis File: C:\EU_Workshop\Work\PISA_Merged.sav Analysis Type: PISA age 15 (Using Student Weights) Statistic Type: Percentages and Means Plausible Value Option: Use PVs Grouping Variable CNT, IMMIG Plausible Value: PV1MATH01-05 Weighting variable: W_FSTUWT 18
IDB Analyzer: Percentages and Means with PV s C:\EU_Workshop\Work\PISA_Merged.sav PISA age 15 (Using Student Weights) Percentages and Means Use PV s Exclude Missing from Analysis CNT IMMIG PVMATH01-05 W_FSTUWT C:\EU_Workshop\Work\Immig_math.* 19
IDB Analyzer: Percentages and Means with PV s 20
Outcome As a result IDB Analyzer creates the following in the working directory (C:\EU_Workshop\Work): SPSS Syntax file contains the syntax with the commands SPSS Data file contains statistics from the analysis MS Excel Output file contains statistics from the analysis 21
IDB Analyzer: Percentages and Means with PV s 22
SPSS: Excel Output List of countries Analysis variable used PVMATH Number of cases Final student weight contains estimates in the population that belong to the groups defined by the classification variables (CNT, IMMIG) 23
SPSS: Excel Output Weighted percentage of students for the groups defined by the classification variables (CNT, IMMIG) Standard error of the percentages 24
SPSS: Excel Output Mean of the analysis variable Standard error of the mean of the analysis variable Standard deviation of the analysis variable 25
Table of contents Percentages and means with PISA Without PV s With PV s Percentages only with TALIS 2013 26
Standards in evaluations for assessing student progress How frequently do teachers work together with other teachers at the same school to ensure common standards in evaluations for assessing student progress? TT2G33F Variable of interest Teacher Questionnaire, Q33-F, p. 19 27
What Do we Need to Do? Analysis for TT2G33F Start the IDB Analyzer Analysis module using TALIS_Merged under C:\EU_Workshop\Work Countries in the merged data file: Denmark Netherlands Italy Slovak Republic Spain 28
Analysis: Percentages only (TALIS) Analysis File: C:\EU_Workshop\Work\TALIS_Merged.sav Analysis Type: TALIS 2013 Single Level Population (Using Teacher Weights) TALIS 2013 Single Level/Population (Using Teacher Weights) Statistic Type: Percentages only Grouping Variables: IDCNTRY, TT2G33F 29
IDB Analyzer: Percentages only C:\EU_Workshop\Work\TALIS_Merged.sav TALIS 2013 Single Level/Population (Using Teacher Weights) Percentages only Exclude Missing from Analysis IDCNTRY TT2G33F TCHWGT C:\EU_Workshop\Work\A1WorksWithTeachers.* 30
SPSS: Run the analysis As a result IDB Analyzer creates SPSS Syntax and starts SPSS In SPSS Syntax, highlight all and click on the Run button 31
Outcome As a result IDB Analyzer creates the following in the working directory (C:\EU_Workshop\Work): SPSS Syntax file contains the syntax with the commands SPSS Data file contains statistics from the analysis MS Excel Output file contains statistics from the analysis 32
SPSS: Output 33
SPSS: Excel Output List of countries Variable name and Value Labels Number of teachers in each group 34
SPSS: Excel Output Total teacher weight contains estimates in the population that belong to the group defined by the classification variables (IDCNTRY, TT2G33F) Weighted percentage of teachers for the groups defined by the classification variables (IDCNTRY, TT2G33F) 35
SPSS: Excel Output Standard error of percentages 36
Any Questions? Thank you for your attention! 37