Educational History. Professional Experience

Transcription

1 Amanda E. Ferster 121 Cedar Rock Trace Athens, GA Educational History 2013 Ph.D., in Educational Psychology Focus: Quantitative Methods University of Georgia 1998 M.Ed., in Educational Psychology Focus: School Psychology Edinboro University of Pennsylvania 1997 B.A. in Psychology Edinboro University of Pennsylvania Professional Experience 2014-Present Assistant Director, Georgia Center for Assessment, University of Georgia, Athens, GA Lead the Evaluation, Measurement, and Reporting & Design Division of the Georgia Center for Assessment through the management of psychometric, data management, and reporting components of large-scale assessment contracts. Serve as the Principal Investigator for contracts through development of Scope of Work(s), project budgeting, milestone monitoring, operational psychometrics, programming, and supervision of division staff Assistant Research Scientist, Georgia Center for Assessment, University of Georgia, Athens, GA Program Manager of the Georgia Criterion-Referenced Competency Tests-Modified Assessment Program. In this role, I coordinated the activities of the test development, psychometric, production and administrative teams; ensured the quality of psychometric and test development deliverables; collaborated with sub-contractors; and facilitated program workshops and meetings. Program Manager of the Georgia Student Growth Model Report for Parents Program. In this role, I collaborated with the Georgia Department of Education regarding program milestones and evaluation instruments and assisted the Georgia Center for Assessment design team through data management, quality assurance, and program supervision. A.E. Ferster 1

2 Psychometrician I, Center for Educational Testing & Evaluation, The University of Kansas, Lawrence, KS Served as a member of the psychometric and test development teams for the Dynamic Learning Maps Consortium. Dynamic Learning Maps is a next-generation alternate assessment system with online operational administration slated for the academic year. In this position, I recommended scoring strategies for Technology Enhanced Item Types (TEIs); developed pilot and field test plans; initiated the development of the program s validity arguments and plan to collect evidence; collaborated with team on cognitive laboratory planning and protocol development; collaborated with the technology team to ensure program needs were met within the assessment delivery system and the implementation of the student Personal Needs and Preferences Profile (PNP) component of the Accessible Portable Item Protocol (APIP); assisted content staff in developing item-writing guidelines and the assessment content distribution; and presented assessment system progress, plans, and technical issues to state members and advisory committees Research Professional III, Georgia Center for Assessment, University of Georgia, Athens, GA Conducted psychometric analyses for the Georgia state-wide Alternate Assessment based on Modified Achievement Standards (AA-MAS) the GA CRCT-M (i.e., calibration, equating, differential item functioning, and classical item analyses); recommended assessment development procedures to client (i.e., established sampling methodology, psychometric operational form guidelines, and equating plans); authored chapters of the CRCT-M Standard Setting Report and the Operational Technical Manual; assisted in the instruction and supervision of interim psychometric staff and graduate assistants, managed the reporting of the high-stakes Gwinnett Gateway Assessment program; served as an advisor to project coordinators and content specialists during form development; generated user-interface programs to facilitate assessment activities (i.e., Visual Basic rater scanning, Visual Basic for Applications form development, and Production Facility cut score impact projection programs); and presented the technical aspects of programs to Technical Advisory Committees Assessment Specialist, Assessment Research & Development, Georgia Department of Education, Atlanta, GA Replicated service providers psychometric analyses and reporting programs for quality assurance (i.e., pre-equating, scaling tables, and data management routines); served as a resource during assessment development activities (i.e., provided support to team during item/data review, standard setting, and vertical articulation); collaborated with serviceproviders on scan, scoring, and reporting procedures; produced user-interface analysis programs for local staff, generated electronic aggregations and performance briefs; and conducted assessment research as requested by state leadership. A.E. Ferster 2

3 School Improvement Specialist, School Improvement, Georgia Department of Education, Atlanta, GA Developed assessment reporting programs, instructional publications, and training modules for local educational agencies (e.g., 20,000 copies of the Data Utilization Guide were distributed to schools with over 50 on-site training sessions); collaborated with team to develop formative assessment and agency evaluation guides; analyzed assessment data/educational indicators to prioritize the level of support offered to local education agencies; and assisted with program evaluation (e.g., evaluation of School Reform Models, Leadership Facilitators, and Performance on School Standards) Research, Evaluation & Testing Specialist, Testing Division, Georgia Department of Education, Atlanta, GA Aggregated student-level assessment data to disseminate electronic results to local systems; assisted with program evaluation (e.g., evaluation of Charter Schools and SWD Inclusion Practices), served as a resource during data reviews, and provided data utilization training to Regional Education Service Agencies Statistical Analyst II, University Planning, Institutional Research, & Continuous Improvement, Edinboro University of Pennsylvania, Edinboro, PA Extracted and analyzed university data requested by the Pennsylvania State System of Higher Education, Pennsylvania Department of Education, and the National Center for Education Statistics; served as a resource to faculty conducting research through design, implementation, and analysis; and evaluated Enrollment, Management, and Retention initiatives (e.g., Living and Learning Communities, Staff -Student Mentor Program, and the At-risk Remediation Program). Grants & Contract Activity 2014 Principal Investigator, Georgia Student Growth Model Report for Parents. $255, Co-Principal Investigator, Georgia High School Graduation Test. $755, Principal Investigator, CRCT-M No Cost Extension. $201, Development of the syntax to evaluate Georgia local agencies for recognition programs. Georgia Department of Education. $4, Factors that impact student retention. Pennsylvania State System of Higher Education Performance and Outcome Plan Grant. $10,000. A.E. Ferster 3

4 Academic Teaching Experience Spring, 2014 Adjunct Assistant Professor, University of Georgia Applied Analysis of Variance Methods in Education Instructed approximately 50 graduate students, prepared lecture material and statistical package lab activities and recordings, graded student work, and held office hours for students. Student Course Evaluations: N=49, n=21. Scale: 1 (Strongly Disagree) 5 (Strongly Agree) Question Mean Median The course was effectively organized Assignments and activities were clearly related to course goals The instructor was knowledgeable and well-prepared Assignments and activities were useful for helping me learn New skills and/or concepts were presented in ways I could understand The instructor was open to students questions and comments The instructor provided useful feedback on student work Course work was evaluated according to clear expectations This course challenged me to think and learn Spring, 2010 Fall, 2009 Spring, 2009 Graduate Teaching Assistant for Structural Equation Modeling Graduate Teaching Assistant for Analysis of Variance Graduate Teaching Assistant for Structural Equation Modeling Assistantships, Internships & Practicum Spring, 2009 Graduate Intern, Georgia Center for Assessment, University of Georgia, Athens, GA Graduate Research Assistant, Institutional Research, Edinboro University of PA, Edinboro, PA 1998 School Psychology Practicum, General McClane School District, Edinboro, PA Psychological Statistics Tutor & Peer Academic Tutor, Office of Students with Disabilities, Edinboro, PA A.E. Ferster 4

5 Publications & Technical Documents Ferster, A.E (2013). The Criterion Referenced Competency Tests Modified (CRCT-M) Item and Data Review Workshop Report. Athens, GA: Georgia Center for Assessment, University of Georgia Bandalos, D.L., Davis, S., Ferster, A.E., & Samuelson, K. (2011). Validation of high stakes testing in accountability systems. In K. Geissinger and J. Boivard, (Eds.), Contemporary Issues in High Stakes Testing. American Psychological Association. Calhoun, L., Cramer, S., Ferster, A.E., Gonyea, M. (2011). The Criterion Referenced Competency Tests Modified (CRCT-M) Operational Technical Report. Athens, GA: Georgia Center for Assessment, University of Georgia. Calhoun, L., Choi, H., Cramer, S., Ferster, A.E. (2011). The Georgia CRCT-M Modified Angoff Standard Setting Technical Report. Athens, GA: Georgia Center for Assessment, University of Georgia. Ferster, A.E. (2010). Georgia Kindergarten Inventory of Developing Skills validity study in support of the argument: GKIDS provides educators with information regarding the level of instructional support needed by students entering first grade. Athens, GA: Georgia Center for Assessment, University of Georgia. Cramer, S., & Ferster, A.E. (2010). Gwinnett Gateway annual technical report. Athens, GA: Georgia Center for Assessment, University of Georgia. Ferster, A.E. (2009). Five-year proposal for investigating the consequential validity of Georgia s Assessment System. Atlanta, GA: Georgia Department of Education. Ferster, A.E., & Calhoun, L. (2006). The Data Utilization Guide: A resource guide for Georgia Educators. Atlanta, GA: Georgia Department of Education. Ferster, A.E., & Calhoun, L. (2005). The Data Utilization Guide: A resource guide for Georgia Educators. Atlanta, GA: Georgia Department of Education. Ferster, A.E., & Burks, K. (2001). Edinboro University s Fact Book. Edinboro, PA: Edinboro University of Pennsylvania. Ferster, A.E., & Algarez, J. (2000). Edinboro University s Fact Book. Edinboro, PA: Edinboro University of Pennsylvania. A.E. Ferster 5

6 Select Presentations Ferster, A.E., Zhao, F., & Clark, A. (April, 2014). Understanding the academic profiles of students participating in the Alternate Assessment based on Alternate Achievement Standards: A cluster analysis. Paper presented at the 2014 Annual Meeting of the American Educational Research Association in Philadelphia, PA. Ferster, A.E., Zhao, F., & Qin, L. (May, 2013). A program to assist non-measurement faculty with their assessment practices. Program presented at the 2013 Annual Meeting of the Association for Institutional Research in Long Beach, CA. Ferster, A.E., & Templin, J. (April, 2013). An evaluation of item level design features via an extension of the Linear Logistic Test Model with Random Effects. Paper presented at the 2013 Annual Meeting of the National Council on Measurement in Education in San Francisco, CA. Ferster, A.E., Shaftel, J., Sheinker, A., & Yung, S. (April, 2013). An argument based approach to the reliability of the First Contact Survey. Poster presented at the 2013 Annual Meeting of the American Educational Research Association in San Francisco, CA. Ferster, A.E., Shaftel, J., Sheinker, A., & Whetstone, P. (November, 2012). Are the right students participating in the Alternate Assessment based on Alternate Achievement Standards? Poster presented at the 2012 Annual TASH Meeting in Long Beach, CA. Nixon, C., Algoloz, C., Ferster, A.E., Jenkins, C., & Templin, J. (April, 2012). A diagnostic model for GKIDS performance ratings. Poster presented at the 2012 Annual Meeting of the National Council on Measurement in Education in Vancouver, BC, Canada. Ferster, A.E. (September, 2010). Evaluating the efficacy of item modifications under the Rasch model, mixed-rasch, and invariance procedures. In-progress research presented at the 8th Annual Society of Multivariate Experimental Psychology Graduate Student Preconference in Atlanta, GA. Ferster, A.E., & Kim, S.-H. (July, 2010). Compatibility of item parameter estimates. Poster presented at the 75 th Annual International Meeting of the Psychometric Society in Athens, GA. Kim, S.-H., & Ferster, A.E. (June, 2010). Use of academic assessment results to improve student academic achievement: Balanced assessment system. Paper presented at the KEDI- KAERA Educational Policy Joint Symposium in Seoul, Korea. Ferster, A.E. (March, 2007). Dissemination & utilization of student level assessment files in Georgia. National Center for Education Statistics (NCES) Management Information Systems Conference, Atlanta, GA. Vahlsing, J., & Ferster, A.E. (November, 2006). Got data? Georgia s single statewide accountability system. Georgia Educational Technology Conference, Atlanta, GA. A.E. Ferster 6

7 Ferster, A.E. (May, 2006). Creating a balanced assessment system, Georgia Regional Service Agency Annual Conference. St. Simons, GA. Ferster, A.E., & Calhoun, L. (August, 2005). The Data Utilization Guide: A resource for Georgia educators. Georgia Association of Educational Leaders, Jekyll Island, GA. Select Training Sessions Ferster, A.E. (June, 2008). Item writing guidelines. Forsyth Counselor Assessment Kick-off, Cumming, GA. Bandalos, D.L., & Ferster, A.E. (April, 2007). Teaching educational measurement. National Council on Measurement in Education, Chicago, IL. Ferster, A. E., & Vahlsing, J. (November, 2006). Analyzing data with macros: Programs within the Georgia Data Utilization Guide. Georgia Educational Technology Conference, Atlanta, GA. Calhoun, L., Ferster, A.E., Fincher, M., & Komatsu, L. (September, 2005). Assessment literacy & constructing formative assessments via the On-line Assessment System (OAS). Training module presented to Regional Education Service Agency Staff. Macon, GA. Ferster, A.E., & Calhoun, L. (Spring, 2003). Managing assessment data. Georgia Department of Education Desire2Learn online professional development course presented to local system test coordinators. Calhoun, L., & Ferster, A.E. (Fall, 2002). Writing within the content areas. Georgia Department of Education Desire2Learn online professional development course presented to local educators. Ferster, A.E. (August-September, 2002). Interpretation of aggregate and student level state assessment reports. Training presented to new local test coordinators at the Annual Test Coordinator s Regional Workshop(s). Professional Affiliations Service & Outreach Activities American Educational Research Association (AERA) Association for Institutional Research (AIR) American Psychological Association (APA) National Council for Measurement in Education (NCME) 2014 AERA Rasch Special Interest Group Session Chair Manuscript review: Applied Psychological Measurement NCME Annual Conference Proposal review NCME Standards & Test Use Committee: Graduate Student Representative A.E. Ferster 7

8 2010 Psychometric Society: 75 th Annual Meeting Local Organizing Committee 2008 Teacher Evaluation (CLASS KEYS) Advisory Council 2005 & 2008 Development Committee for Georgia Leadership Institute for School Improvement Data Module Teaching Leader, Georgia Leadership Institute for School Improvement 2006 Task Force on Disproportionality within SWD (Students classified with a disability) Developed/delivered data management professional learning sessions for GaDOE employees 2003 Assessment Dissemination Task Force Sorority Advisor, Alpha Sigma Alpha, Edinboro University 2001 Strategic Study Group, Evaluation of the Graduate Assistantship Award Process, Edinboro University 1998 Treasurer, School Psychology Organization 1998 Student Representative, School Psychology Program Review Honors & Recognition Fellowship for Graduate Study, Association for Institutional Research-National Center for Education Statistics. $30, AIR-NCES National Summer Data Policy Institute Fellowship 2008 GaDOE Recognition for Terrific Team: Assessment Research & Development 2006 Compass Award for School Improvement: GaDOE 2005 GaDOE Recognition for Development of Data Utilization Guide 2003 Selected to participate in the National Center for Education Statistics National Assessment of Educational Progress (NAEP) 2003 GaDOE Recognition for Adequate Yearly Progress Development Team Computing SPSS LISREL Winsteps/Facets Captivate VBA SAS Mplus SSI IRT Suite Desire2Learn R IRTPRO Camtasia Professional Development Association for Institutional Research: Excel Macro Boot camp: May, 2013 NCME Training Session: Multidimensional Item Response Theory: April, 2013 NCME Training Session: A Generalized Linear Mixed Model Approach to IRT: April, 2012 NCME Training Session: Bayesian Networks in Educational Assessment: April, 2012 NCME Training Session: Standard Setting in the Real World: April, 2012 University of Georgia, College of Education: Statistical Analysis R Workshop: January, 2012 Institute for Interdisciplinary Research: Validation: A General Framework & Prototype: July, 2011 Institute for Interdisciplinary Research: Diagnostic Classification Models: October, 2010 NCME Training Session: Test Equating Methods and Practices: April, 2010 A.E. Ferster 8

9 NCME Training Session: Introduction to Rule Space and Q-Matrix Method: April, 2009 University of Kansas Item Response Theory Advanced Statistics Camp: June, 2007 Introduction to Rasch Measurement Course, University of Illinois at Chicago: April, 2007 Data Retreat Training of Trainers: March, 2006 SREB Leadership Curriculum Training Module: March, 2004 SPSS Professional Development Courses: January-April, 2003 Intermediate Topics Survey Methodology Survey Analysis Syntax I Syntax II SPSS Scripts Statistical Analysis Advanced Statistical Analysis Association for Institutional Research: Enrollment Management Institute: August, 2001 A.E. Ferster 9