The Arizna team and Its Importance

Transcription

1 OFFICE OF UNIVERSITY EVALUATION PO BOX TEMPE, AZ (480) FACSIMILE (480) MEMO Date: June 30, 2009 T: Frm: Re: Kathi Ketchesn, Ph.D. Directr, Institutinal Research & Planning Shelly Ptts, Ph.D. Directr, University Office f Evaluatin and Educatinal Effectiveness Urban Transfer Research Netwrk -- Arizna Prgress Reprt Overview Fr Arizna, year fur f the UTRN grant was ne f data cllectin, analysis, and preparatin fr presentatins. The scpe and impact f the prject in the Phenix metrplitan area were als expanded. The Arizna team experienced several changes t the cre wrking grup, including the additin f Maricpa Cunty Cmmunity Cllege District (MCCCD) Institutinal Research (IR) directrs t the Arizna data cmmittee, departure f the ASU cre team s research analyst, and expansin f the Graduate Service Assistant s (GSA s) rle t include duties previusly held by the research analyst. The Arizna team maintained regular cmmunicatin with administratin frm bth ASU and MCCCD regarding data and plicy aspects as well as prgress f the prject. Cmmunicatin tk the frm f s, phne cnferences, all site meetings, and presentatins. The c-pi made a presentatin n the UTRN prject at the MCCCD Institutinal Research Directrs mnthly meeting (5/09), and MCCCD district staff participated in the March 2009 All Site meeting held in Arizna.. One member f the MCCCD district staff and a cllege IR Directr als attended the UTRN presentatins at the AIR Frum (6/09) Much f the GSA s time during the past year was devted t research cmpnents f the prject, including data prcessing, cding, analysis, and interpretatin as well as preparatin fr the student interviews. AZ team members partnered with PSU staff n the develpment f the administratr cdebk, revisin f the student interview prtcl, and in ensuring inter-rater reliability fr cding the administratr interview data. Extensive cde tables were prduced which allwed fr the examinatin f similarities and differences amng respndent types, between institutin types, and acrss states. Regressin analysis was cnducted fr the chrt data, and results were examined between states. Arizna team members als updated the chrt data tables t ensure cnsistency with Arizna s transfer definitins. IRB apprval fr the student interviews was received frm ASU In April 2009, and ur applicatin will be reviewed at the MCCCD IRB meeting n July 9, The ASU sample has been selected, and the team is set t wrk with MCCCD IRB directrs in attaining access t students enrlled at the individual cmmunity clleges. The AZ team als cntinued cnducting an envirnmental scan and literature review. The fllwing sectin summarizes year fur activities int six main categries: administrative activities, prject management, data cllectin and analysis (quantitative), data cllectin and analysis (qualitative), advisry cmmittees, and next steps. 1

2 Administrative Activities Persnnel The UTRN-AZ team met weekly t discuss data cllectin, prcessing, cding, analysis, and reprting/presentatin activities as well as prject-related challenges and issues. Institutinal Analysis staff were paid fr data acquisitin, analysis, and reprting services. Services were cntracted with Escrptinist.cm (nw VerbalInk.cm) fr transcriptin f the remainder f the administrative interviews. Susan Zbl and Danna Ck cmpleted and passed the nline NIH Human Research Training curse. Susan Zbl left the Office f University Evaluatin and cnsequently the UTRN prject. Danna Ck incrprated Susan s UTRN files, and they met prir t Susan s departure t ensure a smth transitin. Danna Ck assumed a greater rle in the day-t-day crdinatin f the prject, including respnsibility fr mst f the data cding and preliminary analysis. Danna Ck applied fr an August 2009 graduatin frm her M.A. prgram which wuld end her status as a Graduate Service Assistant. Arrangements have been discussed and are in the prcess f being made t cntinue her emplyment as a half-time research specialist assigned t the UTRN prject after her degree is psted. AZ team members participated in the all site meeting at PSU in July 2008, and they hsted PSU team members in April Staff frm the MCCCD district ffice als attended the Arizna meeting. Arizna team members als engaged in nging phne cnversatins and exchanges with Oregn and MCCCD clleagues thrughut the prject year. Paperwrk/Website Staff prvided updates fr the verall UTRN web page earlier this year, and they are currently wrking n additinal updates. The UTRN sectin f the ASU Office f University Evaluatin website was develped and implemented ( This site includes a descriptin f the UTRN prject, a summary f AZ activities, future plans, and relevant links t the main UTRN website and the Lumina Fundatin fr Educatin. IRB apprval fr the student interviews was received frm ASU (4/09), and the applicatin will be reviewed fr district level apprval at the MCCCD IRB meeting n July 9, Apprval will then be sught frm the individual clleges. Meeting minutes, referrals, and resurces were submitted t the PSU-UTRN team n an nging basis. Administrative prcesses, prcedures, and files were maintained fr the prject. Budget Expenditures were prcessed fr cnsultant fees, staff wages/salary redistributin, materials/supplies, and travel csts. Autumn Fuhrmark (Administrative Assciate, OUE) prcessed expenditures, payrll, and HR frms; recnciled accunts; and maintained dcumentatin fr the prject. Accunts were recnciled and reviewed n a mnthly basis. The previusly determined budget bligatins were met. 2

3 Prject Activities & Management The Arizna team maintained regular cmmunicatin with ASU and MCCCD administratin regarding data and plicy aspects and prgress f the prject. Cmmunicatin tk the frm f s, phne cnferences, and presentatins. Staff frm ASU s Office f University Evaluatin and Office f Institutinal Analysis attended an All Site Meeting in Prtland, Oregn (7/08). ASU hsted an All Site meeting in March 2009, and staff frm ASU, the MCCCD district ffice, and PSU participated. Arizna team members participated in business meetings as well as sessins specifically fcused n the quantitative and qualitative aspects f the prject s research cmpnents. During these meetings, the grup discussed the creatin f new data tables that wuld cmpare BA attainment and transfer rates acrss the sites; clarified chrt, transfer, and swirling definitins; cmpared data cllectin appraches fr cnsistency, and made decisins abut the prcesses t be used fr cdebk creatin and determining inter-rater reliability. The team als set a tentative timeline fr the develpment f the student interview prtcl, cdebk, and data cllectin activities. ASU hsted an All Site meeting in March During this meeting, the grup develped gals and a timeline fr cmpletin f actin items during the remainder f year fur, including the administratr and student interviews, the AIR presentatins, and the expansin f the UTRN netwrk. Specifically, we slidified plans fr data cllectin, analysis, and the prductin f cmparisn tables. The team als refined the methdlgy and instrumentatin t be used while cnducting the student interviews, discussed IRB paperwrk and prcesses, and identified cmpletin dates. The pssibility f a fifth year n-cst extensin f the grant als was discussed, including gals, areas f respnsibility, and a timeline fr cmpletin. The Arizna c-pi made a presentatin abut the current status and future activities f the UTRN prject at the MCCCD Institutinal Research Directrs mnthly meeting (5/09). The Arizna c-pi and GSA helped plan, develp, and deliver tw presentatins at the 49 th Annual Assciatin fr Institutinal Research (AIR) Frum (Atlanta, GA: 6/09). The presentatins fcused n the methdlgies and initial findings f the prject s quantitative and qualitative research cmpnents. The AZ team als cntributed t preparatins fr and discussins with ptential partner institutins at the UTRN invitatinal meeting. The Arizna c-pi and GSA will attend an All-Site Meeting at PSU in July Arizna team members cmpleted an rientatin training prgram fr ATLAS.ti and familiarized themselves with the prgram s functins and prcesses. Data Cllectin & Analysis Quantitative ASU s Office f Institutinal Analysis updated the student chrt data tables based n the state s revised transfer definitins. Prductin f the tables was a cllabrative effrt between ASU and MCCCD. Updated chrt summary tables were shared with PSU. Arizna and Oregn team members cllabrated n the regressin analysis f selected enrllment data elements. The crss-state team discussed the apprach, results, and hw t present the findings at the AIR Frum. 3

4 Data Cllectin & Analysis -- Qualitative Arizna s GSA cnducted the final administratr interviews and finalized arrangements with VerbalInk.cm fr transcriptin services. She edited and frmatted all interviews fr analysis, including the replacement f any identifying data with secure cdes. Miss Ck laded all f the administratr interview transcripts int ATLAS.ti and develped a dcument t track each interview s status thrughut the analysis prcess. Arizna staff cntributed t develpment and refinement f the interview cdebk and participated in telecnferences t ensure cnsistency in the cding prcess. They als participated in inter-rater reliability testing t ensure cding reliability acrss states. Ms. Ck cded all f the administratr data, used ATLAS.ti mems t track ther cdes, and prduced a variety f cde cunt displays and summaries f indicative qutes. Similarities and differences were cmpared acrss states, institutins, and persnnel types, including factrs cntributing t/impeding transfer cmpletin and Baccalaureate attainment. C-ccurring cde cunts fr underrepresented students were als prduced and interpreted. ASU cllabrated with PSU n the methdlgy, prcesses, and instrumentatin fr the student interviews, including develpment f the develpment f the interview prtcl, sampling criteria, and language fr the IRB applicatin. The Arizna team received IRB apprval frm ASU fr the student interviews (4/09), and the applicatin fr MCCCD s district level IRB apprval will be reviewed n 7/9/09. The Arizna team reviewed the previusly cllected transfer research and rganized the articles based n regin: West, Suthwest, Midwest, Sutheast, Nrtheast, Natinal, r Arizna. Arizna s GSA als scanned the internet fr research n several transfer systems chsen fr their relevance t the UTRN prject. Systems and areas f interest included Miami-Dade, University f Washingtn, St. Luis, Minneaplis, and CUNY. The research included the lcatin f articles r dissertatins relevant t the UTRN and/r these systems and then navigating the state, university, and cmmunity cllege websites fr infrmatin n transfer resurces and structures. This research was cmpiled and shared with PSU. A bibligraphy f transfer literature was als created and maintained thrughut the prject year. Advisry Cmmittees Data Advisry Cmmittee Data cmmittee meetings were held in 8/08, 2/09, and 3/09. Infrmal meetings and cmmunicatins als were cnducted between ASU and MCCCD Institutinal Analysis staff thrughut the year. Cmmittee members discussed data cllectin, analysis, and interpretatin strategies fr the quantitative and qualitative data; updating the chrt data tables; ways f sharing/presenting the data; and IRB prcesses. The Arizna c-pi made a presentatin abut the current status and future activities f the UTRN prject at the MCCCD Institutinal Research Directrs mnthly meeting (5/09). Invitatins t jin the Arizna data cmmittee were extended t IR Directrs within the MCCCD system. S far, IR directrs at Chandler-Gilbert Cmmunity Cllege and Glendale Cmmunity Cllege have jined the data advisry cmmittee. Arizna will cntinue t expand the cmmittee during year five f the grant. The next data cmmittee meeting will be scheduled fr August. Plicy Advisry Cmmittee AZ C-PI Shelly Ptts prvided regular updates t the plicy makers at bth ASU and MCCCD. A plicy cmmittee meeting will be scheduled fr September. 4

5 Next Steps: Administrative Prcess paperwrk fr summer salaries & expenditures. Cntinue t update prject activity lg and files. Submit administrative (6/10) and financial (7,/09, 6/10) reprts. Prject Management Participate in the all-site meeting (7/09) in Prtland, OR t plan final year f UTRN prject. Participate in AIR 2010 and make presentatins n prject findings. Cntinue weekly ASU-UTRN meetings. Data Cllectin & Analysis Quantitative Cntinue t analyze quantitative data, including the examinatin f similarities and differences acrss sites and institutin types. Data Cllectin & Analysis Qualitative Cntinue analysis f qualitative data with cde cunts, cllapsing cde cunts, indicative qutes, and further cmparisns between faculty, staff, and administratr respnses. Cnduct student interviews. Transcribe, cde, and analyze the data. Prduce data summaries. Examine qualitative findings acrss sites t determine similarities and differences. Use qualitative data t better understand chrt tables and transfer patterns. Advisry Cmmittees Data: Cnvene meetings f the data advisry grup t welcme new members and t discuss chrt data tables, the analysis f quantitative and qualitative data, student interviews, and next steps. Cnvene meetings twice during each semester. Plicy: Meet with leadership at ASU and MCCCD t discuss prject updates, t share data and t identify next steps. Cnvene plicy advisry grup twice t review quantitative and qualitative findings and t discuss implicatins fr plicy. Examine plices and practices in light f UTRN findings. 5