Instructional Language Fluency and Self-Efficacy in College Alexis R Georgeson Simon Fraser University Vancouver, BC
Outline 1. Background and Purpose of Study 2. Methods 3. Results 4. Discussion
Background The Well-Being of college students is an important issue for universities. Distress is common and has been shown to negatively affect academic performance. Well-being has various facets which are usually measured using questionnaires
Wellness and Well-being
Well-Being and English Fluency Previous work has shown differences on measures of well-being across English fluency, though it is not clear whether these are true differences or related to measurement error. CES-D is a tool measuring emotional wellbeing which we have examined. We found interaction effects between item features and English fluency on CES-D
Self-efficacy Self Efficacy is broadly the ability to perform tasks and is related to well-being. For college students, self-efficacy concerns the ability to complete tasks specifically encountered in a university context Lower levels of English fluency were related to lower ratings of college self-efficacy
CES-D vs. CSES There are some notable differences in the constructs being measured as well as the items on these scales. The CES-D has more variation in the way items are written. The content of CES-D items, as it is related to mood, involves feelings. The scale itself is 4-points and has quantitative and qualitative descriptors The CSES, in contrast, includes more behaviors, items are similar in structure and length, and has a 7 point scale with qualitative descriptors. Thus, we focused on more on the content of items, rather than linguistic features, given the homogeneity of the items.
Research Question Do items with certain features show different patterns of responses across levels of English Fluency? Features of interest: Concreteness, social desirability, cultural loading, task requires use of written communication, task requires verbal communication Note about features
Current Paper We used a modified version of the College-Self Efficacy Instrument (CSEI) This scale asks individuals to rate their confidence from 1=not at all confident to 7=Very confident on various tasks The modified scale has two subscales: Course- Related tasks and Social Tasks. We did not include the roommate subscale.
Participants 1272 Undergraduate students from Simon Fraser University completed a battery of questionnaires for course credit. Mean Age 19.8 (SD: 2.9) Males: 431 (34%); Females: 822 (65%) 51% of Asian Descent, 33% Caucasian, 9% Other, 3% Multi-racial Non-Metis, 1% African American
English Fluency Participants were asked to self-report their English Fluency, given four options. They responded as follows: -Very Fluent in English: 53% -More Fluent in English than first language: 22% -Same Fluency in English and First language: 13% -Less Fluent in English than First Language: 10%
Measures English Fluency- Self reported English Fluency. Options are: Very Fluent in English, More Fluent in English than Native Language, Same Fluency in English and Native Language, and Less Fluent in English than in Native Language. This was treated as a continuous variable in the Analysis College Self-Efficacy Inventory-15 items, Individuals rate their confidence in completing various tasks related to college using a 7-point Likert scale from 7=Very Confident to 1=Not at all Confident. There are two subscales we included: course and social.
Coding Features Items from CSEI were coded for various features. The coding was done individually and then concensus coding determined how the items would be coded for the analysis.
Feature Definitions Concreteness: Item represents something well-defined or clearly observable (e.g., Research a term paper), as opposed to something that is more abstract or less clearly defined (e.g., Manage time effectively). Nonconcrete items serve as the reference category for concrete items in the analyses. Cultural Loading: Western cultural values are inherent in item (e.g., Ask a question in class) Socially desirable-prioritizing academic success Socially desirable-prioritizing social life Task Requires written communication Task requires verbal communication
Analytic plan Using Linear mixed effects modeling, we explored the effects of linguistic and cultural features, as well as self-reported English fluency. This would allow us to do an item-level analysis where individuals were a random effect After completing analyses on the overall questionnaire, we then split the analysis by course subscale vs. social subscale to see if there were any differences
Results The results have been graphed Since English Fluency and Feature interactions are most salient to our research question, we will focus on discussing those results.
CSE Response Results-English Fluency 6 5.8 5.6 5.4 5.2 5 4.8 4.6 4.4 4.2 4 0 1 2 3 4 1=Very Fluent 2=More fluent 3= Equally Fluent 4= less fluent
Results-English Fluency by Subscale 6 5.5 5 4.5 4 Social Subscale Course Subscale 3.5 3 0 1 2 3 4 1=Very Fluent 2=More fluent 3= Equally Fluent 4= less fluent
CSE Response CSE Response English Fluency 6 6 5.5 5.5 5 4.5 5 4.5 Social Subscale 4 3.5 4 3.5 Course Subscale 3 0 1 2 3 4 3 0 1 2 3 4 -As the graphs illustrate, there was a large difference in the average ratings on the social subscale compared to the course subscale, motivating us to split our analyses by subscale. There is a significant effect of English Fluency, though it seems that course items received consistently higher ratings. 1=Very Fluent 2=More fluent 3= Equally Fluent 4= less fluent
CSE Response Concreteness Concreteness and English Fluency, Interaction Model 6 5.5 5 4.5 Social FP Social FA 4 3.5 Course FP Course FA 3 0 1 2 3 4 5 FP= Feature Present FA=Feature Absent; 1=Very Fluent 2=More fluent 3= Equally Fluent 4= less fluent
CSE Response Culture 6 Culture English Fluency, Interaction Models 5.5 5 4.5 4 Social FP Social FA Course FP Course FA 3.5 3 0 1 2 3 4 5 FP= Feature Present FA=Feature Absent; 1=Very Fluent 2=More fluent 3= Equally Fluent 4= less fluent
CSE Response Social Desirability: Academic Success 6 Items Related to Academic Success and English Fluency, Interaction Model 5.5 5 4.5 4 Social FP Social FA Course FP* Course FA* 3.5 3 0 1 2 3 4 5 *All Items on the course Subscale were coded as related to academic success FP= Feature Present FA=Feature Absent; 1=Very Fluent 2=More fluent 3= Equally Fluent 4= less fluent
CSE Response Communication 6 5.5 5 Written Communication and English Fluency, Main Effects Models 6 5.5 5 Verbal Communication and English Fluency, Main Effects 4.5 4.5 4 4 3.5 3.5 3 0 1 2 3 4 5 3 0 1 2 3 4 5 Social FP Social FA Course FP Course FA FP= Feature Present FA=Feature Absent; 1=Very Fluent 2=More fluent 3= Equally Fluent 4= less fluent
Discussion
Takeaways-Measurement and Methods Results highlight importance of separating analyses by subscales when analyzing results from questionnaires given the different patterns depending on whether items were on the social or course subscale Concreteness, cultural loading, and items related to academic success showed different patterns depending on English fluency, but only for the social subscale. Importance of being inclusive when doing research on wellness in a university setting; excluding non-native English speakers will only limit our understanding of university students as a whole.
Takeaways-Applications The less fluent an individual is in English, the lower their ratings are for self-efficacy. These individuals perceive themselves to be less efficacious in social or course-related tasks in comparison to individuals who are more fluent. Individuals who are less fluent were least confident in completing that tasks which are social and unrelated to academics-perhaps this is an area for universities to focus, in addition to academic
Limitations As we mentioned, there is not a great deal of variability in the scale. Many of the students who were less fluent in English are likely to be international students, which means they have different challenges they encounter.
Future Work This scale needs to be coded in other ways Run similar analyses on other scales Qualitative work to understand: 1. how individuals who are less fluent in English interpret and respond to questionnaires, 2. Their experience as university students-unique difficulties they encounter