Self-regulation strategies used by students with brain injury while transitioning to college
Abstract
PURPOSE:
Students with TBI enter college with strategies that they have used prior to being injured yet often without knowing which ones will be effective in helping them to be successful. The purpose here is to describe how semi-structured interviews were used to identify self-regulated learning strategies, to demonstrate the utility and reliability of coding self-regulated learning strategies, and to provide examples of student-centered goals derived from survey and interview responses.
METHODS:
College students completed the College Survey for Students with Brain Injury (CSS-BI) and were interviewed before and after coaching support that focused on teaching self-regulated learning. Responses to interview questions about strategies were coded using a modified version of Zimmerman and Martinez-Pons’s (1986) schema. Coders also rated strategies for specificity.
RESULTS:
Strategies were reliably coded into 16 categories of self-regulation. Inter and intra-reliability were strong. Four of the five students reported using a larger variety of self-regulation strategies and strategies that were more specific after coaching support.
DISCUSSION AND CONCLUSIONS:
It is possible to reliably code self-regulation learning strategies reported by college students with TBI. These measures have potential as functional ‘outcomes’ for students who are transitioning to college. Interview responses can be used to collaboratively create student-centered goals.
1Introduction
Students with traumatic brain injury (TBI) may be transitioning back to college after being injured or may be going to college for the first time after having been injured. Additionally, some students are returning to college to retool after their injury if they are unable to return to their prior job. Regardless, going to college is often an achievable goal for individuals recovering from TBI. Although 91% of institutions of higher education serve students with TBI (Raue & Lewis, 2011), this includes only those students who self-report a history of TBI and register themselves as students with disability through campus offices of accessibility. Krause and Richards (2014) found that 16.9% of undergraduate students reported a history of TBI.
Cognitive deficits after TBI have been well-characterized to include deficits in memory, attention, and executive function though it is only recently that researchers have begun to understand the impact these deficits have on college performance (Willmott, Ponsford, Downing, & Carty, 2014). For professionals who are working to support these students as they transition to college, a starting place is to identify the strategies students have used in the past to manage their academic performance; discussing what is and is not being used effectively allows the professional and student to work towards student-centered goals and to determine which strategies could assist in reaching these goals.
1.1Self-regulated learning in college students
Self-regulated learning has long been recognized as a feature of the most successful college students (e.g., Nandagopal & Ericsson, 2012). Research into self-regulated learning has revealed that learners across a variety of contexts and academic subjects perform better when using self-regulation strategies effectively (Tang, 2015; Tuckman & Kennedy, 2011). For example, high achieving students use more strategies and a greater variety of strategies, engage in more self-evaluation, and use more elaborative encoding strategies than low achieving students (Ruban & Reis, 2006). Research has also focused on how self-regulation supports students with disabilities in meeting academic goals. For example, university students with learning disabilities experienced a greater positive effect from the use of self-regulated learning strategies than students without learning disabilities (Ruban, McCoach, McGuire, & Reis, 2003).
Kennedy and Coelho (2005) developed a model of self-regulation (SR) for clinical populations that describes a cyclical process of monitoring, goal-setting, and strategy deployment that can be explicitly taught. This model has since then been expanded (Kennedy, 2017). Individuals with TBI may experience difficulty at any one of these steps: assessing their skills accurately, identifying achievable goals, selecting a strategy, using a strategy, and making adjustments in the goal or strategy based on experience and feedback. Intervention that explicitly teaches this self-regulation process provides students with a skill set that could be used across contexts and academic courses.
Kennedy and Krause (2011) first described this as a self-regulatory coaching program designed to support two students returning to college after TBI. The intervention support entailed explicitly teaching students to regulate their learning, develop and employ appropriate strategies, and monitor progress. To evaluate strategy use, students completed The College Survey for Students with Brain Injury (CSS-BI; Kennedy & Krause, 2009) and were interviewed about strategies based on their responses to the academic challenges they endorsed. Results revealed that both students developed more detailed strategies to cope with academic challenges over the course of intervention. However, the type of strategies students reported was not examined.
Zimmerman and Martinez-Pons (1986, 1988), developed a scale called the Self-Regulated Learning Interview Schedule (SRLIS) that identifies self-regulation learning strategies. The 14 categories of self-regulated learning include self-evaluation, goal-setting, rehearsing and memorizing, and self-consequences. In high school students, the frequency of reported use of such strategies predicted performance in achievement scores beyond demographic measures alone. In university students, use of this scale indicated that students who were required to take remedial courses upon college admission reported using fewer self-regulation strategies as compared to students who were not remediating (Ley & Young, 1998).
The purpose of the current study was to: 1) describe how semi-structured interview responses can be used to identify the type and specificity of self-regulation strategies in college students with TBI, and; 2) to demonstrate how interview responses lead to student-centered goals that are created collaboratively between students and professionals.
2Methods
2.1Participants
All research activities were conducted under the oversight of the University of Minnesota Institutional Review Board. Five adults with history of TBI (2 males/3 females) were all participating in a pilot study on coaching support while transitioning into or back to college (Kennedy & Krause, 2011; Kennedy, 2017). Students ranged from 19 to 24 years in age and included a college freshman, a sophomore, two juniors, and a senior. All were traditional college students. None had other neurological disorders, learning disabilities, or attention deficit disorder. With the exception of Student 1, all others were transitioning to college after being injured.
1 Student 1 had sustained multiple concussions during high school. She was a Junior in college and had recently experienced exacerbated post-concussion symptoms. A counselor referred her.
2 Student 2 had sustained multiple concussions in high school and college, with the most recent one being one month prior to being referred for support by the office of accessibility. He was a junior in college.
3 Student 3 had sustained a moderate TBI one year prior to returning to college as a senior. The office of accessibility referred her.
4 Student 4 had sustained a severe TBI as a graduating high school senior. She attempted college one year later but switched colleges where she could receive more direct support. She was a freshman and referred by a community-based clinician.
5 Student 5 was a freshman who sustained a severe TBI two years prior while in high school. He was referred by the Department of Vocational Rehabilitation.
2.2Procedures
Students participated in a study in which the goal was to develop a collaborative coaching approach that explicitly taught them to engage in self-regulated learning with functional outcome measures. This approach is student-focused. It consists of the clinician ‘coach’ and student collaboratively identifying student strengths and weakness, creating student-centered goals and plans for reaching their goals, and explicitly instructing students in self-regulation strategies in three areas: self-learning and -studying, self-management and -organization, and self-advocacy. Each student’s coaching program was highly individualized, based on their specific needs, abilities and disabilities. Students addressed both proximal (immediate) and distal (long term) goals. For a further discussion of this approach, readers are referred to Kennedy and Krause (2011) and Kennedy (2017).
As a part of the evaluation process, student participants completed a semi-structured interview based on the academic challenges section of the CSS-BI (Kennedy & Krause, 2009) before and after two semesters of coaching support.1 1. The academic challenges section consists of a set of 13 academic statements (e.g., “I forget what has been said in class”) to which participants rate their agreement on a 5-point scale (1 = strongly disagree; 3 = neither agree nor disagree; 5 = strongly agree). This section of the CSS-BI is psychometrically sound and is described by a four-factor model of academic challenges, including difficulty with studying and learning, time-management and organization, social concerns, and nervousness/anxiety (Kennedy, Krause, & O’Brien, 2014).
After completing the survey, participants were interviewed and asked to elaborate on their responses to each statement, explain why they selected the rating, and identify strategies they used to help with the problem. Interviews were conducted by the last author and followed a script that listed the academic item. The interviewer stated, “I see that you agree with ‘I have to study more than I used to.’ Can you tell me more about that?” Participants described why that rating was selected and examples of when it would occur. The interviewer subsequently asked, “What do you do when that happens? Do you use any strategies to manage that?”
2.3Data analysis
Two research assistants (RAs) transcribed the semi-structured interviews verbatim. From the transcripts, RAs identified 321 strategies reported by students across both time points and randomized the strategies for coding. Two other RAs coded the strategies by strategy category and strategy specificity.
To code self-regulation strategy categories, we used a modified version of the SRLIS self-regulated learning strategy coding schema developed by Zimmerman and Martinez-Pons (1986) and further described by Purdie and Hattie (1996). Minor adaptations were necessary to tailor the categories to college students with TBI, since it was originally used with high school students. Adaptations were as follows:
(1) The category “Seeking Assistance from Adults” was expanded to include Disability Service personnel rather than examples such as parents.
(2) To account for the use of technology, categories were expanded accordingly. For example, “Environmental Structuring” included setting alarms or reminders using a smartphone or other technology to assist in completing tasks.
(3) The ‘uncodable’ category was replaced with an ‘other’ category (as done by Purdie and Hattie, 1996) which encompassed strategies that were non-strategic, non-academic, or strategies that were initiated by someone else. These included strategies of willpower (e.g., “I force myself to remember.”), cheating (e.g., “I got it from a friend.”), coping (e.g., “I just let it go.”), and self-advocacy (e.g., “No, you don’t understand; I have to sleep that much.”).
(4) A category of “Too Vague” was added for descriptions that did not contain enough information to be coded (e.g. “Yeah, my notes.”) and were not included in the “Other” category.
The adapted version consisted of 16 categories of self-regulated learning strategies appropriate for college students with TBI, of which 11 were original, 1 was an addition (“Too Vague”), and 4 were adapted or substantially revised. Detailed explanations and examples for each strategy category were provided to the research assistants to improve coder reliability. The complete rubric is available in Appendix A.
Strategies were also coded for specificity using a 4-point scale ranging from very vague to very specific (Kennedy & Krause, 2011). Very specific and specific strategies were those that could be easily replicated using only the information given, while vague or very vague strategies did not include enough detail for the coder to know how or in what context(s) they were being used. Ratings were collapsed into two categories: specific and vague. Disagreements in specificity coding were discussed between the raters, and consensus for specificity on 99.7% of strategies was reached. One strategy for which they could not achieve consensus was eliminated from the analysis. Appendix B is the rubric used for rating strategy specificity.
3Results
3.1Self-regulation strategy descriptions
Reliability of coding the type of self-regulation strategy was evaluated first by examining the agreement between the two trained coders of randomly selecting 20% of the strategies for comparison. Cohen’s kappa was acceptable for this subset of items (K = 0.66). Because the second rater (RA2) had less experience with the coding schema (i.e, only coded 20% of the strategies), we hypothesized that inter-rater reliability might increase with additional practice for RA2. Thus, we instructed RA2 to code the remaining 80% of the strategies. As predicted, agreement for the entire set of strategies increased substantially (K = 0.83).
As a preliminary measure of clinical change over time within a single rater, intra-rater reliability was measured by having each coder re-code 10% of randomly selected strategies. Intra-rater reliability varied between the two coders, revealing acceptable substantial to strong agreement (KRA1 = 0.90, KRA2 = 0.68). Thus, this finding suggests that this modified coding schema for self-regulation strategies could be an effective and valid measure of change in self-regulated learning strategies over time.
Having established the reliability and utility of the coding of self-regulation strategies, a number of measures were used to document the amount and type of strategy used by college students with TBI. These included: 1) the total number of self-regulation strategies reported, 2) the number of different self-regulation strategy categories reported and, 3) the percentage of strategies coded as “specific.”
Table 1 includes these measures for students at baseline and after two semesters of coaching support. Across students, the total number of self-reported strategies increased after two semesters of coaching for three of the five students; the other two reported fewer strategies than at baseline. The average number of different self-regulation strategy categories increased after two semesters of coaching, with the exception of one student. Likewise, the percentage of strategies that were coded as specific increased after two semesters of coaching for 4 of the 5 students, from an average of 36.10% to 48.84%.
Table 1
Number and types of strategies reported by students with TBI from the CSS-BI survey and interview
| Total number of strategies | Number of Self-regulation categories | Percentage of specific strategies | ||||
| Student | Baseline | After tx | Baseline | After tx | Baseline | After tx |
| 1 | 39 | 34 | 11 | 11 | 53.85% | 50.00% |
| 2 | 18 | 17 | 7 | 9 | 27.78% | 41.18% |
| 3 | 12 | 17 | 9 | 10 | 41.67% | 58.82% |
| 4 | 11 | 19 | 5 | 9 | 0.00% | 26.32% |
| 5 | 22 | 28 | 9 | 13 | 57.14% | 67.86% |
| Average | 20.40 | 23.00 | 8.20 | 10.40 | 36.10% | 48.84% |
| SD | 11.33 | 7.65 | 2.28 | 1.67 | 23.31 | 16.04 |
4Conclusion and clinical application
The primary purpose of this study was to describe how interview responses can be used to reliably identify self-regulated learning strategies, and to demonstrate how these responses can be used to help create self-regulation goals with students who are transitioning to college. To this end, students with TBI were interviewed based on their responses from the CSS-BI (Kennedy & Krause, 2009) and specifically asked about strategy usage.
4.1Self-regulation strategy measures
The adapted SRLIS coding schema of 16 types of self-regulation strategies appears to be a clinically feasible and useful tool, as demonstrated by its adequate inter- and intra-rater reliability. Our results indicated that student-reported strategies fell into a range of strategy categories using this coding schema. Furthermore, strategies could be reliably classified into strategy types both within and across coders. This aligns with high coding reliability found by previous studies that investigated the reliability of the original schema with typical learners (e.g., Zimmerman & Martinez-Pons, 1986; Purdie & Hattie, 1996). Nevertheless, we did observe that adequate experience using the coding schema is required to achieve optimal reliability; intra-rater reliability increased between our two RAs after the second RA coded the entire set of samples (as opposed to the initial random sample of 20%).
While counting the number of strategies that students self-report may be easy to do, it may not be the most informative measure when trying to determine what students are using; it does not provide information about the quality of the strategies. In other words, the use of ineffective strategies included in a total count may not serve students as well as fewer effective strategies. Furthermore, the number of strategies that students use depends heavily on their academic coursework at the time of each interview (i.e., taking easier or harder courses).
Measuring the variability of strategy categories avoids some of the limitations mentioned above. This measure also demonstrates better validity with regard to the goal of the intervention program which was to help students develop a wide array of specific strategies for their learning “toolbox.” The students could then select and employ the most appropriate strategy given the unique demands of the situation. Thus, having a wider variety of strategy categories could help them achieve their goals, given the ongoing change in academic situations, environments, and coursework. Using our adapted version of Zimmerman and Martinez-Pons’s (1986) coding schema, the number of strategy categories increased for four of the five students. Prior to coaching support, students reported using an average of 8.2 different strategy categories to manage their academic challenges. After coaching support, they reported using an average of 10.4 categories and strategies fell into 15 of the 16 self-regulation categories; only “Reviewing Tests” was not represented in the data set.
Specificity of strategies, a measure of strategy detail presented here replicates Kennedy and Krause’s (2011) findings that strategy specificity can be coded with high agreement using a consensus procedure. Across the five students, 42.6% of the strategies were coded as “specific” with a range of 0%–53.8% prior to intervention. Post-intervention, 50.4% of strategies were coded as “specific,” with a range of 26.3% to 67.9%. This change was particularly dramatic for Student 4, who initially did not describe any specific strategies. Student 1 was again the only student who did not demonstrate improvement in strategy specificity. The reason for her lack of change is not clear, but may be related to the fact that she described strategies with relatively high specificity at baseline. It should be noted that she was the only student not ‘transitioning’ to college, and had lived with her disability for some time.
4.2Using strategy information to create student-centered goals
The findings suggest that strategy type (as coded using the adapted SRLIS schema) and specificity may be useful in launching discussions that lead to goal formation. By following the survey and interview procedures, professionals can engage students in discussions in order to determine which strategies were already being used effectively or ineffectively, and can explore the use of more effective strategies with students. The following are examples of how interviews were used to identify needs and strategies currently in place, so that coaches could collaboratively create goals with students. Progress toward these goals could also then be re-assessed using the semi-structured interview format around strategy usage. These are not meant to be all-inclusive, but only serve of as examples of self-regulation, student-centered goals, areas of need that emerged from interview responses, and how progress toward those goals could be monitored.
For Student 1, the number of strategies, self-regulation categories, and percent of specific strategies did not change after coaching support. This was a student who had lived with her symptoms for years and had already developed some useful strategies for managing her post-concussion symptoms. In this sense, she was not truly transitioning to college, but had recently experienced an exacerbation of her symptoms. What emerged from her interview responses was the need to develop and use more effective time-management strategies in order to minimize her fatigue and anxiety. By the end of coaching support, she stated, “Everything’s on my planner. I’m planning more breaks…and I’m a lot more realistic about time frames.” Related to this, she was better at identifying triggers of headaches, stating “…I could probably look at my schedule and say if I’ll have a headache that day.”
Student 2’s self-report of self-regulation strategies and the specificity of his strategies had increased by the end of coaching support. At baseline he reported vague learning strategies, e.g., “just tried to study a little more.” His goal was to develop and implement effective learning strategies to recall large amounts of rote information. After coaching support, he reported “I’ve started underlining key information and picking out what I need and then always having examples of both ways to do the problem. It helps me feel more comfortable coming into it I guess.”
Student 3’s self-regulation strategies and the specificity of her strategies increased after coaching support. Before intervention, many of the strategies Student 3 described were not effective, such as, “…I use small note pads like post-its for my scheduling, but it doesn’t really work when you have to memorize a lot of terms and equations.” Her goal was to develop and implement effective strategies to increase recall of information presented in class (e.g., using the SmartPen to record and review). The interview also revealed her lack of self-advocacy when she did not understand instructions or the textbook. This was developed into a goal, so that after coaching support she reported, “I would email the TA asking, what do you mean or can you explain what this question is really asking? Or I would write what I understood from reading it and then ask, is this correct?”
Student 4 initially reported using 11 non-specific strategies that revealed a non-strategic reliance on willpower to learn academic content (e.g. “Study a lot. Make sure I know everything. Everything.”) at baseline. One of her goals was to develop and implement a combination of effective internal and external memory strategies to increase efficiency of learning/recall. After coaching support, she used more strategies and a wider range of strategy types. Furthermore, 26.3% of these strategies were coded as specific.
Student 5 described 22 strategies across 9 self-regulation categories initially. He described managing his assignments vaguely as, “Take notes and keep up with it.” He and his coach developed a goal to learn to use a smart phone to support recalling past events and remembering/planning to turn in assignments and complete tasks. After intervention, he described 28 strategies across 13 self-regulation categories and 67.9% were specific. He reported, “I write down all the assignments in my planner. I have an assignment sheet on one side and a regular calendar sheet for the day on the other side. So, then I write down all my assignments on one side after every single class both semesters this year. Usually I take as many notes as I can now for each assignment in my planner. So, like let’s say it’s for reading class, I’d write down that it was in my reading binder in the to-do section, because my folder has sections for homework not complete and homework completed.” Following intervention, Student 5 could describe specifics of strategies and systems in place for him to manage both when his assignments were due and details about what was required on the assignments.
4.3Conclusions
This preliminary study provides clinicians and researchers with an evaluation schema and numerical measures that have potential to become outcome measures for those who are receiving support as they transition to college after TBI. Having established the inter- and intra-rater reliability of identifying self-regulated learning strategies, professionals now have reliable measures with which to describe change. Although these measures represent only one aspect of change, the face validity of specific strategies and a wider variety of strategies implies that students are better equipped to manage their own transitions across the varying demands of courses, teaching styles of different professors, and course loads within semesters. Future work will benefit from determining the clinical feasibility and utility of coding strategy use in real time using the CSS-BI interview procedures. Finally, these measures may be useful as benchmarks that indicate general changes in self-regulation strategies across time, although students and professionals will continue to benefit from rich discussions about what is working and what is not. Indeed, regular feedback, particularly self-generated feedback during real-life experiences such as college, can result in more realistic self-evaluation, with the potential for students to become their own expert in the strategies that are most useful (Tate et al., 2014).
Conflict of interest
None to report.
Notes
1 Some supplemental testing was conducted initially. Reports providing detailed test results (e.g., neuropsychological test results) were available to coaches. These test results were not considered outcomes and dare not reported here
Appendices
Appendices
Appendix A
College Self-Regulated Strategy Coding Rubric (adapted from Zimmerman & Martinez-Pons, 1986; Purdie & Hattie, 1996)
As best as possible, code the behavior not your interpretation of their purpose in using the strategy. For example, if the student is taking notes as a means of relieving anxiety versus keeping track of information imparted in class, both behaviors include taking notes and therefore would fall under “Keeping Records and Monitoring.”
| Category | Definition | Examples |
| Self-Evaluation | Statements indicating student-initiated evaluations of the quality of completed work, understanding of an area of work, or effort in relation to task demands. | “I check over my work to make sure I did it right.” |
| •Checking the quality of work or effort | “I reflect on my conduct and try and work out why my work was not finished on time.” | |
| •Redoing, reworking | “I look up the answers in the back of the textbook.” | |
| •Using different methods to solve a problem and seeing if the answer is still the same | “I compare my work with my friend’s.” | |
| •Correcting work, revising, editing reflecting on work related behavior | “I ask my mother to test me to see if I know it.” | |
| Using other sources (e.g., people, computers) to check work | ||
| •Comparing with: peers, textbook solutions, answer books, other books | ||
| •Asking others to check completed work | ||
| Testing the extent of knowledge or ability to perform a task by self-testing, constructing quizzes, getting others to ask questions | ||
| Monitoring and evaluating mental state to determine whether to change or modify a strategy | ||
| Organizing and Transforming | Statements indicating student-initiated overt or covert rearrangement of instructional materials to improve learning. | “I summarize the important points from my textbook.” |
| •Summarizing; listing important points | “I make an outline before I write a paper.” | |
| •Writing outlines, drafts | “I turn down the comer of the important pages.” | |
| •Mental planning of a task including generating a to do list. See | “I use a highlighter to mark the important sections in the book.” | |
| •Goal Setting and Planning for clarification - strategies referring to “goals or subgoals and planning for sequencing, timing, and completing activities related to those goals” should be coded in that category | “I put all my notes in order in my file so I can see clearly what I have to learn for this topic.” | |
| •Highlighting, underlining, marking the important parts or main ideas, making keyword notes in the margins of a text | “I make a good copy of my essay before I hand it in.” | |
| •Organizing files, notes, etc.; writing neat or final copies of work | ||
| •Visual imagery | ||
| •Brainstorming | ||
| HINT: Consider verb - if “making” flashcards or other study guide/strategy, then code here, e.g., “I do my flashcards,” code as rehearsal, etc. If re-reading to select key points for highlighting, then code here. | ||
| Goal Setting and Planning | Statements of students’ setting goals or subgoals &planning (sequencing, timing, &completing activities) related to goals. See also prioritizing. | “I start studying 2 weeks before exams, and I pace myself. |
| •See Keeping Records and Monitoring for further clarification - simply recording items into a planner would fall in that category, while attempts to strategize or arrange that information in a planful manner would be coded here. | “I leave the difficult questions until last and then come back to them.” | |
| “I try and work out what are the most important parts for me to study and spend time on those.” | ||
| Seeking Information | Statements of student-initiated efforts to secure further task information from nonsocial sources when undertaking an assignment. This is different from reviewing textbooks. | “Before beginning to do an assignment, I go to the library to get as much information as possible concerning the topic.” |
| Keeping Records and Monitoring | Statements of student-initiated efforts to record events or results. | “I take notes of class discussions.” |
| •Note taking in class or while reading (but see Organizing and Transforming Category for further clarification). | “I keep a list of the words I get wrong.” | |
| •Note taking in class on notes supplied by the instructor (e.g., outlines or slides). | ||
| •See Goal Setting and Planning for further clarification - recording items into a planner would fall in this category, while attempts to strategize or arrange information in a planful manner would be coded as Goal Setting and Planning | ||
| Environmental Structuring | Statements indicating student-initiated efforts to organize the learning context in ways that help them to learn better. | “I isolate myself from anything that distracts me.” |
| •Physical environment: select or arrange the physical setting to make learning easier | “I turn off the radio so I can concentrate on what I’m doing.” | |
| •Self-environment: perform a particular personal behavior so that learning is improved | “I have a shower before starting my homework.” | |
| ∘ Taking breaks or time outs when necessary to “recharge” | “When I get tired, I take a break for a while.” | |
| •Use of SmartPhone specific features, such as alerts or GPS | ||
| ∘ BUT: if using SmartPhone for planning or other easily categorized purposes, then code accordingly | ||
| Self-Consequences | Statements of student arrangement or imagination of rewards or punishment for success or failure. | “If I do well on a test, I treat myself to a movie.” |
| “I imagine what my teacher will say if I don’t do my homework.” | ||
| Rehearsing and Memorizing | Statements of student-initiated efforts to memorize material by overt or covert practice. | “In preparing for a math test, I keep writing the formula down until I remember it.” |
| •Memorizing | “I do similar practice examples so that I really get to understand how to do them.” | |
| •Doing practice exercises to improve skill development or understanding | “Now I actually have to like redo it like, three, two or three times and then like go back and like try to keep myself from forgetting those things.” | |
| •Rote repetition with the intent to memorize – more than once “ over and over,” “again and again,” “many times” | “I just write like for wrong word usage like the way I studied for one of my finals was write ‘been’ and ‘Ben’ like the two different ‘been’s and I wrote them like, like just ton of times.” | |
| Other possible coding categories or exceptions: | “Just ah like when I was doing multiplication tables, like multiplication I do flash cards you know. I do flash cards every night just bam, bam, bam... ” | |
| ∘ Students are less likely to review textbooks repeatedly for the purpose of memorization (as opposed to notes). Those statements may be more appropriately categorized as reviewing records - textbooks as they seek clarification or understanding through re-reading. | ||
| ∘ Other memory or learning techniques (visual imagery, self-quizzing, etc.) should be coded accordingly. This category is for the specific memory strategy of rehearsal or repetition. | ||
| ∘ Making flashcards (or notecards) is categorized as O &T, but using them goes here | ||
| ∘ If “I look over it again,” code as reviewing, not rehearsal. | ||
| Seeking Social Assistance – Peers | Statements of student-initiated efforts to solicit help from other people. This is different from Self-Evaluation where students specifically ask someone to check their work to see if it is correct. Seeking assistance is less specific; it usually involves asking someone for help when there is something the student doesn’t understand. | “If I have a problem with a math assignment, I ask a friend to help.” |
| Seeking Social Assistance – Teachers | Statements of student-initiated efforts to solicit help from other people. This is different from Self-Evaluation where students specifically ask someone to check their work to see if it is correct. Seeking assistance is less specific; it usually involves asking someone for help when there is something the student doesn’t understand. | “I talk to my teacher after the lesson about my assignment.” |
| •This category includes teachers or teaching assistants. | ||
| Seeking Social Assistance – Adults and DS | Statements of student-initiated efforts to solicit help from other people. This is different from Self-Evaluation where students specifically ask someone to check their work to see if it is correct. Seeking assistance is less specific; it usually involves asking someone for help when there is something the student doesn’t understand. Adult assistance includes disability services, out-of-school tutors and all unidentified people. | “I ask members of my family what they think about the topic.” |
| •Includes statements about accommodations, “I use a note taker in class,” whereas statements about use of such materials would be coded accordingly, e.g. “I review the notes my note taker takes in class.” | “My tutor explains the parts I can’t understand.” | |
| •Use of readers such as Kurzweil falls under this category. | ||
| •Any mention of use of DS accommodations such as using a notetaker or taking an exam in a private or semi-private room. | ||
| Reviewing Records – Tests | Statements indicating student-initiated efforts to revise or review relevant work, e.g., Reviewing tests or other completed work | “I read the essays that I wrote last term.” |
| Reviewing Records – Notes (including audio) | Statements indicating student-initiated efforts to revise or review relevant work, e.g., Reviewing notes or audio | “When preparing for a test, I review my notes.” |
| Reviewing Records – Textbooks | Statements indicating student-initiated efforts to revise or review relevant work | “I read the textbook if there is one.” |
| •Reviewing textbooks | ||
| •Also reviewing highlighted text in textbooks | ||
| •Also includes any assigned readings or materials provided by the teacher (i.e. journal articles, worksheets, syllabus). | ||
| •Reviewing lecture notes or notes supplied by others fall into the “reviewing notes” category. | ||
| Other (Non-strategic) | Nonstrategic | “I just force myself to study.” |
| Statements indicating a resolve by the student to persist with a task or to use some source of “inner energy.” | “I persist until I can solve all of the problems.” | |
| •Using willpower | “I copy my friend’s work.” | |
| •Cheating: Statements indicating complete reliance on the work of others in order to finish a task. | “I copy the answers from the answer book.” | |
| •Or statements indicating learning behavior that is initiated by other persons such as teachers or parents. | “I just do what the teacher says.” | |
| •Uncategorized statements such as statements of emotional regulation | “I try to make myself do it sooner.” | |
| ∘ Coping: Relies more on managing internal states or social interactions and expectations. (e.g. “ I can’t remember, so I just let it go.”) | “I was like okay I can’t I can’t take everything so seriously.” | |
| ∘ Self-Advocacy: Explaining your circumstances to someone else (e.g. “I just tell them that like it’s not because I don’t want to, I can’t.”) | “Make sure I know everything. Everything.” | |
| Too Vague or Unable to Code | Other (vague, unscorable, reactive) | “I write down everything.” |
| •Statements that could not be clearly categorized as one of the above, either because they were not specific enough or because the student’s intention was unclear. | “Um, just read it over more often.” | |
| •If there are items that seem to fall into multiple categories and cannot come to a conclusion - consider this coding instead. May not have provided enough detail or context to be able to accurately code the strategy. | “Well that’s the planner has been coming now.” |
Appendix B
College Strategy Specificity Coding Rubric
Rate each strategy from “very vague” to “very specific.” For example, if you wanted to save money, a vague strategy would be “to spend less,” while a specific strategy would be “to use coupons from the newspaper for groceries.” One way to think about specificity is to imagine whether or not you would be able to carry out the strategy exactly the way she or he described it.
When coding for specificity, be sure to think about the strategy for which the item was coded. For example, if the student mentions taking notes, how specifically does the student describe the note-taking strategy? Similarly, if the student mentions planning and scheduling time for studying, consider how specifically the execution of the strategy is described.
| Rating | Category | Description | Example |
| 1 | Very Vague | •No detail provided. | “I just take notes.” |
| •Unable to imagine what the execution of the strategy might look like and the situation in which it might be used. | “Yeah, my phone.” | ||
| •Cannot be replicated. | |||
| •Strategies identified as “Too Vague or Unable to Code” likely fall into this category, although should be independently rated (e.g. some may not be able to be categorized above because a single component is missing, or could fall into more than one category). | |||
| ∘ “I ask after class what the homework is and when it is due.” Enough detail to be rated as “Vague” here. | |||
| 2 | Vague | •Only minimal detail provided. | “I just take notes in class.” |
| •Unclear what the execution of the strategy might look like or the situation in which it might be used. | “I don’t get stressed because then I have a nap afterwards.” | ||
| •Can be partly recreated, but would need more detail to be able to fully replicated. | |||
| 3 | Specific | Adequate detail is provided. | “I take notes every class on the powerpoint slides.” |
| •It is clear how the student executes the strategy and in what situations it is used. | “I write down all the homework in my calendar, cuz it has a homework sheet on one side and like a regular sheet on the other side, just a calendar sheet, so then I write down all my homework on one side after every class this year.” | ||
| •The “gist” of the strategy can be replicated, although additional details might help to recreate it exactly. | |||
| •A list of accommodations is a 3, but any elaboration on that list (e.g. how used, how acquired, why recommended, etc.) is a 4. | |||
| 4 | Very Specific | •Extensive detail is provided. | “I take notes every class on the powerpoint slides. I don’t write down everything, instead I write the key points and then bullet details below.” |
| •It is very clear how the student executes the strategy and in what situations it is used. | “When I’m studying for quizzes, I’ll write down a vocabulary word and then I’ll put it in a sentence and so that I’m using the word and then figuring out how to write a sentence with it.” | ||
| •The strategy can be easily replicated, without need for any additional details. | |||
| •A list of accommodations is a 3, but any elaboration on that list (e.g. how used, how acquired, why recommended, etc.) is a 4. |
Acknowledgments
This work was supported in part by the University of Minnesota – Twin Cities, Department of Speech-Language-Hearing Sciences and a grant with the Minnesota Department of Employment and Economic Development (DEED). A special acknowledgment is extended to Lauren O’Connor and Alissa Allison who served as research assistant coders.
References
1 | Kennedy M. , & Coelho C. ((2005) ). Self-regulation after traumatic brain injury: A framework for intervention of memory and problem solving. Seminars in Speech and Language, 26: (4), 242–255. |
2 | Kennedy M. R. T. , & Krause M. O. ((2009) ). College survey for students with brain injury. Available online at: http://neurocognitivelab.com/wp-content/uploads/2011/12/College-Survey-for-Students-with-Brain-Injury.pdf |
3 | Kennedy M. R. T. , & Krause M. O. ((2011) ). Self-regulated learning in a dynamic coaching model for supporting college students with traumatic brain injury. Journal of Head Trauma Rehabilitation, 26: (3), 212–223. |
4 | Kennedy M. R. T. , Krause M. O. , & O’Brien K. H. ((2014) ). Psychometric properties of the college survey for students with brain injury: Individuals with and without traumatic brain injury. Brain Injury, 28: (13-14), 1748–1757. |
5 | Kennedy M. R. T. ((2017) ), Coaching college students with executive function problems.New York (NY): Guilford Publications. |
6 | Krause M. , & Richards S. ((2014) ). Prevalence of traumatic brain injury and access to services in an undergraduate population: A pilot study. Brain Injury, 28: (10), 1301–1310. |
7 | Ley K. , & Young D. B. ((1998) ). Self-regulation behaviors in underprepared (developmental) and regular admission college students. Contemporary Educational Psychology, 23: , 42–64. |
8 | Nandagopal K. , & Ericsson K. A. ((2012) ). An expert performance approach to the study of individual differences in self-regulated learning activities in upper-level college students. Learning and Individual Differences, 22: (5), 597–609. |
9 | Purdie N. , Hattie J. , & Douglas G. ((1996) ). Student conceptions of learning and their use of self-regulated learning strategies: A cross-cultural comparison. Journal of Educational Psychology, 88: (1), 87–100. |
10 | Raue K. , & Lewis L. ((2011) ). Students with disabilities at degree-granting postsecondary institutions. National Center for Education Statistics, US Department of Education, Statistical Analysis Report, 18: . |
11 | Ruban L. M. , McCoach D. B. , McGuire J. M. , & Reis S. M. ((2003) ). The differential impact of academic self-regulatory methods on achievement among university student with and without learning disabilities. Journal of Learning Disabilities, 36: (3), 270–286. |
12 | Ruban L. , & Reis S. M. ((2006) ). Patterns of self-regulatory strategy use among low-achieving and high-achieving university students. Roeper Review, 28: (3), 148–156. |
13 | Tang E. L. ((2015) ). Self-Regulated Learning of Pre-University Students in Mathematics Classrooms. Journal of Educational Sciences and Psychology, 3: (2), 40–47. |
14 | Tate R. , Kennedy M. R. T. , Bayley M. , Bragge P. , Douglas J. , Kita M. , Ponsford J. , ((2014) ). INCOG recommendations for management of cognition following traumatic brain injury Part VI: Executive function and self-awareness. Journal of Head Trauma Rehabilitation, 29: (4), 338–352. |
15 | Tuckman B. W. , & Kennedy G. J. ((2011) ). Teaching learning strategies to increase success of first-term college students. The Journal of Experimental Education, 79: (4), 478–504. |
16 | Willmott C. , Ponsford J. , Downing M. , & Carty M. ((2014) ). Frequency and quality of return to study following traumatic brain injury. Journal of Head Trauma Rehabilitation, 29: (3), 248–256. |
17 | Zimmerman B. J. , & Martinez-Pons M. ((1986) ). Development of a structured interview for assessing student use of self-regulated learning strategies. American Educational Research Journal, 23: (4), 614–628. |
18 | Zimmerman B. J. , & Martinez-Pons M. ((1988) ). Construct validation of a strategy model of student self-regulated learning. Journal of Educational Psychology, 80: (3), 284–290. |
