


Study with the several resources on Docsity
Earn points by helping other students or get them with a premium plan
Prepare for your exams
Study with the several resources on Docsity
Earn points to download
Earn points by helping other students or get them with a premium plan
Community
Ask the community for help and clear up your study doubts
Discover the best universities in your country according to Docsity users
Free resources
Download our free guides on studying techniques, anxiety management strategies, and thesis advice from Docsity tutors
An assessment report for the critical writing and reading core (intd 105) program at suny geneseo. The report covers the assessment period from 2004-2005 and focuses on the educational outcome of students' ability to produce coherent texts. The assessment was based on class sets of papers and their revisions, using the suny general education assessment rubric. The report discusses the criteria for success, assessment data, factors influencing differences among scorers, and potential program changes.
Typology: Exams
1 / 4
This page cannot be seen from the preview
Don't miss anything!
To complete this form, replace the text below each question with your own text. Complete a separate form for each outcome assessed. Save the completed form, making sure to include your four-letter program prefix (e.g., Geog, Engl) and the word results in the filename. Deposit the file in the Assessment InBox by navigating to \files\inbox\admin and dragging the file into the folder named “assess”. (Note that you cannot open the folder; access is restricted.) If you are filing multiple forms, filenames cannot be identical; distinguish filenames with numbers. Sample filename: Geog_results_1.doc. Place ancillary documentation such as charts and graphs in a separate file or files. Name these as appropriate, but again, please include the program prefix. For help using InBoxes and OutBoxes, consult CIT’s QuickGuide, In and Out Boxes at Geneseo.
Students will demonstrate the ability to produce coherent texts within college-level forms.
Class sets of papers and their revisions were collected from each section of INTD 105 during the 2004-05 academic year. Papers were sampled from sections to represent student writing across the program. Some sections failed to include revisions and were not included in the sampling. In all, 79 different essays and their revisions were assessed by teams of two readers, following the 2005 version of the SUNY General Education Assessment Rubric ( see attached rubric file ) for production of coherent texts and revision and improvement of texts. To improve inter-rater reliability, most assessors gathered to review the rubric together prior to scoring essays. Because it is proving increasingly difficult to recruit faculty volunteers, some assessors worked independently, following written instructions from the Chair of the Critical Writing and Reading Core Committee. Scorers demonstrated fairly close agreement on student essays, but there is little room for difference on a four-point scale. Our data are reported in two ways: averaged scores for 79 essays and unaveraged scores (158—each paper read twice).
SUNY General Assessment requires reports in two areas: production of text and revision of texts. We have separated each area into sub-sections suggested by the GEAR directions. This report discusses "Production." Production: Thesis Coherence, logic, creativity Sentence structure, vocabulary, tone, diction, sense of audience Mechanics—grammar, punctuation, documentation In each area we expect at least 85% of students will achieve a score of "2" (approaching), or "3" (meeting the criteria), or higher.
Please see attached charts. Assessment based on total scores (158 readings) Skill % earning 1 % earning 2 % earning 3 % earning 4 Thesis 11% 42% 41% 6% Coherence 7% 54% 33% 6% Structure 4% 44% 44% 8% Mechanics 8% 32% 54% 6% Assessment based on averaged scores (79 essays) Skill % earning 1- 1.5^ % earning 2-2.5^ % earning 3-3.5^ % earning 4 Thesis 13% 57% 29% 1% Coherence 13% 62% 23% 2% Structure 5% 61% 32% 2% Mechanics 10% 50% 39% 1% The difference in the two data sets reflects inter-rater gaps (e.g., both scorers would have to award a "4" for that to appear in the averaged score category). Although the percentages shift, both sets of scores reflect the same trend: 85% met minimal competency (at least approaching the criteria). But the scores at the upper end suggest that for most skills, faculty perceive that fewer than half of our students write competently ("meeting"). What factors account for differences among scorers? Anecdotally, faculty who have recently taught at other institutions score Geneseo students higher, because most papers are grammatically competent and have some sense of direction for their essays. In other words, they do not exhibit the kinds of writing problems found among students in less academically competitive student bodies. Faculty who have taught longer at
During the 2004-05 academic year, INTD 105 changed one of its requirements from encouraging the teaching of revision to requiring it. This change has generated important discussions about how to teach students that revision is more than "fixing mistakes." This will be further discussed in INTD10504-05results2.doc.