Docsity
Docsity

Prepare for your exams
Prepare for your exams

Study with the several resources on Docsity


Earn points to download
Earn points to download

Earn points by helping other students or get them with a premium plan


Guidelines and tips
Guidelines and tips

Assessment Report for INTD 105 Critical Writing and Reading Core at SUNY Geneseo, Exams of Humanities

An assessment report for the critical writing and reading core (intd 105) program at suny geneseo. The report covers the assessment period from 2004-2005 and focuses on the educational outcome of students' ability to produce coherent texts. The assessment was based on class sets of papers and their revisions, using the suny general education assessment rubric. The report discusses the criteria for success, assessment data, factors influencing differences among scorers, and potential program changes.

Typology: Exams

Pre 2010

Uploaded on 08/18/2009

koofers-user-jvx-1
koofers-user-jvx-1 🇺🇸

5

(1)

10 documents

1 / 4

Toggle sidebar

This page cannot be seen from the preview

Don't miss anything!

bg1
SUNY GENESEO PROGRAM ASSESSMENT REPORT
FORM C: RESULTS
To complete this form, replace the text below each question with your own
text. Complete a separate form for each outcome assessed. Save the
completed form, making sure to include your four-letter program prefix
(e.g., Geog, Engl) and the word results in the filename. Deposit the file in the
Assessment InBox by navigating to \\files\inbox\admin and dragging the file
into the folder named “assess”. (Note that you cannot open the folder;
access is restricted.) If you are filing multiple forms, filenames cannot be
identical; distinguish filenames with numbers. Sample filename:
Geog_results_1.doc. Place ancillary documentation such as charts and
graphs in a separate file or files. Name these as appropriate, but again,
please include the program prefix. For help using InBoxes and OutBoxes,
consult CIT’s QuickGuide, In and Out Boxes at Geneseo.
PROGRAM: Critical Writing and Reading Core (INTD 105)
DEGREE LEVEL: 01
ASSESSMENT PERIOD COVERED: 2004-2005
DATE SUBMITTED: 27 September 2005
YOUR NAME AND POSITION: Celia Easton, Chair, Critical Writing
and Reading Core.
INTENDED EDUCATIONAL OUTCOME:
Students will demonstrate the ability to produce coherent texts within college-level forms.
What was your first means of assessment for this outcome?
Class sets of papers and their revisions were collected from each section of INTD 105
during the 2004-05 academic year. Papers were sampled from sections to represent
student writing across the program. Some sections failed to include revisions and were
not included in the sampling. In all, 79 different essays and their revisions were
assessed by teams of two readers, following the 2005 version of the SUNY General
Education Assessment Rubric (see attached rubric file) for production of coherent texts
and revision and improvement of texts.
To improve inter-rater reliability, most assessors gathered to review the rubric together
prior to scoring essays. Because it is proving increasingly difficult to recruit faculty
volunteers, some assessors worked independently, following written instructions from
the Chair of the Critical Writing and Reading Core Committee.
Scorers demonstrated fairly close agreement on student essays, but there is little room
for difference on a four-point scale. Our data are reported in two ways: averaged scores
for 79 essays and unaveraged scores (158—each paper read twice).
pf3
pf4

Partial preview of the text

Download Assessment Report for INTD 105 Critical Writing and Reading Core at SUNY Geneseo and more Exams Humanities in PDF only on Docsity!

SUNY GENESEO PROGRAM ASSESSMENT REPORT

FORM C: RESULTS

To complete this form, replace the text below each question with your own text. Complete a separate form for each outcome assessed. Save the completed form, making sure to include your four-letter program prefix (e.g., Geog, Engl) and the word results in the filename. Deposit the file in the Assessment InBox by navigating to \files\inbox\admin and dragging the file into the folder named “assess”. (Note that you cannot open the folder; access is restricted.) If you are filing multiple forms, filenames cannot be identical; distinguish filenames with numbers. Sample filename: Geog_results_1.doc. Place ancillary documentation such as charts and graphs in a separate file or files. Name these as appropriate, but again, please include the program prefix. For help using InBoxes and OutBoxes, consult CIT’s QuickGuide, In and Out Boxes at Geneseo.

PROGRAM: Critical Writing and Reading Core (INTD 105)

DEGREE LEVEL: 01

ASSESSMENT PERIOD COVERED: 2004-

DATE SUBMITTED: 27 September 2005

YOUR NAME AND POSITION: Celia Easton, Chair, Critical Writing

and Reading Core.

INTENDED EDUCATIONAL OUTCOME:

Students will demonstrate the ability to produce coherent texts within college-level forms.

What was your first means of assessment for this outcome?

Class sets of papers and their revisions were collected from each section of INTD 105 during the 2004-05 academic year. Papers were sampled from sections to represent student writing across the program. Some sections failed to include revisions and were not included in the sampling. In all, 79 different essays and their revisions were assessed by teams of two readers, following the 2005 version of the SUNY General Education Assessment Rubric ( see attached rubric file ) for production of coherent texts and revision and improvement of texts. To improve inter-rater reliability, most assessors gathered to review the rubric together prior to scoring essays. Because it is proving increasingly difficult to recruit faculty volunteers, some assessors worked independently, following written instructions from the Chair of the Critical Writing and Reading Core Committee. Scorers demonstrated fairly close agreement on student essays, but there is little room for difference on a four-point scale. Our data are reported in two ways: averaged scores for 79 essays and unaveraged scores (158—each paper read twice).

What were your criteria for success for this outcome?

SUNY General Assessment requires reports in two areas: production of text and revision of texts. We have separated each area into sub-sections suggested by the GEAR directions. This report discusses "Production." Production: Thesis Coherence, logic, creativity Sentence structure, vocabulary, tone, diction, sense of audience Mechanics—grammar, punctuation, documentation In each area we expect at least 85% of students will achieve a score of "2" (approaching), or "3" (meeting the criteria), or higher.

Please summarize the assessment data you collected on this

outcome.

Please see attached charts. Assessment based on total scores (158 readings) Skill % earning 1 % earning 2 % earning 3 % earning 4 Thesis 11% 42% 41% 6% Coherence 7% 54% 33% 6% Structure 4% 44% 44% 8% Mechanics 8% 32% 54% 6% Assessment based on averaged scores (79 essays) Skill % earning 1- 1.5^ % earning 2-2.5^ % earning 3-3.5^ % earning 4 Thesis 13% 57% 29% 1% Coherence 13% 62% 23% 2% Structure 5% 61% 32% 2% Mechanics 10% 50% 39% 1% The difference in the two data sets reflects inter-rater gaps (e.g., both scorers would have to award a "4" for that to appear in the averaged score category). Although the percentages shift, both sets of scores reflect the same trend: 85% met minimal competency (at least approaching the criteria). But the scores at the upper end suggest that for most skills, faculty perceive that fewer than half of our students write competently ("meeting"). What factors account for differences among scorers? Anecdotally, faculty who have recently taught at other institutions score Geneseo students higher, because most papers are grammatically competent and have some sense of direction for their essays. In other words, they do not exhibit the kinds of writing problems found among students in less academically competitive student bodies. Faculty who have taught longer at

Do you plan, or are you considering, any program changes in

light of the assessment results you are reporting on this form?

If so, please describe the changes below.

During the 2004-05 academic year, INTD 105 changed one of its requirements from encouraging the teaching of revision to requiring it. This change has generated important discussions about how to teach students that revision is more than "fixing mistakes." This will be further discussed in INTD10504-05results2.doc.