Program: Religion (BA)
Degree: Bachelor's
Date: Sun Oct 18, 2009 - 5:31:27 pm
1) List your program's student learning outcomes (SLOs).
1. Students acquire basic knowledge and understanding of the history, scriptures, doctrines, rituals and other practices of the major world religious traditions.
2. Students become acquainted with major themes in the study of religion.
3. Students read and analyze primary source material, including scriptures, faith statements, etc.
4. Students read and analyze scholarly articles and monographs in the field.
5. Students begin the process of learning to write scholarly materials in genres appropriate to the field of Religion, including research papers, exegetical essays, etc.
2) Where are your program's SLOs published?
Department Website URL: www.hawaii.edu/religion/major-minor.html
Student Handbook. URL, if available online: Information Sheet, Flyer, or Brochure URL, if available online: UHM Catalog. Page Number: Course Syllabi. URL, if available online: Other: Other: 3) Upload your program's current curriculum map(s) as a PDF.
4) What percentage of courses have the course SLOs explicitly stated on the course syllabus, department website, or other publicly available document? (Check one)
0% 1-50%
51-80% 81-99% 100%5) State the SLO(s) that was Assessed, Targeted, or Studied
• In Fall 2008, the Assessment team mapped the undergraduate curriculum against the previously established SLOs.
• The team identified SLO #2 and SLO #4 for evaluation.
6) State the Assessment Question(s) and/or Goal(s) of Assessment Activity
The team wanted to find out whether, and to what extent, undergraduates were:
1) becoming acquainted with major themes in the study of religion; and
2) reading and analyzing scholarly articles and monographs in the field.
7) State the Type(s) of Evidence Gathered
Final examinations for the required REL 300 class were collected and scored on a standard 2-point scale (2.0=Very good; 1.0=Satisfactory; 0.0=Unsatisfactory) by two faculty members, Professor Helen Baroni and Professor James Frankel.
8) State How the Evidence was Interpreted, Evaluated, or Analyzed
Professors Baroni and Frankel chose to read a sample of Professor Kristin Bloomer's final exams. Prof. Baroni randomly chose the sample. Profs. Baroni and Frankel met and shared their data. Prof. Baroni typed up the results.
9) State How Many Pieces of Evidence Were Collected
Ten exams from a total of 24 were randomly selected from the pile by Prof. Baroni.
10) Summarize the Actual Results
Results:
Results are summarized in the following chart
Assessment Item HJB JDF Combined
SLO #2 0.95 0.7 0.825
SLO #4 1.0 0.8 0.9
Overall rating 1.05 0.825 0.94
• Scoring fell within acceptable variation.
• Average combined score for SLO #2 was 0.825, falling below satisfactory level.
• Average combined score for SLO #4 was 0.9, approaching the satisfactory level.
• Average combined score for Overall assessment of the exams was 0.94, approaching the satisfactory level.
• Raw data is attached below.
Score sheet for Examinations
Exam #1
Date of exam: Fall 2008
Evaluator: James D. Frankel
Evaluation Scale
0.0 Unsatisfactory
1.0 Satisfactory
2.0 Very good
1. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 1
2. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 1
3. Overall rating: 1
Score sheet for Examinations
Exam #2
Date of exam: Fall 2008
Evaluator: James D. Frankel
Evaluation Scale
3.0 Unsatisfactory
4.0 Satisfactory
5.0 Very good
1. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 1.5
2. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 2
3. Overall rating: 1.75
Score sheet for Examinations
Exam #3
Date of exam: Fall 2008
Evaluator: James D. Frankel
Evaluation Scale
6.0 Unsatisfactory
7.0 Satisfactory
8.0 Very good
1. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 1
2. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 0.5
3. Overall rating: 1
Score sheet for Examinations
Exam #4
Date of exam: Fall 2008
Evaluator: James D. Frankel
Evaluation Scale
9.0 Unsatisfactory
10.0 Satisfactory
11.0 Very good
1. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 0.5
2. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 0.5
3. Overall rating: 0.5
Score sheet for Examinations
Exam #5
Date of exam: Fall 2008
Evaluator: James D. Frankel
Evaluation Scale
12.0 Unsatisfactory
13.0 Satisfactory
14.0 Very good
1. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 0.5
2. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 0.5
3. Overall rating: 0.5
Score sheet for Examinations
Exam #6
Date of exam: Fall 2008
Evaluator: James D. Frankel
Evaluation Scale
15.0 Unsatisfactory
16.0 Satisfactory
17.0 Very good
1. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 0.5
2. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 0.5
3. Overall rating: 0.5
Score sheet for Examinations
Exam #7
Date of exam: Fall 2008
Evaluator: James D. Frankel
Evaluation Scale
18.0 Unsatisfactory
19.0 Satisfactory
20.0 Very good
1. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 1
2. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 1
3. Overall rating: 1
Score sheet for Examinations
Exam #8
Date of exam: Fall 2008
Evaluator: James D. Frankel
Evaluation Scale
21.0 Unsatisfactory
22.0 Satisfactory
23.0 Very good
4. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 0.5
5. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 1
6. Overall rating: 1
Score sheet for Examinations
Exam #9
Date of exam: Fall 2008
Evaluator: James D. Frankel
Evaluation Scale
24.0 Unsatisfactory
25.0 Satisfactory
26.0 Very good
4. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 0.5
5. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 0.5
6. Overall rating: 0.5
Score sheet for Examinations
Exam #10
Date of exam: Fall 2008
Evaluator: James D. Frankel
Evaluation Scale
27.0 Unsatisfactory
28.0 Satisfactory
29.0 Very good
7. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 0.5
8. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 0
9. Overall rating: 0.5
Score sheet for Examinations
Exam #1
Date of exam: Fall 2008
Evaluator: Helen J. Baroni
Evaluation Scale
30.0 Unsatisfactory
31.0 Satisfactory
32.0 Very good
7. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 1.5
8. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 1.5
9. Overall rating: 1.5
Score sheet for Examinations
Exam #2
Date of exam: Fall 2008
Evaluator: Helen J. Baroni
Evaluation Scale
33.0 Unsatisfactory
34.0 Satisfactory
35.0 Very good
10. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 2
11. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 2
12. Overall rating: 2
Score sheet for Examinations
Exam #3
Date of exam: Fall 2008
Evaluator: Helen J. Baroni
Evaluation Scale
36.0 Unsatisfactory
37.0 Satisfactory
38.0 Very good
4. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 1
5. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 1
6. Overall rating: 1
Score sheet for Examinations
Exam #4
Date of exam: Fall 2008
Evaluator: Helen J. Baroni
Evaluation Scale
39.0 Unsatisfactory
40.0 Satisfactory
41.0 Very good
4. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 1
5. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 1
6. Overall rating: 1
Score sheet for Examinations
Exam #5
Date of exam: Fall 2008
Evaluator: Helen J. Baroni
Evaluation Scale
42.0 Unsatisfactory
43.0 Satisfactory
44.0 Very good
4. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 0.5
5. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 1
6. Overall rating: 1
Score sheet for Examinations
Exam #6
Date of exam: Fall 2008
Evaluator: Helen J. Baroni
Evaluation Scale
45.0 Unsatisfactory
46.0 Satisfactory
47.0 Very good
4. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 1
5. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 1
6. Overall rating: 1
Score sheet for Examinations
Exam #7
Date of exam: Fall 2008
Evaluator: Helen J. Baroni
Evaluation Scale
48.0 Unsatisfactory
49.0 Satisfactory
50.0 Very good
4. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 1.5
5. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 1
6. Overall rating: 1
Score sheet for Examinations
Exam #8
Date of exam: Fall 2008
Evaluator: Helen J. Baroni
Evaluation Scale
51.0 Unsatisfactory
52.0 Satisfactory
53.0 Very good
13. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 1
14. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 0.5
15. Overall rating: 1
Score sheet for Examinations
Exam #9
Date of exam: Fall 2008
Evaluator: Helen J. Baroni
Evaluation Scale
54.0 Unsatisfactory
55.0 Satisfactory
56.0 Very good
10. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 0.5
11. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 0.5
12. Overall rating: 0.5
Score sheet for Examinations
Exam #10
Date of exam: Fall 2008
Evaluator: Helen J. Baroni
Evaluation Scale
57.0 Unsatisfactory
58.0 Satisfactory
59.0 Very good
16. Student demonstrates acquaintance with major themes in the study of religion (SLO #2) 0.5
17. Student demonstrates an ability to read and analyze scholarly writing (SLO #4) 0.5
18. Overall rating: 0.5
11) Briefly Describe the Distribution and Discussion of Results
Prof. Bloomer received the results. She will distribute and explain them at the next faculty meeting.
12) Describe Conclusions and Discoveries
Recommendations from Profs. Baroni and Frankel:
• Faculty should discuss means to improve critical reading of scholarly materials throughout the undergraduate curriculum.
13) Use of Results/Program Modifications: State How the Program Used the Results --or-- Explain Planned Use of Results
We will discuss the results and reassess our assessment plan. This assessment team coordinator notes that the means of assessment seems insufficient, as:
1.) Prof. Bloomer didn't know that her exams would be used this way until after she had administered them (though that is arguably a good thing; indeed, we may want to discuss a similar "surprise sampling" of exams/papers from other professors) ;
2.) It seems to department members that students taking REL 300 actually do become acquainted with major themes in the study of religion; and that
3.) All students taking REL 300 read and analyze scholarly articles and monographs in the field.
Thus, the determination by Profs. Baroni and Frankel that the results are below satisfactory requires more discussion and clarification. Does their reading of the exam results reflect a low level of student skill in meeting these SLOs across the curriculum, or does it say something specifically about our program? About REL 300? About the exam's ability to measure these SLOs?
14) Reflect on the Assessment Process
Next time this assessment coordinator, who also supplied the exams for the assessment, will recommend that:
- We assess a wider range of student exams/papers from other classes.
- We consider holding focus groups with undergraduates and perhaps use the new "departmental meet and greet," along with exit interviews, to assess the program.
- We review the ability of this type of REL 300 exam (written essay responses to passages by key theorists in the field)to measure SLOs.