Unit: Women's Studies
Program: Women's Studies (BA)
Degree: Bachelor's
Date: Mon Nov 09, 2020 - 6:17:51 pm

1) Program Student Learning Outcomes (SLOs) and Institutional Learning Objectives (ILOs)

1. Demonstrated ability to engage in critical and interdisciplinary thinking, analysis, and problem solving through effective written and oral communication.

(1a. General education, 1b. Specialized study in an academic field, 1c. Understand Hawaiian culture and history, 2a. Think critically and creatively, 2b. Conduct research, 2c. Communicate and report, 3a. Continuous learning and personal growth, 3b. Respect for people and cultures, in particular Hawaiian culture, 3c. Stewardship of the natural environment, 3d. Civic participation)

2. Evidence of ability to integrate key concepts in Women's Studies, including the social construction of gender; intersectionalities among gender, sexuality, race, class and other vectors of power and identity; social stratification; and how these issues manifest in a Pacific-Asia context in written and oral work.

(1a. General education, 1b. Specialized study in an academic field, 1c. Understand Hawaiian culture and history, 2a. Think critically and creatively, 2b. Conduct research, 2c. Communicate and report, 3a. Continuous learning and personal growth, 3b. Respect for people and cultures, in particular Hawaiian culture, 3c. Stewardship of the natural environment, 3d. Civic participation)

3. Demonstrated ability to connect the classroom with "real world" feminist issues through active engagement in citizenship and civic participation.

(1a. General education, 1b. Specialized study in an academic field, 1c. Understand Hawaiian culture and history, 2a. Think critically and creatively, 2b. Conduct research, 2c. Communicate and report, 3a. Continuous learning and personal growth, 3b. Respect for people and cultures, in particular Hawaiian culture, 3c. Stewardship of the natural environment)

2) Your program's SLOs are published as follows. Please update as needed.

Department Website URL: http://womenstudies.manoa.hawaii.edu/
Student Handbook. URL, if available online:
Information Sheet, Flyer, or Brochure URL, if available online:
UHM Catalog. Page Number:
Course Syllabi. URL, if available online:
Other:

3) Please review, add, replace, or delete the existing curriculum map.

Curriculum Map File(s) from 2020:

4) For your program, the percentage of courses that have course SLOs explicitly stated on the syllabus, a website, or other publicly available document is as follows. Please update as needed.

0%
1-50%
51-80%
81-99%
100%

5) Does the program have learning achievement results for its program SLOs? (Example of achievement results: "80% of students met expectations on SLO 1.")(check one):

No
Yes, on some(1-50%) of the program SLOs
Yes, on most(51-99%) of the program SLOs
Yes, on all(100%) of the program SLOs

6) Did your program engage in any program learning assessment activities between November 1, 2018 and October 31, 2020?

Yes
No (skip to question 17)

7) What best describes the program-level learning assessment activities that took place for the period November 1, 2018 and October 31, 2020? (Check all that apply.)

Create/modify/discuss program learning assessment procedures (e.g., SLOs, curriculum map, mechanism to collect student work, rubric, survey)
Collect/evaluate student work/performance to determine SLO achievement
Collect/analyze student self-reports of SLO achievement via surveys, interviews, or focus groups
Use assessment results to make programmatic decisions (e.g., change course content or pedagogy, design new course, hiring)
Investigate other pressing issue related to student learning achievement for the program (explain in question 8)
Other:

8) Briefly explain the assessment activities that took place since November 2018.

For the 2017-2019 assessment, the University of Hawaii at Mānoa’s Department of Women’s Studies employed a student survey. Exit interviews from graduating seniors were not collected due to Departmental restructuring and COVID-19, and thus are not represented in this three year assessment report. The student survey asked questions that aligned with departmental Student Learning Objectives (SLOs). This assessment report includes several tables depicting data ranges and table summaries to assist in data interpretation for both the Department and the University. 

9) What types of evidence did the program use as part of the assessment activities checked in question 7? (Check all that apply.)

Artistic exhibition/performance
Assignment/exam/paper completed as part of regular coursework and used for program-level assessment
Capstone work product (e.g., written project or non-thesis paper)
Exam created by an external organization (e.g., professional association for licensure)
Exit exam created by the program
IRB approval of research
Oral performance (oral defense, oral presentation, conference presentation)
Portfolio of student work
Publication or grant proposal
Qualifying exam or comprehensive exam for program-level assessment in addition to individual student evaluation (graduate level only)
Supervisor or employer evaluation of student performance outside the classroom (internship, clinical, practicum)
Thesis or dissertation used for program-level assessment in addition to individual student evaluation
Alumni survey that contains self-reports of SLO achievement
Employer meetings/discussions/survey/interview of student SLO achievement
Interviews or focus groups that contain self-reports of SLO achievement
Student reflective writing assignment (essay, journal entry, self-assessment) on their SLO achievement.
Student surveys that contain self-reports of SLO achievement
Assessment-related such as assessment plan, SLOs, curriculum map, etc.
Program or course materials (syllabi, assignments, requirements, etc.)
Other 1:
Other 2:

10) State the number of students (or persons) who submitted evidence that was evaluated. If applicable, please include the sampling technique used.

For the 2017-2019 assessment, 164 students completed self-assessment surveys. Surveys were conducted in class and near the end of the regular semester with the aim of collecting student perceptions of their learning and achievement of SLOs. 

11) Who interpreted or analyzed the evidence that was collected? (Check all that apply.)

Course instructor(s)
Faculty committee
Ad hoc faculty group
Department chairperson
Persons or organization outside the university
Faculty advisor
Advisors (in student support services)
Students (graduate or undergraduate)
Dean/Director
Other:

12) How did they evaluate, analyze, or interpret the evidence? (Check all that apply.)

Used a rubric or scoring guide
Scored exams/tests/quizzes
Used professional judgment (no rubric or scoring guide used)
Compiled survey results
Used qualitative methods on interview, focus group, open-ended response data
External organization/person analyzed data (e.g., external organization administered and scored the nursing licensing exam)
Other:

13) Summarize the results from the evaluation, analysis, interpretation of evidence (checked in question 12). For example, report the percentage of students who achieved each SLO.

Table 1: frequencies of students' responses to SLO survey questions as an average aggregate for three years.

Tables 2-4: frequencies of students' responses to SLO survey questions in single years.

Tables 5-8: frequencies of students' responses for academic level, majpr/discipline, and perceived course performance in oral and written production.

Table 9: frequencies of students' responses to survey questions focusing on community engagement and feminist activities as inspire by Women's Studies coursework at the time of self-reporting and is depicted in a three year data cluster.
 

Table 1: Women’s Studies Student Assessment Survey Average Results for 2017, 2018,  and 2019 

 

Concept (total # of responses, 3 years)

Strongly Agree/Agree

Neutral

Disagree/Strongly Disagree

Social construction (163)

145 (89%) 

16 (9.8%)

2 (1.2%)

Race (164)

 129 (78.7%)

32 (19.5%)

3 (1.8%) 

Gender (163)

 154 (94.5%)

9 (5.5%)

0 (0%)

Class (162)

 127 (78.4%)

32 (19.8%)

3 (1.9%) *

Sexuality (164)

 150 (91.5%)

12 (7.3%) 

2 (1.2%)

Social Stratification (164)

124 (75.6%)

33 (20.1%)

7 (4.3%)

Masculinity (164)

150 (91.5%)

12 (7.3%)

2 (1.2%)

Intersectionality [1] (164)

 160 (97.6%)

4 (2.4%)

0 (0%)

Asia-Pacific [2] ( 163)

 110 (67.5%)

43 (26.4%)

10 (6.1%)

 

Table 2: Women’s Studies Student Assessment Survey Results for 2017

 

Concept (# of responses)

Strongly Agree/Agree

Neutral

Disagree/Strongly Disagree

Social construction (76)

65 (85.3%)

10 (13.2%) 

1 (1.5%)

Race (77 )

57 (74.1%)

19 (24.7%) 

1 (1.2%)

Gender (77 )

72 (93.5%)

5 (6.5%)

0 (0%) 

Class (75)

57 (76%)

17 (22.7%) 

1 (1.3%) 

Sexuality (77)

69 (89.6%) 

7 (9.1%) 

1 (1.3%)

Social Stratification (77)

57 (74.1%)

17 (22.1%) 

3 (3.8%) 

Masculinity (77)

71 (92.2%) 

5 (6.5%) 

1 (1.3%)

Intersectionality [1] (77)

74 (96.1%)

3 (3.9%) 

0 (0%) 

Asia-Pacific [2] (76) *

 

46 (60.6%)

25 (32.9%) 

5 (6.6%) 

 

(*) taken from survey results graph, 2017 assessment

 

Table 3: Women’s Studies Student Assessment Survey Results for 2018

 

Concept

(# of responses)

 

Strongly Agree/Agree

 

Neutral

 

Disagree/Strongly Disagree

 

Social construction 

(27)

22 (81.5%)

4 (14.8%)

1 (3.7%)

Race

(27)

24 (88.9%)

3 (11.1%)

0 (0%)

Gender

(27)

26 (96.3%)

1 (3.7%)

0 (0%)

Class

(60)

24 (88.9%)

2 (7.4%)

1 (3.7%)

Sexuality  

(27)

24 (88.9%)

3 (11.1%)

0 (0%)

Social Stratification 

(27)

20 (74.1%)

5 (18.5%)

2 (7.4%)

Masculinity

(27)

23 (85.2%)

4 (14.8%)

0 (0%)

Intersectionality [1]

(27)

26 (96.3%)

1 (3.7%)

0 (0%)

Asia-Pacific [2] 

(27)

20 (74%)

6 (22.2%)

1 (3.8%)

 

(*) taken from survey results graph, spring 2019 assessment (representing AY 2018-19)

 

Table 4: Women’s Studies Student Assessment Survey Results for 2019 

 

Concept

(# of responses)

 

Strongly Agree/Agree

 

Neutral

 

Disagree/Strongly Disagree

 

Social construction 

(60)

58 (96.7%)

 

2 (3.3%)

 

0 (0%) 

 

Race

(60)

48 (80%)

 

10 (16.7%)

 

2 (3.3%) 

Gender

(59)

56 (94.9%)

 

3 (5.1%) 

 

0 (0%) 

 

Class

(60)

46 (76.7%) 

 

13 (21.7%) 

 

1 (1.6%) 

 

Sexuality

(60)

57 (95%)

 

2 (3.3%) 

 

1 (1.7%)

 

Social Stratification 

(60)

47 (78.5%)

 

11 (18.3%)

 

2 (3.4%) 

 

Masculinity

(60)

56 (93.3%)

 

3 (5%) 

 

1 (1.7%)

 

Intersectionality [1]

(60)

60 (100%)

 

0 (0%) 

 

0 (0%) 

 

Asia-Pacific [2] 

(60)

44 (73.3%)

 

12 (20%) 

 

4 (6.7%) 

 

 

(*) taken from survey results graph, fall 2019 assessment (representing AY 2019-2020 data)

 

Table 5: Student Academic Level, Three Years

 

(Self-Identified by Credits)

2017

# (%) 

77 (100%)

2018

# (%)

27 (100%)

2019

# (%)

60 (100%)

1st Year

12 (15.6%)

1 (3.7%)

6 (10%)

 

2nd Year

15 (19.5%)

1 (3.7%)

12 (20%)

 

3rd Year

29 (37.7%)

10 (37%)

23 (38.3%)

 

4th Year

13 (16.9%)

14 (51.9%)

17 (28.3%)

 

Graduate or Unclassified

8 (10.3%)

1 (3.7%)

2 (3.4%)

 

Table 6: Student Majors/Disciplines, Three Years

 

Major and Minor Reporting

2017

# (%)

77 (100%)

2018

# (%)

26 (100%)

 

2019

# (%)

61 (100%)

 

(*) In Major

Women’s Studies Major

8 (10.4%)

5 (19.2%)

7 (11.5)

 

 

Women’s Studies Minor

6 (7.8%)

4 (15.4%)

1 (1.6%)

 

 

Undergraduate and Graduate (Certificate?)

11 (14.3%)

3 (11.5%)

3 (4.9%)

 

 

Other

52 (67.5%)

14 (53.9%)

50 (82%)

 

 

Note: This table depicts only major reporting for enrolled or intended enrollment in WS programs at the undergraduate level (major, cert) and graduate level (cert). This data is taken from the annual results charts and combines outside disciplines into a single Other designation on this table. As we continue to discuss recruitment strategies, dual-major and major-certificate conversations can reference Tables 5 and 6. 

 

Table 7: Women’s Studies Student Assessment Survey Average Results for 2017, 2018, and 2019

 

Q: How many pages did you have to write for your WS courses?

 

2017

# (%)

77 (100%)

2018

# (%)

27 (100%)

 

2019

# (%)

60 (100%)

Less than 5 pages

12 (15.6%)

2 (7.4%)

26 (43.4%)

 

5-10 pages

37 (48.1%)

10 (37%)

22 (36.7%)

 

11-15 pages

15 (19.5%)

3 (11.1%)

7 (11.7%)

 

16-20 pages

4 (5.1%)

5 (18.5%)

3 (5%)

 

More than 20 pages

9 (11.7%)

7 (25.9%)

2 (3.2%)

 

 

Table 8: Women’s Studies Student Assessment Survey Average Results for 2017, 2018, and 2019

 

Q: How many times did you speak in your WS courses?

 

2017

# (%)

77 (%)

2018

# (%)

26 (%)

2019

# (%)

59 (100%)

Never

13 (16.9%)

4 (19.2%)

16 (27.1%)

 

Almost never

26 (33.8%)

3 (7.7%)

16 (27.1%)

 

At least every other class

23 (29.9%)

7 (26.9%)

11 (18.6%)

 

Almost every class

12 (15.6%)

6 (23.1%)

9 (15.3%)

 

Multiple times almost every class

3 (3.8%)

6 (23.1%)

7 (11.9%)

 

 

Table 9: Women’s Studies Student Assessment Survey Average Results for 2017, 2018, and 2019

 

Q: As a result of taking this course, I have engaged in activities that focus on women, gender, or sexuality in my community or other contexts outside the classroom

 

2017

# (%)

77 (%)

2018

# (%)

27 (%)

2019

# (%)

60 (100%)

Strongly agree

16 (20.8%)

14 (51.9%)

28 (46.7%)

 

Agree

21 (27.3%)

7 (25.9%)

18 (30%)

 

Neutral

27 (35.1%)

5 (18.5%)

12 (20%)

 

Disagree/Strongly disagree

13 (16.9%)

1 (3.7%)

2 (3.3%)

 

 

 

 

14) What best describes how the program used the results? (Check all that apply.)

Assessment procedure changes (SLOs, curriculum map, rubrics, evidence collected, sampling, communications with faculty, etc.)
Course changes (course content, pedagogy, courses offered, new course, pre-requisites, requirements)
Personnel or resource allocation changes
Program policy changes (e.g., admissions requirements, student probation policies, common course evaluation form)
Students' out-of-course experience changes (advising, co-curricular experiences, program website, program handbook, brown-bag lunches, workshops)
Celebration of student success!
Results indicated no action needed because students met expectations
Use is pending (typical reasons: insufficient number of students in population, evidence not evaluated or interpreted yet, faculty discussions continue)
Other: Following data collection and initial report production, faculty determined the following: 1) removing "social stratification" in future years' SLOs as this term is outdated in the field; 2) further, and more clearly, articulating race and class as intersectional with gender; 3) making race, class, and Asia-Pacific contexts, materials, and concepts more clear in our syllabi.

15) Please briefly describe how the program used its findings/results.

The three year assessment combines and analyzes individuated data collected from 2017 to 2019. Data collection efforts take the form of student reporting on departmental surveys provided during the regular class time near the end of the scheduled semester and have produced data on student achievement of our SLOs, the strengths of the undergraduate program, and ways to improve the student experience. Generally speaking, students report—in individual years and as represented in Table 1, combined data—that they feel they meet or exceed the program SLOs. The Department has responded/is responding to previous years’ responses by recruiting lecturers who can teach a wide range of classes, and by collaborating with other campus organizations that can help facilitate student internships. Women’s Studies is continually leveraging resources and opportunities to increase our course offerings, as resources allow. At the time of this assessment, the precarity of an intra- and post-Covid budgetary realignment informs the continued response approaches by Women’s Studies faculty, lecturers, and staff. At this time, the Department maintains its commitment to enhancing course offerings and foci, as well as is developing plans for recruitment and enrollment increases regardless of any final budgetary and/or unit determinations forthcoming by University Administration. 

 

The Department continues focus in the following areas, as evidenced by meeting minutes: major recruitment; diversification of courses, specifically E and O designations; Outreach, Mānoa Academy, and summer course offerings; virtual presence via various social media platforms, updated Department website, and online community engagement; and increasing partnerships with campus resource offices such as the Career Center to provide undergraduates with post-bac internship, career, and graduate resources. Additionally, in light of COVID-19 and its impact on the University writ large, Women’s Studies also focuses on major enrollment, minor enrollment, and certificate enrollment increases despite unsecure/unknown budgetary provisionsin order to retain administration of its major and certificate programs.

 

The three-year assessment report can be found here:

https://drive.google.com/drive/u/0/folders/0AIvOxQ8l2VSGUk9PVA

16) Beyond the results, were there additional conclusions or discoveries? This can include insights about assessment procedures, teaching and learning, and great achievements regarding program assessment in this reporting period.

Summaries 

 

As demonstrated in Table 1, students believed that Women’s Studies classes improved their understanding of key concepts. Conceptual understanding, however, is inconsistent with the significant majority of students reporting that they better understood intersectionality, sexuality, gender, and masculinity (over 90% respectively). Almost one-third of students were neutral or disagreed that they had a better understanding of how key concepts manifest in an Asia-Pacific context. During our October faculty meeting, we discussed this issue: going forward, we plan to be more explicit about how the course discusses Asia-Pacific concepts and contexts, and how they relate with field concepts. In other words, the Women’s Studies faculty have indeed been teaching Asia-Pacific materials in courses, but we recognize it may need to be made clearer for students in order for them to connect materials specifically related to this concept more easily and in connection with field concepts more readily recognized and understood. 

Key terms with high rates of neutral response to better understanding include Race (19.5%), Class (19.8%), and Social Stratification (20.1%). On this matter, Women’s Studies faculty have decided to remove “social stratification” from our SLO for future years, particularly because this concept is outdated in the field. In terms of “race and class” designations, we have also discussed these in our courses using specific materials and unit themes. However, because these are articulated as intersecting with gender, students may not immediately grasp the concepts/contexts as distinct topics. The majority of students in Women’s Studies classes (more than 80%) do understand that race and class are being discussed in the course and to what ends. Nonetheless, to help everyone in the class learn better and understand these topics more clearly, we will articulate “race and class” more explicitly in both our course syllabi and materials. Generally, students report better understanding. However, the areas most impacted with neutral or disagreement reporting were consistent in individual years and across the three year data totals. To boost these responses, we intend—as stated above—to further articulate the explicit nature of specific topics and themes via syllabi, course units/themes, and course materials. 

Tables 2-4 represent individuated data per collection year. These tables show significant improvement (10% or more) in students’ conceptual understanding in the areas of Race and Asia-Pacific concepts from 2017-2019, although a drop between 2018 and 2019 still reflecting overall improvement across three years. This is critical to place-based applications and students’ survey responses indicate improvements across courses in these areas. Conversely, there is fluctuation from 2017 to 2019 in students’ conceptual understanding in the following areas, both expressed in 2018 and 2019 as represented in neutral and disagree/strongly disagree responses: Social Stratification and Masculinity. Intersectionality, Sexuality, and Gender remain consistent. 

Tables 5 shows a decrease in freshman and graduate or unclassified students enrolled in Women’s Studies courses; this is countered by an increase in senior students enrolled in courses by nearly double (16.9% in 2017 to 28.3%% in 2019). Junior student enrollment remains steady in these reporting years, with small increase from 2017 to 2019 (only 0.6%). However, there is sharp decrease in senior-level students from 2018 to 2019, from 51.9% to 28.3%, despite expressing an overall increase over three years. This could reflect higher graduation rates in the 2018 AY.  

Table 6 shows an increase in Women’s Studies majors comprising course enrollments (10.4% in 2017 to 11.5% in 2019), but also shows a sharp decrease in minors (7.8% in 2017 to just 1.6% in 2019). Table 6 also shows undergraduate and graduate students reporting they are undeclared or potentially in certificate programs (14.3% in 2017 to only 4.9% in 2019), and nearly a 15% increase in Other students during these reporting years. 

Tables 7 and 8 show an interesting combination of increased speaking in class and decreased written production. Specifically, Table 7 shows an increase in written production in 2019, but a total reduction in written production from an average of 36.3% of 2017 respondents writing 11 or more pages in the course to only 19.9% of total 2019 respondents writing 11 or more pages in the course. Similarly, Table 8 shows both an increase from 2017 to 2019 in students self-reporting that they never speak in class and students self-reporting that they speak in almost every class, at 16.9% in 2017 to 27.1% in 2019 and 3.8% in 2017 to 11.9% in 2019 respectively.

Table 9 is perhaps one of the most encouraging in that it depicts a significant increase in community applications and practices for Women’s Studies students. Designing courses, providing instruction, and facilitating learning that enables students to think and write across disciplines is an integral function of Women’s Studies. Students report that their coursework does indeed translate to women-, gender-, and/or sexuality-related community engagement. Of special note is that 76.7% of students in 2019 report that they agreed or strongly agreed that their course fostered this engagement, up from 48% in 2017. Substantial decrease also occurred in both neutral and disagree/strongly disagree responses, with the latter seeing a reduction from 16.9% in 2017 to just 3.3% in 2019. 

17) If the program did not engage in assessment activities, please justify.

Not applicable.