Degree Program Assessment Reports

This summary is from our professional reaffirmation documents, which were submitted on August 1, 2009.

Data on Program Objectives
1. Values and ethics. Feedback from current and graduating students, employers, and practicum instructors finds that students are meeting or exceeding benchmarks in terms of values and ethics. A noted above, the BSW CAC, however, felt that this was one area that could be strengthened. They suggested more content on knowing one’s personal values and value systems, having personal and professional integrity, conducting ethical practice, having knowledge of the National Association of Social Workers (NASW) Code of Ethics, and application of ethical
decision-making. Although students are doing well with regard to values and ethics, there is room for improvement.

2. Professional use of self. Similar to values and ethics, most data sources suggest that BSW students are for the most part meeting or exceeding the benchmarks set for this objective. For example, over the years, practicum instructors in general found interns did particularly well at establishing professional relationships with others and in participating in a variety of social work roles. Nearly all questions on the exit survey about professional use of self yielded some of the highest means (some mid- to high-4s on a 5 point scale). However, the BSW CAC and results of the current employer survey find that, while acceptable as is, professional use of self can be strengthened even further. Their qualitative feedback includes suggesting more stringent admissions criteria and monitoring students more closely during the first semester in the program. In addition, the item “Use supervision effectively” on the exit survey of graduating students was rated below 4.00 for two years. In 2005, it had a mean of 3.71 and in 2009 in had a mean of 3.78. During other years, it was rated more highly, with a mean ranging from 4.40 to 4. 83.

3. Critical thinking. The results on meeting or exceeding benchmarks for critical thinking were good. Graduating students rated critical thinking items in the low- to mid-4s on a 5 point scale. Employers rated BSW graduates fairly highly on critical thinking, especially in terms of being able to distinguish between verifiable facts and value claims, and using research to inform practice. For the most part, practicum instructors find that students are performing at an excellent or good level. The one area for concern has to do with what appears to be a small but growing
number of practicum instructors who state that applying relevant research to practice situations in not applicable. Sometimes up to a quarter of practicum instructors mark that this application of research to practice is not applicable to what the student is doing at their agency.

4. Applying theory to practice. While many benchmarks were met or exceeded for this objective, some were not. Employers, CAFÉ results, and exit survey data suggest that for the most part, students are able to apply theory to practice. The picture is different based on feedback from the BSW CAC and practicum evaluations. The BSW CAC felt this was another area that could be strengthened. They emphasized the need to know and understand key systems and models, such as systems theory and the ecological perspective, generalist practice, and person-in-environment. Graduates also needed to be able to apply micro, meso, and macro level interventions.
The practicum evaluations revealed another issue with regard to applying theory to practice. While practicum instructors rate students as meeting the benchmarks for working with individuals, large numbers of them marked “not applicable” when asked about student work with families, groups, organizations, and communities. The range of “not applicable” in these areas is from approximately 30%-70%, varying by semester and year. Based on these data, it is difficult to know if students are meeting the benchmarks since they are not being given the opportunity to perform in these areas. The first concern, however, is that students are not able to participate in activities related to work with these different groups.

5. Advocacy. Advocacy is one of the most highly rated of all the Seven Abilities by all data sources. With the exception of the 2004-2005 practicum evaluations, all items related to advocacy met or exceeded the benchmarks. Employers rated this as the highest of all objectives for program graduates.

6. Diversity. Diversity is also rated highly by most data sources. Students met the benchmarks for this program objective every semester since data collection began in 2003. The members of the BSW CAC felt BSW students performed well in this area, and CAFÉ and exit surveys of graduating students backed this up. The only source that felt this was somewhat of any issue was employers. They stated there was room for improvement in this area, especially in terms of knowledge of diverse cultures and how to engage persons from other cultures.

7. Communication. For the most part, results found that BSW student meet the set benchmarks in terms of communication. This was the case based on feedback from the BSW CAC, practicum evaluations from 2003-2009, and CAFÉ. Employers rated some aspects of communication to be good, while stating that recordkeeping skills could be stronger. In 2005 on the exit survey, students rated using information technologies appropriately and effectively with clients and colleagues as 3.86 on a 5.00 scale. Ratings on this item were higher for the remaining
years, ranging from 4.25 to 4.67. As a result, it does meet the benchmark.

Global Assessments of Program Objectives

FCAI. The Myron B. Thompson School of Social Work utilizes several global assessments of program objectives. These include the BEAP FCAI, final cumulative GPAs of graduating students, and BSW senior practicum grades. Data from all 3 measures finds that BSW students met established benchmarks during the years since our last reaccreditation. Entering and exiting BSW students had means on the FCAI that were not statistically significantly different or were statistically significantly higher than mean scores for entering and exiting students nationally. To better allow us to determine if we are meeting stated program objectives, we have requested that in the future FCAI scores be broken down by objective, rather than just providing a global mean.

Final cumulative GPAs. Each course contains objectives that are based on the Seven Abilities. Successful completion of these courses suggests students are achieving these goals.Final cumulative GPAs of graduating students averaged to just above a B+ (note that this is for all classes taken during the course of earning the degree, not just social work classes). This also suggests that gatekeeping and remedial plans, when necessary, are appropriately admitting and weeding out students.

Practicum grades. Nearly all of practicum students (97% in fall and 99% in spring semesters) received a grade of B or better in the fall and spring semesters. There were more A (A+, A, A-) grades in the spring than in the fall, which also suggests that students progressed over time in terms of meeting program objectives.

This is also from our reaffirmation documents.

AS. 8.c. How Data have been/are being used to Affirm or Improve Program

Overall, the results of data collection affirm that the BSW Program is meeting its established objectives. There are some caveats that must be considered when interpreting these data. Some measures yielded low response rates. These include employer surveys and exit surveys of graduating students. Assessment Committee members have already begun to discuss ways in which response rates can be increased. However, even with small sample sizes on exit surveys, the fact is that the same results appear year after year. In addition, these results are triangulated
by data collected from other sources, such as employers and practicum instructors. Patterns appeared across results from different data sources. Detailed below are the program objectives that require attention and what has or is being done to address the issues.

Values and ethics and professional use of self. The first area that can be strengthened has to do with the program objectives of Values and Ethics and Professional Use of Self. To address concerns by the BSW CAC and employers about these areas, the BSW Program is revamping the practice sequence. The current practice sequence consists of 4 classes (SW 302, SW 303, SW 402, and SW 403). The MSW foundation curriculum contains 3 classes. SW 303, SW 402, and SW 403 will be reformulated, along with the corresponding MSW foundation classes, to more closely resemble one another. They will cover generalist practice with individuals, families, groups, and communities. The first class in the BSW sequence (SW 302), will continue to emphasize some of the basics, such as intake and assessment, but will have a new focus on personal and professional development, including professional attitude and bearing, interpersonal skills, self-awareness, and good mental health. It will thus also serve a gatekeeping function.

Professional use of self. “Use supervision effectively,” an aspect of the objective Professional Use of Self, was rated below a 4.00 on a 5.00 scale for two years by graduating students. However, during other years, it was rated much more highly. The variability suggests that this item needs to be monitored closely during the next year or two. If low means continue in the future, this concern needs to be brought to the BSW Curriculum Committee and members of the Practicum Office for discussion and action. Actions could include reviewing all syllabi to see
where this content is being taught and examining how it is being taught.

Critical thinking. There are two trends that appeared in the practicum evaluations. One appears to be emerging as it appears more and more practicum instructors are marking “Applying relevant research findings to practice situation” as not applicable. It is an aspect of program objective Critical Thinking. This is a trend that should be monitored. If this pattern continues in the next year or two, it requires the attention of the Research Sequence Committee, Practicum Office members, and BSW Curriculum Committee. Additional training in this area for
practicum instructors may be needed.

The second trend has been evident over time. Large percentages of practicum instructors have been marking “not applicable” in terms of applying basic social work process skills and practicing or applying in practice interventions with families, groups, organizations, and communities. Opportunities for work with individuals are being regularly provided. Practicum instructors rate students as meeting or exceeding the established benchmarks. However, students are not getting the experiences needed in working with various types of groups. It is thus difficult
to understand if students are meeting this benchmark for Applying Theory to Practice. Practicum Office personnel and the BSW Curriculum Committee have been informed of this trend and are discussing the issue. In response, in the past few years, efforts have been made to increase the number of macro level placements. However, not all agencies and organizations serve families, groups, organizations or communities. The program objective recognizes this and is written so that a student may actually be doing work with these groups or is at least learning in theory how she or he might practice at these levels of intervention. A next step could be to develop meso and macro level exercises that are presented to practicum instructors at their annual meeting. These exercises could be used with students in practicum.

Communication. Although for the most part constituents felt students were achieving set benchmarks for Communication, there were a couple of areas that bear watching. It may be that more content is needed with regard to recordkeeping and using information technologies appropriately and effectively. The BSW Curriculum Committee has been informed of this possible issue and the situation is being monitored.

BSW Program Strategic Planning
In response to assessment information, growth of the program, and changing economic times, the BSW Curriculum Committee began strategic planning in early 2008. This process includes examining the curriculum and syllabi with regard to what they currently contain, if there are any gaps, and how they align with the MSW foundation curriculum syllabi. Discussions have taken place and continue to take place with regard to gatekeeping issues, indigenization of the curriculum, and competencies.