Unit: Social Work, Myron B. Thompson School of
Program: Graduate Academic Advising (MSW)
Date: Fri Oct 10, 2014 - 4:04:55 pm

1) Below are your program's student outcomes (SOs). Please add or update as needed.

Outcome 1: Students will be able to design and achieve a reasonable and timely academic plan that leads to a Master of Social Work degree.

Outcome 2: Students will be able to identify academic and professional goals that incorporate his/her personal values, interests, aptitudes and skills.

Outcome 3: Students will be able to identify and utilize resources to support them in achieving their academic and professional goals.

2) Your program's SOs are published as follows. Please update as needed.

Program's Website. URL:
Student Handbook. URL, if available online: http://www.hawaii.edu/sswork/Students/MSW_Handbook.pdf
Information Sheet, Flyer, or Brochure. URL, if available online:
UHM Catalog. Page Number:
Other: MSW New Student Orientation
Other: FACULTY & STUDENT MANDATORY ADVISING MEMOS

3) Provide the program's activity map or other graphic that illustrates how program activities/services align with program student outcomes. Please upload it as a PDF.

Activity Map File(s) from 2014:

4) Did your program engage in any program assessment activities between June 1, 2013 and September 30, 2014? (e.g., establishing/revising outcomes, aligning activities to outcomes, collecting evidence, interpreting evidence, using results, revising the assessment plan, creating surveys, etc.)

Yes
No (skip to question 14)

5) For the period between June 1, 2013 and September 30, 2014: State the assessment question(s) and/or assessment goals. Include the student outcomes that were targeted, if applicable.

  1. 100% of new students will attend a mandatory orientation session where they will receive training on how to use STAR, the UHM catalog, Credit Check form, and the Student Handbook to identify and understand program requirements.
  2. 100% of student files will have an academic plan form that is updated every semester by the student and a faculty advisor.
  3. In the MSW Self Assessment Surveys, 90% of respondents will indicate that they received assistance, if requested, in examining academic and professional goals for themselves. 
  4. In the MSW Self Assessment Surveys, 90% of respondents will indicate that they received assistance in identifying and utilizing appropriate resources to support them in achieving their academic and professional goals when they requested such assistance.

6) State the type(s) of evidence gathered to answer the assessment question and/or meet the assessment goals that were given in Question #5.

Evidence for Measure A (New Student Orientation)

Orientation sign-in sheets

Evidence for Measure B (Academic Plan Form)

Review of student files for presence of academic plan form

Evidence for Measure C & D

Review of Mid-Program & Exit Surveys for Foundation year & Concentration year students

7) State how many persons submitted evidence that was evaluated. If applicable, please include the sampling technique used.

       For Measure A

All new students = 116

For Measure B 

All student files were reviewed for academic forms completed w/ both student & academic advisor = 230 students, 14 faculty advisors

For Measure C

120 student respondents (both foundation & concentration year students)

For Measure D

120 student respondents

8) Who interpreted or analyzed the evidence that was collected? Check all that apply.

Program faculty/staff member(s)
Faculty/staff committee
Ad hoc faculty/staff group
Director or department chairperson
Persons or organization outside the university
Students (graduate or undergraduate)
Dean or Associate Dean
Advisory Board
Other:

9) How did he/she/they evaluate, analyze, or interpret the evidence? Check all that apply.

Compiled survey results
Used quantitative methods on student data (e.g., grades, participation rates) or other numeric data
Used qualitative methods on interview, focus group, or other open-ended response data
Scored exams/tests/quizzes
Used a rubric or scoring guide
Used professional judgment (no rubric or scoring guide used)
External organization/person analyzed data (e.g., Social Science Research Institute)
Other:

10) For the assessment questions/goals stated in Question #5, summarize the actual results.

For Measure A

99-100% (115 or 116/116) of new students entering the MSW program in 2014 attended orientation

[One Distance Education Guam student did not attend E Komo Mai.]

For Measure B 

71% (164/230) of MSW student files have an academic plan form that appears to be updated.

  • Only 75% (172/230) of student files have an academic plan form, but of those, nearly all of them (164/172) are current.

For Measure C

Assigned Academic Advisor

C. Among 120 respondents (both foundation and concentration students), 65 students reported that they requested assistance in examining academic goals, and 92.3% (60 students) reported that they received assistance; and 34 students reported that they requested assistance in examining professional goals, and 88.2% (30 students) reported that they received assistance. 

Other Advisor

C. Among 120 respondents, 31 students reported that they requested assistance in examining academic goals, and 93.5% (29 students) reported that they received assistance; and 26 students reported that they requested assistance in examining professional goals, and 96.2% (25 students) reported that they received assistance. 

For Measure D

Assigned Academic Advisor

D. 28 students reported that they requested assistance in identifying and utilizing appropriate resources, and 85.7% (24 students) reported that they received assistance.

Other Advisor

D. 22 students reported that they requested assistance in identifying and utilizing appropriate resources, and 95.5% (21 students) reported that they received assistance.

11) What was learned from the results?

With respect to Measure A, we may not be at 100% for orientation this year because DE Guam was not required to attend E Komo Mai Orientation Meeting. 

With respect to Measure B:  Still not all advisors are using academic plan forms.  But those that do are generally keeping academic plan forms updated.

With respect to Measure C, it appears that of the students who requested assistance in examining academic goals, we exceeded our goal of providing assistance; students who requested assistance in examining professional goals received assistance from other advisors more so than their assigned advisors; however assigned advisors were less than 2% off from the estimated goal of assisting their students. This may also not reflect that advisors could have referred their students to a more appropriate resource.

With respect to Measure D, it appears that a relatively small number of students requested assistance in identifying & utilizing appropriate resources; however, a higher proportion of students reported receiving assistance from advisors other than their assigned academic advisor. 

12) State how the program used the results or plans to use the results. Please be specific.

Advisors are still not fully compliant with regard to academic plan forms.  No progress made since last year in this area.

One strategy that we implemented this year is a fully electronic version of our Academic Advising Training w/ a written quiz to be taken after reviewing the powerpoint presentation. These quizzes are to be submitted to the Student Services Director for correction and accountability. We updated the information to include accurate website links, and more targeted information based upon the areas that advisors consistently missed last year. Among the questions was one specifically asking them to articulate which forms are to included in every student file. As we are able to review which advisors may need more support and follow-up, we can discreetly contact them to provide extra support and training.

13) Reflect on the assessment process. Is there anything related to assessment procedures your program would do differently next time? What went well?

It was promising to see that students, for the most part, are receiving assistance either through their assigned advisor or another advisor to answer questions or concerns about their academic progress and/or professional goals.

14) If the program did not engage in assessment activities, please explain.
Or, if the program did engage in assessment activities, please add any other important information here.

N/A