Program: Graduate Academic Advising (MSW)
Date: Mon Oct 15, 2012 - 10:09:08 pm
1) Below are your program's student outcomes (SOs). Please add or update as needed.
I. PROGRAM GOAL
The goal of advising for the Myron B. Thompson School of Social Work is to assist students in achieving success in their academic and professional objectives and graduating on a timely basis from the Master of Social Work program.
II. LEARNING OUTCOMES (See Table 1)
Outcome 1: Students will be able to design and achieve a reasonable and timely academic plan that leads to a Master of Social Work degree.
Outcome 2: Students will be able to identify academic and professional goals that incorporate his/her personal values, interests, aptitudes and skills.
Outcome 3: Students will be able to identify and utilize resources to support them in achieving their academic and professional goals.
III. MEASUREMENT
A. 100% of student will attend a mandatory orientation session where students will receive training on how to use STAR, the UHM catalog, Credit Check form, and the Student Handbook to identify and understand program requirements.
B. 100% of student files will have an academic plan form that is updated every semester by the student and a faculty advisor.
C. In the MSW Exit Survey, 90% of respondents will indicate that they received assistance, if requested, in examining academic and professional goals for themselves.
D. In the MSW Exit Survey, 90% of respondents will indicate that they received assistance in identifying and utilizing appropriate resources to support them in achieving their academic and professional goals when they requested such assistance.
TABLE 1
|
No |
Learning Outcome |
Measurement |
|
1 |
|
Measure A: Training Measure B: Academic plan |
|
2 |
|
Measure B: Academic plan Measure C: Assistance in examining goals |
|
3 |
|
Measure D: Assistance in identifying and utilizing resources |
2) Your program's SOs are published as follows. Please update as needed.
Program's Website. URL: 
Student Handbook. URL, if available online: http://www.hawaii.edu/sswork/forms/msw/MSW_Handbook_2012.pdf Information Sheet, Flyer, or Brochure. URL, if available online: UHM Catalog. Page Number: Other: MSW New Student Orientation Presentation Other: 3) Provide the program's activity map or other graphic that illustrates how program activities/services align with program student outcomes. Please upload it as a PDF.
- File (10/12/2012)
4) Did your program engage in any program assessment activities between June 1, 2011 and September 30, 2012? (e.g., establishing/revising outcomes, aligning activities to outcomes, collecting evidence, interpreting evidence, using results, revising the assessment plan, creating surveys, etc.)
Yes No (skip to question 14)5) For the period June 1, 2011 to September 30, 2012: State the assessment question(s) and/or assessment goals. Include the student outcomes that were targeted, if applicable.
A. 100% of student will attend a mandatory orientation session where students will receive training on how to use STAR, the UHM catalog, Credit Check form, and the Student Handbook to identify and understand program requirements.
B. 100% of student files will have an academic plan form that is updated every semester by the student and a faculty advisor.
C. In the MSW Exit Survey, 90% of respondents will indicate that they received assistance, if requested, in examining academic and professional goals for themselves.
D. In the MSW Exit Survey, 90% of respondents will indicate that they received assistance in identifying and utilizing appropriate resources to support them in achieving their academic and professional goals when they requested such assistance.
6) State the type(s) of evidence gathered to answer the assessment question and/or meet the assessment goals that were given in Question #5.
Evidence for Measurement A (Orientation):
- Orientation sign-in sheets
- Individual Orientation appointments were scheduled w/ Student Services Coordinator if students could not/ did not attend mandatory Orientation sessions.
Evidence for Measurement B (Academic Plan Form):
- Student files reviewed for presence of updated forms
Evidence for Measurement C & D (MSW Exit Survey):
- Individual responses from MSW Exit Survey
7) State how many persons submitted evidence that was evaluated. If applicable, please include the sampling technique used.
Measurement A: All students signed-in for orientation sessions and received related written materials (e.g. New Student Orientation Manual, PowerPoint handout, Student Rights & Responsibilities, academic advising forms).
Total of 210 MSW students: For Fall 2012: 77 new MSW students;
87 continuing Mānoa students, who entered and received orientation in 2008, 2009, 2010, or 2011; 23/25 DE cohort 3, entering in 2010; and 20/21 DE cohort 4, entering in 2011.
Measurement B: All student files were reviewed which includes academic forms completed w/ both student & academic advisor. (210 total MSW students; 14 faculty advisors; 4 Site Coordinators for Distance Education Option; 3 Practicum Office faculty; 1 Admissions Administrative Support)
Measurement C & D: 7/77 (9.1%) have completed MSW exit survey.
8) Who interpreted or analyzed the evidence that was collected? Check all that apply.
Program faculty/staff member(s) Faculty/staff committee Ad hoc faculty/staff group Director or department chairperson Persons or organization outside the university Students (graduate or undergraduate) Dean or Associate Dean Advisory Board Other: 9) How did he/she/they evaluate, analyze, or interpret the evidence? Check all that apply.
Compiled survey results Used quantitative methods on student data (e.g., grades, participation rates) or other numeric data Used qualitative methods on interview, focus group, or other open-ended response data Scored exams/tests/quizzes Used a rubric or scoring guide Used professional judgment (no rubric or scoring guide used) External organization/person analyzed data (e.g., Social Science Research Institute) Other: 10) For the assessment questions/goals stated in Question #5, summarize the actual results.
Measurement A: Orientation
100% of student will attend a mandatory orientation session where students will receive training on how to use STAR, the UHM catalog, Credit Check form, and the Student Handbook to identify and understand program requirements.
207/210 = 98.6% MSW students attended orientation.
Measurement B: Academic Plan Form
100% of student files will have an academic plan form that is updated every semester by the student and a faculty advisor.
Starting from 11/2011 (for advising for Spring 2012), we instituted the requirement for all student files to have an academic plan form.
152/210 = 72.4% of MSW student files have an academic plan form.
Highest for DE (46/46 = 100%) because they all have the same prescribed plan, so the DE academic plan forms are automatically put into their student files.
Lowest for F12 new Manoa (43/77 = 55.8%) because they’ve only had orientation advising so far and haven’t met with their assigned academic advisors yet.
68.1% of MSW student files have an academic plan form that is current.
Measurement C & D: MSW Exit Survey
C: In the MSW Exit Survey, 90% of respondents will indicate that they received assistance, if requested, in examining academic and professional goals for themselves.
D. In the MSW Exit Survey, 90% of respondents will indicate that they received assistance in identifying and utilizing appropriate resources to support them in achieving their academic and professional goals when they requested such assistance
Among seven respondents, five students reported that they requested assistance in examining academic goals, and 100% reported that they received assistance; and four students reported that they requested assistance in examining professional goals, and all of them reported that they received assistance.
Three out of seven respondents reported that they requested assistance in identifying and utilizing appropriate resources, and 100% reported that they received assistance.
11) What was learned from the results?
Please refer to #13 response.
12) State how the program used the results or plans to use the results. Please be specific.
Please refer to #13 response.
13) Reflect on the assessment process. Is there anything related to assessment procedures your program would do differently next time? What went well?
We have made some progress in implementing the proposed assessment plan and achieving the stated learning outcomes. Through our assessment activities of the past year, we have learned much about things that we need to do better. We plan to use what we’ve learned to improve on our activities as well as the assessment process in the next year.
A. Orientation
The measurement includes two parts: (1) students attend new student orientation (2) students will receive training on how to use STAR, the UHM catalog, Credit Check form, and the Student Handbook to identify and understand program requirements.
We already had mandatory orientation, and our compliance is practically 100%. In the past year, we have also instituted the use of a registration hold until a student has completed advising and orientation. However, we may need to more directly train students in the specific tools described in Measurement A. We will also need to introduce questions into the orientation evaluation to measure to what extent students felt “trained” after orientation.
B. Academic Plan Form
Again, a two-part measurement: (1) students will have an academic plan form in their student file and, (2) the form will be updated every semester by the student and a faculty advisor.
Instituting academic plan forms has been somewhat successful in that most advisors are using them, but still not all advisors. We may need to develop a system or mechanism to remind as well as track academic form updates. For example, one possibility may be to create a mandatory checklist form to be completed by advisors every semester for each advisee to indicate that they completed academic advising with the student, approved their courses for the next semester (signed advising form), updated their academic plan, and updated their credit check form. This would also assist with the 2nd part of the measurement confirming that the plan had been updated.
C. & D. MSW Exit Survey
In AY 2011-12, we developed questions to be included in the MSW Exit Survey for assessment measures C & D (relating to outcomes #2 & #3). However, the total response rate to the MSW Exit Survey was low (7 of 77), with even fewer indicating that they had requested assistance in examining academic and professional goals and/or in identifying and utilizing resources to support them in achieving their goals. Nonetheless, the limited data collected looks positive toward achieving the MSW program advising goals, as all students who indicated that they requested assistance in these areas indicated that they received such assistance.
We need to develop a better strategy to increase the response rate for the exit survey this academic year. For example, administering a paper-and-pencil questionnaire in a classroom setting is being considered.
14) If the program did not engage in assessment activities, please explain.
Or, if the program did engage in assessment activities, please add any other important information here.
N/A