Program: Mānoa Advising Center
Date: Wed Oct 09, 2013 - 3:01:16 pm
1) Below are your program's student outcomes (SOs). Please add or update as needed.
1. Students can identify major options
2. Students can learn, identify, and understand General Education, graduation and program requirements using advising combined with supplemental services (MyUH, STAR, catalog, registration guide and program sheets.)
3. Students can identify campus resources available to them and use them, as necessary (Career Center, CSDC, LAC, tutoring, etc.)
2) Your program's SOs are published as follows. Please update as needed.
Program's Website. URL: Student Handbook. URL, if available online: 
Information Sheet, Flyer, or Brochure. URL, if available online: NA UHM Catalog. Page Number: Other: Advising syllabus (on MAC website) Other: 3) Provide the program's activity map or other graphic that illustrates how program activities/services align with program student outcomes. Please upload it as a PDF.
- File (10/08/2013)
4) Did your program engage in any program assessment activities between June 1, 2012 and September 30, 2013? (e.g., establishing/revising outcomes, aligning activities to outcomes, collecting evidence, interpreting evidence, using results, revising the assessment plan, creating surveys, etc.)
Yes
No (skip to question 14)5) For the period June 1, 2012 to September 30, 2013: State the assessment question(s) and/or assessment goals. Include the student outcomes that were targeted, if applicable.
We met with the Manoa Assessment Office to create a Mandatory Advising survey. This survey was administered via SurveyMonkey to all of our students who completed mandatory advising in Spring 2013. We had to cut the survey short and ended it at the time when holds were applied to students. The main purpose of running the survey this semester was to be sure that the mechanics of it would work. We did some simple analysis of the students who completed the mandatory advising options administered by MAC (meeting with academic advisors, meeting with peer advisors, MAC run workshops and MAC designed online assignments) only.
6) State the type(s) of evidence gathered to answer the assessment question and/or meet the assessment goals that were given in Question #5.
The mandatory advising survey asks a number of factul questions: what type of mandatory advising the student did, their demographic information (how many credits they have, their gender, whether they are part-time or full-time students.) The rest of the questions are designed to gauge student learning outcomes.
1. Before completing your mandatory advising, how much did you already know about the following? (Nothing, A little, Somewhat, A lot, Not applicable):
- General Education requirements
- Majors offered at UHM
- How to choose a major
- Major requirements
- Available campus resources and services
2. As a result of the session, do you know . . .
- where to find information on the majors offered at UHM?
- how to find a major to help you reach your goals?
- how to find courses that fulfill general education requirements?
- how to complete academic requirements in a timely manner (e.g., in 4 years)?
- how to find campus resources that meet your needs?
3. As a result of your mandatory advising, how much did you learn about using the following tools to identify academic requirements? (Nothing new, A little more, Somewhat more, A lot more, Not applicable):
- MyUH Portal
- STAR
- UHM Catalog
- Program sheets
4. As a result of this session, how much did you learn about using the following tools to search for majors offered at UHM?
- UHM catalog
- Program sheets
5. Check the resources / services that you know more about as a result of this session. (Check all that apply.)
- choice of 12 resources / services
7) State how many persons submitted evidence that was evaluated. If applicable, please include the sampling technique used.
All MAC students were sent unique links to the survey from SurveyMonkey. 609 students replied to the survey. Of this number, 333 had completed mandatory advising options overseen by MAC (appointment with MAC advisor, appointment with MAC peer advisor, attended a MAC run workshop, submitted a MAC designed written assignment.)
8) Who interpreted or analyzed the evidence that was collected? Check all that apply.
Program faculty/staff member(s) Faculty/staff committee Ad hoc faculty/staff group Director or department chairperson Persons or organization outside the university Students (graduate or undergraduate) Dean or Associate Dean Advisory Board Other: consulted with Manoa Assessment Office9) How did he/she/they evaluate, analyze, or interpret the evidence? Check all that apply.
Compiled survey results Used quantitative methods on student data (e.g., grades, participation rates) or other numeric data Used qualitative methods on interview, focus group, or other open-ended response data Scored exams/tests/quizzes Used a rubric or scoring guide Used professional judgment (no rubric or scoring guide used) External organization/person analyzed data (e.g., Social Science Research Institute) Other: 10) For the assessment questions/goals stated in Question #5, summarize the actual results.
We were able to test run the survey and identified a few issues that could be addressed by rewording and spacing out some of the questions.
11) What was learned from the results?
On October 2, we sent out the mandatory advising survey to all the MAC students. We consulted with the Manoa Assessment Office and decided to run the survey again for a full semester to get a more accurate response pool. We adjusted / reformatted two questions that we felt were problematic, in consultation with the Manoa Assessment Office.
We also decided to word our mandatory emails more strongly to emphasize that students needed to both complete an option and complete the survey in order to have their registration holds released.
12) State how the program used the results or plans to use the results. Please be specific.
We have sent out the revised survey and will schedule a meeting with the Manoa Assessment Office once we have completed our initial data collection in December. Based on our findings, we may modify the survey further.
13) Reflect on the assessment process. Is there anything related to assessment procedures your program would do differently next time? What went well?
Overall, I think the process went smoothly. We needed to gauge whether it would work to have the mandatory advising email sent out first and then have the mandatory survey email sent out a few days later. We also needed to test out whether students would understand our questions.
14) If the program did not engage in assessment activities, please explain.
Or, if the program did engage in assessment activities, please add any other important information here.
This coming year, we hope to work on a more thorough activity map showing each of our mandatory advising activities and how they meet our student learning outcomes. We also will explore whether having individual evaluations for each different mandatory advising option would make sense of not.