Program: Student Academic Services
Date: Thu Oct 03, 2013 - 5:21:34 pm
1) Below are your program's student outcomes (SOs). Please add or update as needed.
- Throughout their academic career, students can identify and explain their interests, strengths, values, and career/life goals.
- Students can develop and implement an academic and educational plan.
- Students understand how the A&S degree prepares them for success in their personal, academic, and professional lives.
2) Your program's SOs are published as follows. Please update as needed.
Program's Website. URL: http://www.advising.hawaii.edu/artsci/pages/academic_services/about.asp Student Handbook. URL, if available online: http://www.advising.hawaii.edu/artsci/docs/Advising%20Handbook%20Ch%201.pdf Information Sheet, Flyer, or Brochure. URL, if available online: http://www.advising.hawaii.edu/artsci/pages/academic_services/coresheets/ UHM Catalog. Page Number: 85
Other: Other: 3) Provide the program's activity map or other graphic that illustrates how program activities/services align with program student outcomes. Please upload it as a PDF.
- File (10/03/2013)
4) Did your program engage in any program assessment activities between June 1, 2012 and September 30, 2013? (e.g., establishing/revising outcomes, aligning activities to outcomes, collecting evidence, interpreting evidence, using results, revising the assessment plan, creating surveys, etc.)
Yes
No (skip to question 14)5) For the period June 1, 2012 to September 30, 2013: State the assessment question(s) and/or assessment goals. Include the student outcomes that were targeted, if applicable.
Besides the learning outcomes, CASSAS uses other assessment measures as follows.
CASSAS collected Individual Advising Evaluations from students who attended same-day appointments, to obtain student perceptions of desired learning outcomes.
Responses ranged on a scale of 0 to 5; 5 indicates “Strongly Agree,” 1 indicates “Strongly Disagree” and 0 indicates “No Opinion.” Students could also leave additional comments at the end of the survey. For assessment questions, please refer to the Individual Advising Evaluation data, which is currently posted on our website at http://www.advising.hawaii.edu/artsci/pages/academic_services/stats.asp (see links “Individual Student Advising Evaluations 07/01/2012-06/30/2013” and “Written Comments from Individual Student Advising Evaluations 07/01/2012-06/30/2013”).
In addition, CASSAS has three programs that have been collecting program assessment surveys from students:
SUCCESS has been collecting student surveys to “assess the needs of academic advising services for students who are on academic probation in the Colleges of Arts & Sciences.” (Please see the attached survey, combined in the PDF file for #3, for further details.)
A LA CAS (Accentuating Liberal Arts with the Colleges of Arts & Sciences) (http://www.advising.hawaii.edu/artsci/ALACAS) includes a student survey posted on the Web site, which asks questions such as “What did the interviewee(s) say that was most relevant to you?,” “After watching the interview(s), what additional information would you like to pursue?,” “After watching the interview(s), do you feel that your A&S degree prepares you for success in your personal, academic, and/or professional life?” and “Do you like the format of the program (for example: web-based, social media, video)? If possible, please elaborate” to align with program outcomes,
1) Articulate the value and provide examples of the practicality of liberal arts skills for students in Arts & Sciences disciplines.
2) Introduce students to people and resources on and off campus who embrace the liberal arts and related fields and can provide insight into co-curricular programs for academic planning.
3) Utilize widely used electronic media and support alternative learning styles.
Explore Your A&S Major (http://www.advising.hawaii.edu/artsci/exploreA&Smajor) is a program in which students start with an exploration of personality types, learn how their personality type fits with their declared major, and learn about transferable skills in the major. Online career resources are available along with the opportunity to create an action plan. The Web site includes a student survey, in which the following assessment themes are posed:
- I am now more aware of the connection between personality/interests and major.
- I am now more aware of career areas in my major.
- I am now more aware of online major exploration resources.
- I now feel more confident about my choice of major.
- I plan to switch majors, but now feel more confident about exploring other majors.
6) State the type(s) of evidence gathered to answer the assessment question and/or meet the assessment goals that were given in Question #5.
Evidence was gathered from student feedback via surveys described in question #5. Please refer to the data (qualitative and quantitative responses) on our website for Individual Advising Evaluations.
Program developers have been individually collecting and interpreting data for their respective programs (Dawn Nishida and Ryoko Sekiguchi for SUCCESS; Kay Hamada for A LA CAS; and Lisa Wong for Explore Your A&S Major).
7) State how many persons submitted evidence that was evaluated. If applicable, please include the sampling technique used.
Please refer to the data on our website for Individual Advising Evaluations survey sample information.
Thirty-five students responded to the A LA CAS survey.
Data is currently being analyzed for SUCCESS and Explore Your A&S Major; therefore, more information cannot be provided for these programs at this time.
8) Who interpreted or analyzed the evidence that was collected? Check all that apply.
Program faculty/staff member(s) Faculty/staff committee Ad hoc faculty/staff group Director or department chairperson Persons or organization outside the university Students (graduate or undergraduate) Dean or Associate Dean Advisory Board Other: 9) How did he/she/they evaluate, analyze, or interpret the evidence? Check all that apply.
Compiled survey results Used quantitative methods on student data (e.g., grades, participation rates) or other numeric data Used qualitative methods on interview, focus group, or other open-ended response data Scored exams/tests/quizzes Used a rubric or scoring guide Used professional judgment (no rubric or scoring guide used) External organization/person analyzed data (e.g., Social Science Research Institute) Other: 10) For the assessment questions/goals stated in Question #5, summarize the actual results.
Please refer to the data on our website for a summary of Individual Advising Evaluations results.
Regarding A LA CAS, while student feedback was limited, the responses showed that students appreciated the intimate interview setting and various perspectives of A&S degrees and the liberal arts. However, when it came to the technology used, modification of media platforms was deemed as a necessity.
Data is currently being analyzed for SUCCESS and Explore Your A&S Major; therefore, more information cannot be provided for these programs at this time.
11) What was learned from the results?
From Individual Advising Evaluations, the survey results indicate that the majority of students (ranging from 84% to 96%) agreed or strongly agreed that desired learning outcomes were being met in appointments.
See #10 for supplemental program information.
12) State how the program used the results or plans to use the results. Please be specific.
While the Individual Advising Evaluations data for this report is cumulatively compiled for all advisors in CASSAS, advisors have access to their own Individual Advising Evaluations internally. Therefore, with the data available to advisors, advisors can interpret and utilize data in their approaches to individual advising sessions.
Regarding A LA CAS, the site’s primary delivery of information was based on video interviews. However, some students stated that they had technical problems accessing videos (e.g., internet connection was too slow) and others said they preferred voice-only or text-based information. Additionally, a site that primarily uses text appears to be more mobile-friendly (based on test cases using an android phone, iPhone, and iPad). Therefore, this program could benefit from adding more text and different options for accessing other media. Additionally, as a response to student comments, the design of the website was changed to improve ease of navigation.
Data is currently being analyzed for SUCCESS and Explore Your A&S Major; therefore, more information cannot be provided for these programs at this time.
13) Reflect on the assessment process. Is there anything related to assessment procedures your program would do differently next time? What went well?
The CASSAS department is currently in a state of transition. Therefore, while previous discussion about revising existing activity matrixes to further align with advising services took place, the revision process has been delayed with the possibility that program-level changes of larger scope will need to take place first. However, what went well is that outcomes were created and assessment is being conducted for pilot programs that supplement existing A&S advising services.
14) If the program did not engage in assessment activities, please explain.
Or, if the program did engage in assessment activities, please add any other important information here.
N/A