Program: Student Academic Services
Date: Thu Oct 13, 2011 - 11:33:09 am
1) List your program's student outcomes.
- Students will identify their career goals and formulate an educational plan that will assist them in achieving their goals.
- Students will be able to identify College and University policies that affect their educational experience.
- Students will utilize OSAS advising services in any of the following ways: in-person; phone; Skype; Blackboard Collaborate; and weekend, evening, or satellite advising sessions.
- Students will arrive at advising sessions with prepared questions and forms properly completed.
2) Where are your program's student outcomes published? Mark all that apply and include URLs when appropriate.
Program's Website. URL: http://coe.hawaii.edu/admissions/initial
Student Handbook. URL, if available online: Information Sheet, Flyer, or Brochure. URL, if available online: UHM Catalog. Page Number: Other: COE Student Wiki: http://students.coe.hawaii.edu/Advising Other: 3) Provide the program's activity map or other graphic that illustrates how program activities/services align with program student outcomes. Please upload it as a PDF.
4) For the period June 1, 2010 to September 30, 2011: State the assessment question(s) and/or assessment goals. Include the student outcomes that were targeted, if applicable.
In our previous report, we stated that we were going to target SLO #1 in the coming year. However, over the past several years, our office has experienced a reduction in faculty positions from 7 to 4 full-time academic advisors. In addition, our College will be moving toward freshmen admission, which will result in an approximate increase of 750 students each year. This increase will directly impact the types of services we offer. Although we have recently hired 2 new advisors, we found ourselves creating and exploring innovative means utilizing technology to deliver our services. Consequently, targeting the following goal and SLO #3 made more sense and subsequently became our focus:
GOAL = Ensure that all COE students have access to OSAS advising services throughout the year.
SLO #3= Students will utilize OSAS advising services in any of the following ways: in-person; phone; Skype; Blackboard Collaborate, and weekend, evening, or satellite advising sessions.
5) State the type(s) of evidence gathered to answer the assessment question and/or meet the assessment goals that were given in Question 4.
Over the past several years, OSAS has developed and incorporated the following into our advising services: Skype, Blackboard Collaborate, satellite advising (conducted on UH Community College campuses), weekend/evening advising, phone, and email advising. In the coming year, assessment instruments will be developed to measure the types and frequency of these services students utilize to obtain academic advising.
6) State how many persons submitted evidence that was evaluated. If applicable, please include the sampling technique used.
The advising staff have all participated in the services mentioned in the previous question. They will also contribute to the development of the assessment instrumentation to be used in the upcoming year.
7) Who interpreted or analyzed the evidence that was collected. Check all that apply.
Program faculty/staff Faculty/staff committee Ad hoc faculty/staff group Director or department chairperson Persons or organization outside the university Students (graduate or undergraduate) Dean Other see comments from Question #68) How did he/she/they evaluate, analyze, or interpret the evidence? Check all that apply.
Compiled survey results Used qualitative methods on interview, focus group, open-ended response data Scored exams/tests/quizzes Used a rubric or scoring guide Used professional judgment (no rubric or scoring guide used) External organization/person analyzed data (e.g., Social Science Research Institute) Other: Items checked reflect ideas we are considering for assessment development.9) For the assessment questions/goals stated in Question 4, summarize the actual results.
Utilizing technology, and providing non-traditional advising hours and locations have allowed the COE Office of Student Academic Services to broaden the delivery of services that we offer. Developing these innovative practices has also enabled us to reach a wider national and international audience, helped to strengthen our ties with the UH Community Colleges, and have offered students alternative ways of receiving assistance.
10) What was learned from the results?
There have been numerous positive benefits that have resulted in expanding our services, as stated in the previous response. Not only have we enabled students to receive greater access to academic advising, but we have also formed stronger partnerships with UH community college and Manoa advisors. We have also found ways to work more efficiently, which allows advisors to work on other OSAS related projects.
By embracing the use of technology and providing face-to-face services in alternate settings, we are pushing ourselves to think of creative avenues to become even more accessible to students. We believe that students want alternative choices in how and when they seek advising OSAS advisors are committed to providing students with as many opportunities as possible to receive assistance.
11) State how the program used the results or plans to use the results. Please be specific.
By providing a diverse menu of advising services to students (ranging from face-to-face to online modes), OSAS can assess if student advising access needs are being met. OSAS can also assess which advising services are preferred by students that lead to student success (i.e., COE admission, retention, and graduation).
12) Reflect on the assessment process. Is there anything related to assessment procedures your program would do differently next time? What went well?
Although OSAS is eager and enthusiastic about expanding and improving its services to students, the area of assessment (beyond advisor evaluations) is new to us. Additional training and support is needed in this area for OSAS faculty, particularly in the area of program evaluation. Training in research methodology (both qualitative and quantitative), research tools, data analysis, and interpretation would be extemely helpful.
13) Other important information
The faculty of OSAS would like to request a meeting with the Manoa Assessment Office for feedback on this report and for additional guidance on its assessment endeavors. The assistance that the Manoa Assessment Office has provided thusfar is greatly appreciated.