Departmental Assessment Update - Social Sciences Report

Department: Psychology
Program: MA, PhD
Level: Graduate

1. Has your program developed learning outcomes? If yes, please list.

1.1.   General.  A student who has successfully completed the graduate degree program in psychology should be able to:

1.1.1.      Demonstrate mastery of appropriate literature, methodology and techniques

1.1.2.      Communicate both orally and in writing at a high level of proficiency in the professional and academic fields of psychology

1.1.3.      Conduct independent research to a high standard

1.1.4.      Function as a professional in psychology

 

1.2.   Specific to MA training.  The SLOs for the MA component of the graduate program in psychology include but are not limited to the following:

1.2.1.      Acquisition of a common core of empirical and analytic methods currently in use in psychological research

1.2.2.      Acquisition of specialist techniques, knowledge and (as appropriate) clinical skill according to the concentration in which the student is working

1.2.3.      Completion of a significant piece of empirical work, under the supervision of faculty member and guided by other members of the student’s MA committee, culminating in the MA thesis

1.2.4.      The development of transferable skills in computing, statistics, oral and written presentation, professional and academic standards, and personal interaction.

 

1.3.   Specific to PhD training.  The SLOs for the PhD component of the graduate program in psychology include but are not limited to the following:

1.3.1.      Acquisition of in-depth knowledge of the theory, empirical findings, statistical and/or other analytic techniques, controversies and debates in a specialist area of research, and if necessary in one or more related areas.  Demonstration of this knowledge through the comprehensive examination process

1.3.2.      Proposal of a major piece of independently-motivated empirical work (the PhD dissertation proposal), including articulation of the details of rationale, method, ethical issues, statistical outcomes, and likely outcome and significance.  Successful oral defense of the PhD proposal in front of a five-member committee of faculty from inside and outside the Department of Psychology.

1.3.3.      Timely completion of the proposed empirical research

1.3.4.      Publication of findings from that research and/or dissemination of results at academic and professional conferences

1.3.5.      Completion of the PhD dissertation according to the regulations of the University of Hawaii.  Successful public oral defense of the PhD dissertation in front of the five-member committee of faculty.

2. If your program has learning outcomes, where are they published (e.g., department web page)?

SLOs are published as follows:

0.General expectations of progress mileposts and learning outcomes are published by the Graduate Division on their website, which is regularly updated

0.Departmental SLOs are published in the Departmental Graduate Student Handbook, which is reviewed annually and updated as needed, and is available to download from the Departmental website.

0.SLOs that are specific to concentrations (for example, those that specify clinical learning outcomes) are published in the handbooks produced by those concentrations, posted on the Department website, and updated as needed.

3. Do your faculty list course learning outcomes on their syllabi?

Yes, we require it of faculty and lecturers.

4. Does your program have a curriculum map that links course outcomes to program outcomes? If so, please include.

This section makes reference to the SLOs numbered in Section 1.

 

SLOs 1.1.1, 1.1.2, 1.1.3 and 1.1.4 are generic outcomes, and should be achieved by any student completing the graduate program in psychology through their coursework and faculty-supervised research and training, regardless of the particular concentration and combination of classes taken.

SLO 1.2.1 is met by the requirement upon all graduate students in psychology to take the following classes.  All students take PSY600, “Methodological Foundations of Psychology”, which builds upon the research training students have received in undergraduate and/or professional contexts, and aims to prepare them for the design, implementation, management and communication of research in psychology at graduate level.  Students take either PSY610 “Introduction to Quantitative Methods” or PSY611 “Design and Analysis of Psychological Experiments”.  These classes provide an overview of important designs and statistical techniques (e.g. analysis of variance; multiple regression) that are widely used in psychological research. Some concentrations require additional course work in statistics and research methodology. 

SLO 1.2.2 is met by the requirement of each concentration for students within that concentration to take certain foundation courses.  For examples, students in the clinical studies concentration are required to take PSY 670 “Introduction to Clinical Psychology”; students in the cognition concentration are required to take PSY 626 “Cognitive Psychology”; students in behavioural neuroscience are required to take PSY 634 "Physiological Psychology." Such foundation classes provide a graduate-level knowledge base for students. 

SLO 1.2.3 is met by two requirements.  First, students are required to register for six credits of directed research in their concentration, as part of the MA  This provides them with hands-on experience with the research process, in a formative environment, often as part of a larger laboratory or clinical team and working together with faculty, post-docs and senior graduate students.  Second, students work with their primary faculty advisor throughout their MA training to formulate their MA thesis project, make a formal proposal, conduct the research in a timely fashion, write their MA thesis and defend it in front of a committee of three faculty. 

SLO 1.2.4 is integrated into the total learning experience in this graduate program.  Throughout their graduate studies, students are (a) provided with learning opportunities for transferable skills such as classes in using statistical software, and (b) given opportunities to practice and improve more generic transferable skills such as oral presentation, computer skills and teamwork.  Students in the clinical studies concentration are also given specific feedback on their personal and professional development (see also section 5). 

SLO 1.3.1 is met through two routes.  First, in the PhD component of the program, the emphasis is on the development of a constructive mentoring relationship between the student and his/her advisor (and also the other members of his/her dissertation committee).  As part of this relationship, it is expected that the advisor will negotiate an extended program of reading, directed research and other scholarly activities with the student.  Second, depending on the concentration, the student may be required to take further specialist classes, practica and internships.  As a result of these activities, students are expected to become well-prepared for the doctoral comprehensive examination (see section 5). 

SLO 1.3.2 is a formal milepost in the development of PhD students and typically involves the student in preparing a substantial dissertation proposal document, responding to comments on this document from the dissertation committee, and making an oral presentation of the dissertation proposal, usually lasting at least one hour.  Both written and oral feedback from the committee members is expected to be incorporated into the final version of the dissertation proposal. 

SLO 1.3.3 requires each graduate student to make timely progress through their program of studies, according to the rules of the Graduate Division.  Students failing to make timely progress are identified by the Graduate Division, and corrective action is then initiated by the Graduate Chair of the Department. 

SLO 1.3.4 stems also from the mentoring relationship referred to previously.  Advisors of graduate students are expected to play a proactive role in the development of graduate students, assisting them with the identification of appropriate routes for dissemination of research findings, and helping with the process of responding to reviewers and editors. 

SLO 1.3.5 comprises the final formal mileposts, in which students complete their doctoral dissertation according to the guidelines of the University of Hawaii, and defend their work in public in front of their dissertation committee. 

 

5. Does your program benchmark or have goals for student performance? (e.g. 70% students will graduate within 5 years)

We have a goal that 70% of students will graduate within five years.  

6. Other than GPA, what data/evidence is used to determine that graduates have achieved stated outcomes for the degree? (i.e. capstone project, class assignment)

1.1.            Initial admission requirements.  Entry into the graduate program in Psychology is competitive: in AY2005-6, 27 of 198 (13.6%) were offered places, and in AY 2006-7, 13 out of 86 (6.9%)  Each applicant is reviewed on the basis of academic achievement at baccalaureate level, scores on the graduate record examination and tests of English language competence if necessary, their personal statement, and three letters of reference.  The entire faculty of the department meets to approve admissions.

1.2.            Advancement to Candidacy for the Degree of MA.  This is typically done by proforma approval via the Graduate Chair, although there may be cases where undergraduate deficiencies must be remedied. 

1.3.            Knowledge assessment for graduate classes.  Each graduate class will have its own assessment devices, at the discretion of the instructor.  Typically, each graduate student will encounter a variety of assessment devices over the range of core and foundation classes.  This range includes formal written examination, extended essay, oral presentation, oral examination, poster presentation, and clinical skills observation.  Students receive feedback and letter grades for each graduate class (including directed research classes).

1.4.            Advancement to Thesis Stage (MA).  This assessment event involves a written thesis proposal which is reviewed by a three-member committee of faculty (all selected from the Department of Psychology).  If the thesis requires human participants or the use of animals, a prerequisite is that the student must obtain IRB approval prior to advancement.  Typically, the student then makes a short oral presentation to his/her committee, responds to questions, and implements any changes requested.  The resultant paperwork is reviewed by the Graduate Chair prior to acceptance.

1.5.            Final Examination and Approval of Thesis (MA).  The student will complete his/her empirical work and write the thesis in consultation with his/her primary faculty advisor.  When appropriate, a thesis defense is scheduled.  Typically, the student makes an oral presentation of about one hour, and responds to questions from the committee.  The final form of the thesis is signed by all committee members, and all paperwork is reviewed by the Graduate Chair prior to acceptance.

1.6.            Advancement to Doctoral Candidacy.  All students who have successfully obtained the degree of MA are reviewed by the entire faculty of the Department, following recommendation by the concentration faculty.  Students submit a full curriculum vitae and covering letter explaining their progress to date, academic and professional accomplishments, and plans for doctoral study.  The faculty meet to discuss each case for advancement, and consider both the student’s documents and comments from teachers and advisors of the student.  Advancement to doctoral candidacy may be denied, in which case the student exits the University with the degree of MA only.  It should be noted that this scenario is rare.

1.7.            Doctoral Comprehensive Examinations.  The Comprehensive Examination ensures that doctoral students have a thorough and adequate comprehension of their chosen field of study.  The form of the examination various across the different concentrations within the department, giving the faculty within each concentration the flexibility to adapt the comprehensive examination process to best suit the student’s area of study.  Some examples of comprehensive examinations include (a) formal written examinations designed to assess knowledge of a specified body of literature; (b) a portfolio of research and professional activities, examined by the dissertation committee and subject to oral examination; (c) a dossier of accomplishments in three of four professional activity domains (for the clinical studies concentration).

1.8.            Advancement to Dissertation Stage.  This assessment event is similar to 1.4 in that students submit a substantial written research proposal, accompanied by IRB approval if necessary.  The student then makes an oral presentation to his/her dissertation committee, which must consist of four faculty members from the Department of Psychology, plus one outside member from a separate Department.  The student responds to questions and implements any required changes to the research proposal.  Paperwork is reviewed by the Graduate Chair prior to acceptance.

1.9.            Final Examination and Approval of Dissertation.  The student will complete his/her empirical work and write his/her dissertation in consultation with his/her advisor and members of his/her dissertation committee as appropriate.  When the dissertation is complete, a public defense is undertaken in front of the committee.  The doctoral dissertation defense is a public event that must be publicized according to the Graduate Division’s rules.  The defense is oral, is never less than one hour in length, and the committee is expected to subject the student to rigorous questioning.  Major or minor changes to the dissertation may be required prior to final approval.  The Graduate Chair has oversight of the paperwork and signs his/her approval as a final step.

1.10.        In addition to stages 1.1 – 1.9 above, the Department strongly encourages advisors to review student progress on an annual basis.  In some concentrations, notably the clinical studies concentration, this annual review process is formalized and extensively documented (to meet requirements of the American Psychological Association).  The Graduate Chair is actively working to encourage standardization of the annual review process across the concentrations.

7. Who interprets the evidence of student learning?

Course instructors; thesis and dissertation committee members; practicum supervisors, especially for students in the clinical concentration; concentration faculty; the faculty of the department as a whole.

8. How are the assessment data/results used to inform decisions concerning the curriculum and administration of the program?

Assessment data are used in three general ways to inform the development of the graduate programs in psychology.

 

First, they form an important input into professional accreditation through the American Psychological Association, which is required for the clinical studies concentration.  All aspects of program provision, student progress and pedagogy are considered, and accreditation reports then inform future changes.

 

Second, the Graduate Chair and Graduate Studies Committee oversee the progression of students and make recommendations to the Department about curriculum design.  One of the Graduate Chair's duties is to sit on the Departmental Scheduling Committee to ensure that graduate course provision is appropriately coordinated on a yearly basis.

 

Third, policies and administrative procedures for the graduate programs the Department of Psychology offers are discussed regularly, and modified when appropriate, by the Graduate Studies Committee, taking input from both formal assessment events and less formal student amnd faculty feedback.

9. What attempts are made to monitor students’ postgraduate professional activities?

The Director of the Clinical Studies Program closely monitors students' progress toward their degrees, their placement in practica, and their placement in internships.  In addition to this, individual advisors monitor each students activities.

Post-graduate activities of students who have received a PhD. From the clinical program are systematically monitored as part of the process of maintaining professional accreditation through the American Psychological Association.