A Video-Introduction to PLO Program Assessment: Why and How
WHAT EXACTLY ARE YOU LOOKING FOR?
The Council on Assessment is looking for the following in an Assessment Report and Plan:
- A concise summary of your findings from the last cycle of assessments
- What the program learned from them (i.e., is X meeting your standards? would you like to see Y improve?)
- What the department has done/is doing with that information.
Here, we can see whether your prior plan was (a) realistically achievable and (b) practically useful for your program.
- Some current information about your program (degree name, student enrollment, faculty involved in this assessment) and a review of your PLOs and curriculum map.
This is your opportunity to describe any changes made to the program in the last three years, as well as to request assistance in updating your PLOs, if you would like.
- A plan for assessing your program, which addresses one of your PLOs. This should include direct evidence (i.e., actual student work), a scoring guide specific to your inquiry (which should be included in the plan), and a timeline of when/where data will be collected and who/how it will be assessed.
Your plan’s focus can be either the same PLO as the prior cycle (if you need further data or need to adjust your method of investigation) or a different PLO (if that inquiry is complete, or the program currently wants to prioritize another program outcome).
We have created a Template for PLO Assessment Plans that lays out all of these parts in question-answer format, for your convenience!
Midway through the second year of implementing your plan, we will request a brief Progress Report, mainly to ensure that—if you needed to make changes to your initial plan, or would like any support in completing it—we can help you in a timely manner.
And that’s it! Just those two documents, every three years. PLO Assessment achieved.
WHEN DO YOU WANT IT?
UC Santa Barbara operates under a three year cycle for assessing program learning outcomes. Every three years departments report on the recent PLO assessment, and create a plan for the next PLO assessment.
Is your program in Group 1, 2, or 3? Here is a list of Assessment Groups/Cycles by Department.
At the beginning of the three year cycle (in January), your department must report on its assessment findings from the prior cycle AND its plan for the next three year PLO assessment.
Midway through year two of your three year PLO Assessment Plan (in October), a progress report is due. This is a required document.
Email all documents to Josh Kuntzman, our assessment coordinator.
Three-Year Assessment Plans
A successful PLO Assessment Report and Plan will include (a) a report of findings and outcomes from the prior PLO assessment cycle; (b) any updates to the program’s PLOs or Curriculum Map; and (c) a new plan, including a description of data to be collected, the rubric or scoring guide to be used in evaluating this data, and a timeline detailing when/where/who will be doing this work.
We strongly recommend that you submit this current Template for PLO Assessment Plans to ensure that your plan includes all pertinent details, and will be approved by the Council on Assessment.
Plans that are not initially approved will receive specific recommendations for revision from the CoA, and programs will coordinate with our assessment coordinator Josh Kuntzman on submitting a revised plan for CoA to review and approve. So:
- Your program's Assessment Team will submit a PLO assessement plan to the Assessment Coordinator, who will distribute it to Council on Assessment members for review and vote;
- The CoA will send a Memo to your program, either approving your plan or requesting specific revisions;
- If revisions are requested, your program will submit a revised plan to the Assessment Coordinator, who will work with you to ensure that all CoA issues are adequately addressed;
- The CoA will send you a memo approving your plan for implementation over the next three years of the assessment cycle.
Of course, you can reach out to the Assessment Coordinator, Josh, at any point during your planning process! He can help you review draft-plans, craft PLO-specific rubrics for your program, and answer any other questions about how to make your plan work best for you, your faculty, and your program.
Here are some important points to remember:
- These Assessments target Programs: focus on required courses in the major/program (as opposed to electives or GEs).
- These Assessments are Practical: focus on what you can do (in courses/curriculum) to improve student learning; select PLOs and guiding questions/theories accordingly.
- Plans need to be Coherent: make a clear connection between your target-PLO(s), your research question(s), your direct/indirect evidence, and your rubric/scoring guide criteria.
- Plans need to be Specific: reviewers are not from your departments! So, when in doubt, spell it out - why are you collecting data at This point in your curriculum, why is this a Sufficient sample-size for your question, why is your Standard for success __% or __/5 achievement etc., in this plan? Let us know your reasoning.
For inspiration, feel free to look through some of these prior plans from Graduate and Undergraduate Programs across departments at our University.
Sample Assessment Plans
Humanities & Fine Arts:
- Comparative Literature (Undergraduate)
- Film & Media (Undergraduate)
- French (Undergraduate + Rubric)
- History of Art & Architecture (Graduate)
Math & Hard Sciences:
- Psychology & Brain Sciences (Undergraduate)
- Molecular Cellular & Developmental Biology (Graduate)
- Ecology, Evolution, & Marine Biology (Graduate + Rubric)
- Education (Graduate)
Submitting a Progress Report midway through the second year of your assessment benefits you in two ways.
If you have deviated from your initial plan, or need to make changes going forward, you can use the progress report to describe these changes and get feedback/support from the CoA as needed.
Alternately, if everything is going according to plan, you can provide an initial report of these findings, which can then be used as a rough draft for your final report at the end of your assessment’s third year.
Below are a few sample Progress Reports, to give you an idea of what these check-in documents might look like.