Evaluating Your Evidence

Each program can evaluate their evidence according to whichever qualitative or quantitative methods they feel are most relevant and appropriate. Some things to consider when identifying appropriate methods are:

  • How many student artifacts will be needed for a robust analysis, and how feasible will it be to collect that amount of data? For example, many quantiative methods work best with larger data sets, while some qualitative methods are designed for smaller data sets or may be impractical to apply to larger data sets due to the time they take.
  • Are the artifacts and scoring rubrics we have selected compatible with the method(s) we would like to use? For example, a multiple choice test with no partial credit is more appropriate for certain quantitative methods, while a thematic coding of an essay may be more appropriate for qualitative or mixed methods.
  • Are the resources required (time, expertise, software, etc.) feasible for our program?

Some programs may have faculty with a lot of expertise in methods that are applicable to assessment, while other programs may not have many or any faculty with this type of expertise. For support with evaluating your evidence, including ideas for appropriate methods, please contact the A-Team.