Skip to Main Content

CSCU Assessment Toolkit

This Toolkit was developed by the CSCU Library Consortium’s Assessment Team in response to their charge of recommending best practices of implementing assessment data and analysis toward student success.

Guiding Question: How is the library supporting student research and information literacy?

Library Instruction Sessions: Quantitative Data

The following is an example of how a comprehensive quantitative assessment of library instruction might be conducted:

Central Connecticut State University won a Davis Educational Foundation grant in the fall of 2020 to ensure sustainability of its MSC-based assessment program by by increasing faculty participation throughout the process, building a library of valid assignments aligned to ten student learning outcome rubrics, increasing the number of student artifacts scored against the rubrics, and collaborating with a local community college in order to track transfer students' learning outcomes. The following documents are used in this process. Additional documents will be added to this page in the future.

The faculty who have participated in the Information Literacy assessment process so far have been from different academic departments, including FYE, WRT110 (basic freshman writing composition with embedded librarians), criminology, social work, bio molecular science, and our one-credit library sciences/information literacy course. 

Databases: Are students incorporating articles into their papers?

Assessing the inclusion of articles in student research papers requires the cooperation of at least one faculty member and possibly the local Institutional Research office. Librarians cannot assess this outcome without access to student artifacts. So the first step in pursuing this type of assessment if to build relationships with the partners needed for the project. Once those relationships exists, librarians can gather bibliographies from targeted student assignments, in a manner that complies with Institutional Research standards. If possible it can be helpful to collect a sample of bibliographies submitted prior to the teaching of a library session, to serve as a baseline to measure changes in student research behaviors.

In assessing the work of graduate students, librarians could assess the inclusion of articles that can be found in library databases through a survey of graduate students' published works. This could be done without the involvement of faculty or the local Institutional Research office, though relationships with graduate faculty might be helpful in calling the library's attention to their students' publications.

Research Appointments

Below are a variety of approaches to assessing research appointments.

Note that in addition to other helpful demographics that could be captured about research appointments, it is particularly important to log whether the appointment was with an undergraduate or graduate student. Research appointments with these two populations can be drastically different, requiring different levels of library resources and time, making it important to be able to track them separately.

Research Habits: How is the library contributing to scholarly activities?

Below are a variety of approaches to assessing how the library is contributing to scholarly activities.

In addition to assessing undergraduate and faculty research, as noted in the question above about article usage, it can be helpful to routinely survey graduate students' published works.

Chat/text/in person reference statistics

Libraries use different ways to collect interaction statistics.  These methods range from the simple (paper tick sheets at the desk), to online forms (Microsoft or Google Forms that are exported to Excel or Google Spreadsheets), to the purchase and use of professionally developed, desk statistic tracking programs (Gimlet and Desk Tracker Basic for example). 

Some libraries, particularly those with smaller budgets and staffs, seem to prefer the Microsoft or Google Forms option.  These forms can be easier for libraries to update as libraries adjust them based on what is and is not working.  Being able to export the results from these forms to an Excel or Google spreadsheet allows more interoperability with the other statistics that libraries collect (such as door counts, library instruction statistics etc.).

The exception to this assessment approach may be LibAnswers for our our online chat interactions.  This system has a robust statistical interface that allows for basic assessment as well as more detailed assessment options such as historical data and the ability to make comparisons.

Note that in addition to other helpful demographics that could be captured about reference interactions, it is particularly important to log whether the interaction was with an undergraduate or graduate student. Reference interactions with these two populations can be drastically different, requiring different levels of library resources and time, making it important to be able to track them separately.

The tracking and assessment of this reference data allows libraries to identify issues and possible actions:

  • Staffing concerns
    • Which type of library staff or student worker should spend time at the main, circulation or reference desk?
    • Are there times when we need more or less staff members available to patrons?
    • What overall hours should we have staff available?
      • And is that time consistent for the duration of the semester, or from semester to semester?
  • Staff training (Ozeran & Martin, 2019)
    • What do we need to ensure our new employees or student’s workers are prepared to help our patrons with?
      • Is the training we currently have sufficient, or should we add new information to cover new questions being asked?
      • Is everything in our current training still relevant to what library staff are being asked?
  • Handouts and/or training (including library signage)
    • Are we being asked the same questions repeatedly?
      • Is there a way that libraries can answer that question before it comes to us through some form of training?
        • Is the issue something that can be addressed with an informational sign or infographic posted inside the library? (Ozeran & Martin, 2019)
        • Should we create handouts that students can take with them?
        • Is the issue complex enough that a workshop or training session might be more appropriate? (Ozeran & Martin, 2019)
  • Instruction
    • Are there lots of students from the same section of a class asking for help with an assignment?
      • Can we reach out to that professor and offer to have a librarian do a quick class visit?
    • Do students mention having a librarian visit their class, but some part of the library instruction was unclear?
  • Collection development
    • Are students being asked to find material that is either hard to find or non-existent in the library’s collection?
    • Are library staff members suddenly seeing a lot of questions about a topic that they have not been asked about before?
  • Marketing
    • Is there enough data to prove to professors that providing a path to the library at the same time research assignment are introduced is beneficial to their students?
    • Are students making any comments about either the benefits of the sources they find in the library, or the help received from library staff that can be used to promote library services?

 

Ozeran, M., & Martin, P. (2019). “Good night, good day, good luck”: Applying topic modeling to chat reference transcripts. Information Technology & Libraries, 38(2), 59–67. https://doi.org/10.6017/ital.v38i2.10921

Additional Resources

Benchmarking reference data collection: The Results of a national survey on reference transaction instruments with recommendations for effective practice

Taking a fresh look: Reviewing and classifying reference statistics for data-driven decision making

Accessibility Statement
“Open CSCU” by the Connecticut State Colleges & Universities is licensed under a CC BY 4.0 International License. The individual items included are subject to their respective license provisions.