LibQUAL Survey Administration
LibQUAL Survey AdministrationMartha KyrillidouAssociation of Research LibrariesMichael MacielTexas A&M UniversityAmerican Library AssociationMidwinter MeetingChicago, ILMonday, February 2, 2015www.libqual.org
Overview Preparing for the Survey Implementation––––––Defining survey objectives/desired outcomesInstitutional review boardSamplingCreating an assessment group/teamPreparing the organizationMarketing your survey Online System: Management Centerwww.libqual.org
Preparing for the SurveyImplementationwww.libqual.org
Why is Your Library Participatingin LibQUAL ? Institutional goals:– what do you want to get out of the survey? Survey requirements:– people, supplies, technologywww.libqual.org
Get Permission from yourInstitutional Review Board Local group that approves human subjectresearch May also be called– Committee for Human Subject Research– Committee for the Protection of HumanSubjects Not all institutions need to obtain permissionwww.libqual.org
Get Permission from yourInstitutional Review Board If permission is required:– Seek well in advance of survey– Supply a copy of the survey, if requested– Inform them that results will be sharedamong participants No need to inform LibQUAL of decisionwww.libqual.org
Determine Whom to Survey Random sampleor Entire populationwww.libqual.org
If You Sample Recommendations:– At least 1,200 or more random e-mailaddresses for each user group– Separate sample groups forundergraduates, graduates, faculty, andstaff– Think about survey fatigue if you want torepeat the survey regularly Keep notes on your methodology as you willbe asked to describe it in the Post HocQuestionnairewww.libqual.org
If You Survey the Entire Population Recommendations:– Think about survey fatigue if you want torepeat the survey regularly Keep notes on your methodology as you willbe asked to describe it in the Post HocQuestionnairewww.libqual.org
Obtain Email Addresses Typical sources include:– Campus computing office– Campus administrative records office– Library patron databasewww.libqual.org
Become Familiar with LibQUAL Resources Manage Your Surveyhttp://www.libqual.org/ LibQUAL Procedures ns/ProceduresManual.pdf Discussion listLIBQUAL-L@listserv.tamu.eduwww.libqual.org
Marketing Your Survey–––––Place ads in campus newspaperWrite article for library newsletterPost flyers around campusPresent at faculty meetings & student orientationsCreate a survey website and feature on library’shome page– Take the survey to where users are: dining halls,study rooms, dorms– More suggestions and example works areavailable on Publications section of LibQUAL.orgwww.libqual.org
The LibQUAL Management Centerwww.libqual.org
LibQUAL Management Center:Getting Started Login (Required to use the Management Center) Center Sections:– Manage Surveys– Data Repository– Manage Users– Organization Websites– Manage Permissions– Directory– Resourceswww.libqual.org
Survey Process: Manage Your SurveyFour Stages1.2.3.4.Pre-LaunchMonitor Survey ProgressClose My SurveyPost-Survey and ResultsStage 1www.libqual.org
Manage Your Survey:Stage 1 - CustomizationAlwayssave yourworkwww.libqual.org
Manage Your Survey:Stage 1 - Optional Questionswww.libqual.org
Manage Your Survey:Stage 1 - Positions Results notebooks summarize findings by Position (usergroup)– “Parent” categories (e.g., Undergraduate, Graduate,Faculty)– “Child” categories (e.g., First year, Doctoral,Associate Professor) Standard positions (based on your institution type, i.e.,College/University) Both Parent and Child position options can becustomized– Child options map to standard positions for peercomparisonswww.libqual.org
Manage Your Survey:Stage 1 – Position OptionsCustomizabletextMap to reporting value Peer comparisons Display on questionnaireCustomizabletextwww.libqual.org
Manage Your Survey:Stage 1 – Position OptionsOnly Child options can be selected by participants.Categories(Parents)Response options(Children)www.libqual.org
Manage Your Survey:Stage 1 - Positions Cautions– Only Child options can be selected byparticipants– You must have at least one Child option foreach Parent category– Need to provide representativeness data foreach position (Parent categories)www.libqual.org
Manage Your Survey:Stage 1 - Branch Library OptionsThe libraryyou usemost often.www.libqual.org
Manage Your Survey:Stage 1 - Disciplines Results notebooks summarize findings by usergroup and provide a chart for both standard andcustom disciplines Standard disciplines (based on your institutiontype, i.e., College/University) Customized disciplines– Recommend no more than 16 disciplines, ifpossible You can order a Discipline Analysis (additionalcharge) with notebooks for each customizeddisciplinewww.libqual.org
Manage Your Survey:Standard Disciplines Agriculture/EnvironmentalStudies Architecture Business Communications/Journalism Education Engineering/ComputerScience General Studies Health Sciences HumanitiesLawMilitary/Naval ScienceOtherPerforming & Fine ArtsScience/MathSocial Sciences/Psychology Undecided*Note: Disciplinesare for an AcademicLibrarywww.libqual.org
Manage Your Survey:Customized Disciplines Use your local terminology to map to thestandard disciplines Cautions:– Need to provide representativeness datafor each discipline– Too many choices present challenges touserswww.libqual.org
Manage Your Survey:Stage 1 - Customized Disciplineswww.libqual.org
Manage Your Survey:Results Notebook - Standard Disciplineswww.libqual.org*Note: Disciplinesare for an AcademicLibrary
Manage Your Survey:Results Notebook - Customized Disciplineswww.libqual.org*Note: Disciplinesare for an AcademicLibrary
Manage Your Survey:Stage 1 – Preview Your Survey & LaunchPreviewLaunch Complete at least one full runof your preview survey Test in different settings,using different platforms andWeb browsers Get library staff involved intesting Can no longer make changes Live survey URLwww.libqual.org
Manage Your Survey:Stage 2 - Representativeness Questionnaire Determines how your institutional profile compares toyour survey data Requires the following information:––––# of individuals per user group (Position)# of individuals within each discipline# of males and femalesLibrary Statistics Total library expenditures (U.S. dollars)Personnel – professional staff, full-time equivalent (FTE)Personnel – support staff, full-time equivalent (FTE)Total library materials expendituresTotal salary and wages for professional staffUse the fiscal year (2013-2014) that ended the year before you aredoing the survey (2015) Complete before closing surveywww.libqual.org
Completed ompletedRepresentativenessNOT Completedwww.libqual.org
Sending Reminders 3-5 reminders to sample populations Include a thank you to respondents whohave completed the survey Boost marketing efforts around campus– More flyers, table tents, ads in campusnewspaper– Get professors and other staff involved– Increase number or types of incentives Confidentialwww.libqual.org
Manage Your Survey:Stage 3 - Closing Your Survey We recommend a survey run of at least3 weeks– Continuous Confirm you want to close – irreversiblestepwww.libqual.org
Manage Your Survey:Stage 4 - Post-Survey Taskswww.libqual.org
Manage Your Survey:Stage 4 - Resultswww.libqual.org
Manage Your Survey:Stage 4 – Incentive Winnerswww.libqual.org
Manage Your Survey:Stage 4 - Post Hoc & Evaluation QuestionnairesPost Hoc Questionnaire Information about yoursurvey– Sample size– # of e-mails sent– #of invalid e-mailaddresses– Incentives offered– Marketing techniques– Etc.Evaluation Questionnaire Feedback about yourLibQUAL experience All survey liaisons andassistants areencouraged to completethis questionnairewww.libqual.org
Survey Results Survey Results Notebook (PDF)– Individual & Group Analyses Comments– About half of users provide comments– Download Excel file from Stage 4 or Data Repository Excel/SPSS data files Additional Services:–––––Customized Discipline AnalysisLibrary Branch AnalysisUser Subgroup AnalysisOther customized analyses (upon request)Print Copieswww.libqual.org
General Discussionand Q&Awww.libqual.org
Summary and Closurewww.libqual.org
LibQUAL Resources LibQUAL Lite News Events and Training Publications About pages LibQUAL Procedures Manualwww.libqual.orgwww.libqual.org
The LibQUAL Team The best way to contact us: libqual@arl.org Amy YeagerPublic Relations Program Officeramy@arl.org Martha KyrillidouSenior Director, Statistics and Service Quality Programsmartha@arl.org Henry GrossSenior Applications Developerhenry@arl.org Gary RoebuckDirector of Information Technologygary@arl.org Shaneka MorrisSurvey Coordinator and Data Analystshaneka@arl.orgwww.libqual.org
LibQUAL Survey ResultsPresented by:Martha KyrillidouAssociation of Research LibrariesAmerican Library AssociationMidwinter MeetingChicago, ILMonday, February 2, 2015www.libqual.org
Results Notebooks Sections for Overall, Undergraduates, Graduates,Faculty, Staff, Library Staff include:– Demographic Summary– Core Questions Summary– Dimensions Summary– Local Questions– General Satisfaction Questions– Information Literacy Outcomes Questions– Library Use Summary Appendix describing changes in the dimensions andthe questions included in each dimension.www.libqual.org
Results Data Repository:Individual NotebooksGroup Notebook(PDF)Unified GroupNotebook (PDF) User Comments Excel / SPSS data fileswww.libqual.org
Core Items and Dimensions22 core items (i.e., questions)Three dimensions: Affect of Service – 9 questions Information Control – 8 questions Library as Place – 5 questionswww.libqual.org
DO YOU UNDERSTANDYOUR RESULTS?www.libqual.org
Understanding Your Individual Results Look at the top 5 most desired services Compare your results with peer or ARL institutions Compare your results over time Compare your faculty’s minimum with the aggregateminimum acceptable levels– Same for perceived and desired Look at user groups individuallywww.libqual.org
Understanding Your Individual Results Look at user groups by discipline Look at results to determine if users are not aware ofwhat the library already does Explore one question by discipline and user group Probe the questions that had meaningful gaps betweenperceived results and minimum expectations Focus on questions with negative gaps (i.e., the red)www.libqual.org
Interpreting Your LibQUAL Data Determining representativeness LibQUAL Scores have 3 interpretation frameworks:– Zone of tolerance– Peer comparisons– Longitudinal analysis Quantitative Analysis: Excel Data Qualitative Analysis: Commentswww.libqual.org
Determining Representativenesswww.libqual.org
Understanding Your Individual Results:Radar ChartsKey Term:Zone of Tolerancewww.libqual.org
Key to Radar ChartsKey Term:Zone of Tolerancewww.libqual.org
Radar Chart BasicsKey Term:Zone of Tolerancewww.libqual.org
What Do the Colors Mean?Key Term:Zone of ToleranceGreenAndBluewww.libqual.org
What Do the Colors Mean?RedKey Term:Zone of Tolerancewww.libqual.org
What Do the Colors Mean?Little YellowKey Term:Zone of Tolerancewww.libqual.org
What Do the Colors Mean?A lot of YellowKey Term:Zone of Tolerancewww.libqual.org
Understanding Your Individual Results:Thermometer ChartsKey Term:Zone of Tolerancewww.libqual.org
Dimension SummaryKey Term:Zone of Tolerancewww.libqual.org
Three interpretation frameworks Zone of tolerance– Perceptions vs. expectations– meeting users minimum expectations– Approaching users’ desired expectations My scores over time (longitudinal)– Am I doing better or worse compared to lasttime I measured my performance Peer comparisonswww.libqual.org
Other Analytical Tools LibQUAL Analytics– Institutional Explorer (peer comparison)– Longitudinal Analysishttp://libqual.org/analytics Norms SPSSwww.libqual.org
Quantitative Analysis: Excel Data Excel/SPSS data files available on the LibQUAL Website Use customized radar chart template to create customanalyseswww.libqual.org
Qualitative Analysis: User Comments About one-half of users include comments on theirsurveys User Comments available on the LibQUAL website– Download comments in Excel or text file Skim the comments Conduct ATLAS.ti analysiswww.libqual.org
Library Use Summarywww.libqual.org
LibQUAL HighlightsAvailable fordownload on the Publicationspage athttp://libqual.org/publicationswww.libqual.org
Results notebooks summarize findings by user group and provide a chart for both standard and custom disciplines Standard disciplines (based on your institution type, i.e., College/University) Customized disciplines -Recommend no more than 16 disciplines, if possible You can order a Discipline Analysis (additional
the Association of Research Libraries who had previously developed the LibQual survey instrument. The LibQual conceptual approach was also based on SERVQUAL, a tool used in the private sector to assess service quality. Following the success of the pilot project, a research project was commissioned by Dr. Timothy Chester.
Brigham Young University Participation: 2001, 2003, 2004, 2006 Brian Roberts (801) 422-1989 brian_roberts@byu.edu Type of Analysis: Qualitative and Quantitative The Harold B. Lee Library again joined with other libraries throughout the U.S., Canada and abroad in ARL’s survey of library service quality, LibQUAL .
Benefits for your institution include: Institutional data and reports that enable you to assess whether your library services are meeting user expectations; Aggregate data and reports that allow you to compare your library's performance with that of peer institutions; Workshops designed specifically for LibQUAL participants;
Association of Research Libraries ARl Annual Salary Survey 1984 1527 New Hampshire Avenue, N.W., Washington, D.C. 20036 Compiled by Gordon Fretwell
Survey as a health service research method Study designs & surveys Survey sampling strategies Survey errors Survey modes/techniques . Part II (preliminary) Design and implementation of survey tools Survey planning and monitoring Analyzing survey da
new survey. Select one of those options to apply to your new survey form. 1)Create a new survey from scratch - will create a blank survey form that you can use to add your own questions 2)Copy an existing survey - can be used to create a copy of a survey form you have already created 3)Use a Survey Template - will allow you to select
1. A recruitment survey (public survey) will be used to recruit subjects in the study. Public survey link. 2. If a participant agrees to participate, a demographic survey (private survey) will be sent to the participant to fill out. Automatic survey invitation. 3. Based on the answer in the demographic survey, the
changes to the ASME A17.1-2013/CSA B44-13 code. At the end of the Planning Guide are lists of gures and tables. Again, these are added so you can quickly and easily access the gures and tables you need. For more product-speci c information you may look at the accompanying product vs. segment matrix. This will allow you to see which KONE products we recommend for certain segments, such as .
