College and Research Libraries What Journals Do Psychology Graduate Students Need? A Citation Analysis of Thesis References Margaret Sylvia and Marcella Lesher The increasing price of journal subscriptions and the increasing number of journals available make it difficult for libraries to supply all needed material locally for scholarly research. Bibliographic citation analysis of student research papers is one method of evaluating the use of a journal collection. Journal selection and cancellation may be done on the basis of cost-per-use to maximize the usefulness of materials purchased with the library budget. Theses provide a convenient archival resource of student research. This study used the biblio- graphic citations found in theses and dissertations of graduate students in the psychology and counseling departments of the university, cost-per-use statis- tics, and shelving statistics to develop a basis for psychology journal selection in the Academic Library. The library should not rely on one single evaluation technique. It should take advantage of a combination of techniques, which as this study indicates, serve to complement each other. cademic libraries face a seri- ous budgetary problem in the development of library collec- tions because of the rising cost of journal subscription prices and the increasing number of new journals. Journal prices have, in recent years, in- creased far in excess of inflation so that most academic libraries, even those with modest budget increases, are canceling subscriptions rather than adding to their collections.1 In addition, since 1665, sci- entific journals have doubled in number every fifteen years.2 This combination of circumstances makes it more difficult for academic libraries to supply the infor- mation needs of clients. The Academic Library has been in the unusual position over the past five years of being able to add extensively to its collection of journals in psychology and counseling due to the establishment o~ a new Ph.D program in counseling. Titles ordered for the counseling program alone increased from forty-six in 1989 to 144 in 1994. Librarians selected new ti- tles using various methods with priority given to requests from faculty and sec- ondarily to an evaluation of interlibrary loan requests. All titles must also be in- dexed in Psychological Abstracts before they are approved for purchase. Back files were ordered (usually in five-year increments) as part of this expansion. Because of this combination of new titles and back files, the budget amount com- mitted to ongoing subscriptions has in- creased each year while the amount available to order new titles and their accompanying back files has decreased. Margaret Sylvia is Assistant Director for Technical Seroices at the Academic Library, St. Mary's University, San Antonio, Texas. Marcella Lesher is Periodicals Librarian at the Academic Library, St. Mary's University, San Antonio, Texas . 313 314 College & Research Libraries Since the amount of money available for this collection is relatively stable, there is a point where current subscriptions can be maintained but new titles cannot be ordered without sacrificing older titles. In order to ensure that the utility of the col- lection is maintained, it is important to start evaluating the collection with some additional measures of utility other than those currently in use . COLLECTION EVALUATION There are several established methods for evaluating library collections, in- cluding checking specific lists and bibli- ographies against the collection, having experts in the literature examine the col- lection directly, compiling comparative statistics on collection size and expendi- tures, studying circulation and in-house use, surveying user opinions, doing shelf availability studies, analyzing in- terlibrary loan statistics, and analyzing bibliographic citations. There are advan- tages and disadvantages associated with each of these methods of collection evaluation. No one method used alone is sufficient to provide all information needed for a good collection evaluation.3 Ideally, this study will set some parameters for how other subject areas in the journals collection can be measured on an ongoing basis. The Academic Library is involved cur- rently in using most of the collection evaluation methods noted above, either formally or informally, in an ongoing collection evaluation. Title selections are made based on expert "faculty" evalu- ations. In addition, bibliographic lists are consulted, . and usage statistics (based on shelving counts) are taken on an ongoing basis. Limitations exist in that periodical titles do not circulate. There are also vagaries inherent in shelv- ing counts, i.e., patrons shelving their own material, use by students from other universities, etc. One untapped resource is the collec- tion of master's theses and dissertations July 1995 done by psychology and counseling stu- dents. Up until the time of this study, it was unknown what titles were actually appearing in the bibliographies of these manuscripts. WHY CITATION ANALYSIS? Empirically, one of the best ways to measure past use of an academic library is through citation analysis of student research papers. Citation analysis has been done through nationally collected citation statistics, and proposals have been made to use these analyses for li- brary collection development and evalu- ation.4-6 The easiest approach is to simply look at previous studies and use the findings to govern one's own collec- tion development strategies. There are, however, some very strong arguments for doing a local study. Maurice B. Line argued that every library has a differing clientele, and that these clients have dif- ferent information requirements so that national surveys may have little rele- vance for individuallibraries.7 Many li- braries have, indeed, done local citation analyses to determine their own special needs.8- 12 A drawback of this procedure is that students tend to use what is found easily in local libraries. One other area of investigation for the journals collection involved determin- ing if it fit into the familiar bibliographic pattern known as the Law of Scattering. If our usage patterns fit this pattern, 80 percent of the citations from our data- base should come from about 20 percent of the cited journals. 13 This top 20 per- cent of cited journals should represent at least part of a core list of psychology journals found in the Academic Library. OTHER FACTORS There were two additional factors used in refining the "core" list of psy- chology journals. These factors are cost- per-use and shelving statistics. Although subscription price is only one element of the cost factor associated with maintain- ing the periodicals collection, it is a major factor in making selection and de- selection decisions, especially for journals with relatively low usage. Reshelving A Citation Analysis of Thesis References 315 counts are also important because these data provide some indication of how ti- tles are used for purposes other than thesis and dissertation research. PURPOSEOFTHESTUDY Using the three measures discussed- citation analysis, cost-per-use, and reshelv- ing counts-several questions can be answered that provide useful information about how the collection should be man- aged in the future. Ideally, this study will set some parameters for how other sub- ject areas in the journals collection can be measured on an ongoing basis. Consider the following: • Which journals have the highest usage? • Does the Academic Library hold these titles? • Do our journals fit into the Law of Scattering pattern? • According to citations from the psy- chology and counseling theses, which are the most cost-effective journal ti- tles for the Academic Library to own in terms of cost-per-use? • Do we hold the most cost-effective journals? • Is there a relationship between cita- tion analysis and shelving counts? • Does citation analysis give us a better understanding of the needs of our own clientele? PROCEDURE The bibliographic citations for journals from theses and dissertations written by psychology and counseling students at the university during the past six years were collected. The journal title and cita- tion date were recorded for each journal citation, and library holdings were checked using this information. The cur- rent subscription price taken from the latest Librarian's Handbook was used to determine the cost-per-use of each jour- nal by dividing the cost of the journal by the average number of citations per year over the six-year period that data were collected. 14 Journals were ranked in two ways: (1) by the number of citations in the database, and (2) by cost-effective- ness. Shelving counts for the 1991-92 fis- cal year were also examined. RESULTS Usage Table 1 lists twenty-eight titles cited more than ten times in the theses and dissertations included in the study. Of these twenty-eight titles, seven are not owned by the library. Two of the titles, Primates and Folia Primatologica, are very specialized and do not really fit with the primary emphasis of the program at the university. These titles were not consid- TABLE 1 CITATION COUNTS IN RANKED ORDER OF FREQUENCY No. of Gtations Title 33 *Personnel Psychology 30 *Hispanic Journal of Behavior Sciences 28 *Journal of Counseling Psychology 26 *Journal of Applied Psychology 24 *Journal of Consulting and Clinical Psychology 23 *American Psychologist 23 International Journal of the Addictions 21 * Counselor Education and Supervision 21 * Nature (ordered for another department) 20 Primates 19 *New York Times (ordered for another department) 16 *American Journal of Psychiatry 16 *Journal of Abnormal Psychiatry 16 *Journal of Educational Psychology (ordered for another department) 16 Journal of Vocational Behavior 15 *Journal of Personality and Social Psychology 15 * Psychometrika 14 Journal of Human Evolution 13 Intelligence 13 Journal of Educational Measurement 13 *Journal of Marriage and the Family 12 * Psychological Reports 11 *American Journal of Family Therapy 11 * Archives of General Psychiatry 11 Folia Primatologica 10 *Journal of Clinical Psychology 10 *Journal of Counseling and Development ,. Indicates ownership by the Academic Library. 316 College & Research Libraries ered for purchase, particularly since all citations for them came from a single user with a very extensive bibliography. A third title, International Journal of the Addictions has a current subscription cost of $1,045 and requires careful ex- amination before purchase because of the high cost. The other four titles are possible replacements for lesser used journals. Several of the most heavily used journals included citations for older volumes not held by the library. For example, Hispanic Journal of Behav- ioral Sciences had twelve citations from older issues, indicating a need to con- sider more back issue purchasing. Law of Scattering There were 376 titles cited in the data- base. The top seventy-five titles (20 p~r­ cent) constituted 62 percent of the citations (769 out of 1,732 total citations). This is not the 80 percent predicted by the Law of Scattering. However, the dif- ference is not strong enough based on this statistic alone to warrant serious changes in our collection strategies. However, as more data are gathered in the future, and the collection changes, an increase may occur among the top 20 percent. The Academic Library holds fifty-eight of the most heavily cited sev- enty-five titles. Since seventeen of the titles from this group are not owned, this is another resource "pool" for making possible changes and/ or additions to the collection. Cost-Effectiveness Table 2 ranks the top group of titles by cost-per-use over the study's six-year period. This shows a fairly effective cost- per-use ratio, especially taking into consideration the relatively short time period and the small pool of theses and dissertations included in the study. Table 3 is a summary limited to the titles which are included in the budget for psychology or counseling, as well as the seven journals not owned by the Aca- demic Library but which fall in the high usage group listed in table 1. As is indi- cated in table 2, seventeen of the most highly cited journals have a cost-per-use Cost($) 273.00 204.00 187.00 158.00 117.00 102.00 89.00 84.00 81.00 72.00 63.00 63.00 53.00 51.00 51.00 50.00 46.00 41.00 39.00 28.00 23.00 18.40 10.00 7.00 July 1995 Title International Journal of the Addictions Folia Primatologica Journal of Personality and Social Psychology Journal of Human Evolution Psychological Reports American Journal of Psychiatry Journal of Vocational Behavior Journal of Clinical Psychology Primates Psychological Bulletin Journal of Consulting and Clinical Psychology American Psychologist Journal of Educational Psychology Journal of Applied Psychology Intelligence Journal of Abnormal Psychology Archives of General Psychiatry American Journal of Family Therapy Journal of Counseling and Development Psychometrika Journal of Educational Measurement . Hispanic Journal of Behavioral Sciences Personnel Psychology Counselor Education and Supervision TABLE3 SUMMARY OF COST-PER-USE OF ALL COUNSELING AND PSYCHOLOGY TITLES INCLUDED IN CITATION COUNTS No. of Titles Cost-per-Use ($) 14 1-49 16 50-99 8 100-149 8 150-199 7 200-249 5 250-299 4 300-349 2 350-399 3 400-449 2 450-499 1 500-549 1 550-599 1 600-649 2 650-699 4 Over 700 78 Total A Citation Analysis of Thesis References 317 of less than $100. Totals for the entire sample as summarized in table 3 indi- cate that thirty of the titles purchased by the library have a cost-per-use of less than $100. This is 43 percent of all titles measured for cost-effectiveness. Figures in tables 1 to 3 are based only on citation counts for the past six years of master's theses and dissertations, and do not include usage as measured by shelving counts. Since the increase in the budget was made to support the Ph.D program in counseling, it was more ap- propriate to limit cost-per-use measure- ments to citation analysis only. These figures provide a starting point. As data are collected, titles with high cost-per- use will be monitored. SHELVING COUNTS Bibliographic citation counts provide a simple form of measurement but are not definitive. It was somewhat surpris- ing to see that shelving counts did not correspond to citation analysis. Al- though some titles in table 1 did have very high shelving counts-an average of sixty-one times in a one-year period (1991-92) for eighteen titles-there were many titles that had little or no usage in the citation analysis but had heavy use according to shelving counts. The top group of those titles is indicated in table 4, which compares titles that were shelved more than thirty times with the number of times that they were cited. TABLE4 HIGH-USAGE TITLES WITH LOW CITATION COUNTS Shelving Citation Title Count Count Family Relations 115 1 Family Therapy Networker 72 0 Journal of Family Therapy 72 2 Child Development 34 7 Counseling Psychologist 31 4 Journal of Drug Education 35 0 Journal of Homosexuality 39 0 Journal of Mental Health 38 0 Counseling Journal of Social Psychology 30 3 Mediation Quarterly 32 0 Psycho therapy 54 3 None of the titles in table 4 figured into the citation count more than seven times. One obvious conclusion from this is that both measurement tools are im- portant. Citation analysis can be used to confirm what shelving counts should be indicating, but citation analysis will not provide a complete picture of journal usage. Since many students are not re- quired to present the master's thesis, their research is harder to measure but obviously many titles are used that do not show up in citation: counts. Data col- lected in future years may indicate a much broader listing of titles. If broad- ening does not occur, some theorizing might be made about a possible nar- rower range in focus of theses and dis- sertations. This would not be unusual in that the independent research con- ducted by this group of students is un- doubtedly more heavily influenced by the research interests of their faculty supervisors than students doing class assignments. Because of budgetary limi- tations, faculty research interests do not rate as highly in the St. Mary's collection development guidelines as do student research interests. MEETING STUDENT NEEDS Perhaps the most interesting outcome of this study is in seeing just what types of journals are used from a qualitative rather than quantitative viewpoint. In San Antonio the population of the uni- versity and of the community is primar- ily Hispanic. Thus, the heavy usage of the Hispanic Journal of Behavioral Sciences reflects this demographic trend. One other factor that was also surprising was the heavy usage of journals dealing pri- marily with science. This may indicate a need to think in a more "interdiscipli- nary" manner regarding future collec- tion decisions. CONCLUSION There is no easy formula for determin- ing what should constitute the collec- tion for any program. However, citation analysis, shelving counts, and cost- per-use are all extremely helpful. Each technique complements the other. By 318 College & Research Libraries July 1995 beginning a routine of careful analysis using all of these measurements, aca- demic librarians can make future col- lection decisions with confidence. Furthermore, the use of psychology and counseling journals provides us with a model that can be used in other areas of the collection. REFERENCES AND NOTES 1. Lee Ketcham and Kathleen Born, "The Art of Projecting: The Cost of Keeping Periodicals," Library Journal118 (Apr. 15, 1993): 42-48. 2. Derek J. Price, Science Since Babylon (New Haven, Conn.: Yale Univ. Pr., 1975). 3. Barbara Lockett, ed., Guide to the Evaluation of Library Collections (Chicago: ALA, 1989). 4. Stephen J. Bensman, "Journal Collection Management as a Cumulative Advantage Process," College & Research Libraries 46 Oan. 1985): 13-29. 5. Robert N. Broadus," A Proposed Method for Eliminating Titles from Periodical Subscription Lists," College & Research Libraries 46 Oan. 1985): 30-35. 6. Elizabeth Pan, "Journal Citation as a Predictor of Journal Usage in Libraries," Collection Management 2 (Spring 1978): 29-38. 7. Maurice B. Line, "Use of Citation Data for Periodicals Control in Libraries: A Response to Broadus," College & Research Libraries 46 Oan. 1985): 36-37. 8. George R. Chambers and James S. Healey, "Journal Citations in Master's Theses: One Measurement of a Journal Collection," Journal of the American Society for Information Science 24 (Sept./Oct. 1973): 397-401. 9. Larry Hardesty and Gail Oltmanns, "How Many Psychology Journals Are Enough? A Study of the Use of Psychology Journals by Undergraduates," Serials Librarian 16, nos. 1-2 (1989): 133-53. 10. Rose Mary Magrill and Gloriana St. Clair, "Undergraduate Term Paper Citation Patterns by Discipline and Level of Course," Collection Management 12, nos. 3-4 (1990): 25-56. 11. Bluma C. Peritz and Dina Sor, "The Use of Libraries by Graduate Students in Psychology as Indicated by Citations," Coll.ection Management 12, no. 3-4 (1990): 11-23. 12. G. St. Clair and R. M. Magrill, "Undergraduate Use of Four Library Collections: Format and Age of Materials," Collection Building 11, no. 4 (1992): 2-15. 13. Audrey S. Tobias, "The Yule Curve Describing Periodical Citations by Freshmen: Essential Tool or Abstract Frill?" Journal of Academic Librarianship 1 (Mar. 1975): 14-16. 14. Ebsco Industries, Librarians' Handbook (Birmingham, Ala.: Ebsco, 1993) . . COLLEGE & RESEARCH LIBRARIES INDEX TO ADVERTISERS ALA 340 ACRL 351,365 Bioisis 294 Blackwell 324 Library Technologies 2d cover Minolta 362,363 OCLC 300 PAIS 299 Personal Bibliographic Software 293 Readmore 372, 3d cover Todd 4th cover