Procedimentos metodológicos para a seleção de material para a Revisão Estruturada da Literatura

George Bedinelli Rossi; Julio Carneiro da Cunha; André Torres Urdan

doi:10.5585/remark.v21i5.23454

Authors

George Bedinelli Rossi Escola de Artes, Ciências e Humanidades da Universidade de São Paulo (EACH/USP) https://orcid.org/0000-0002-8567-8376
Julio Carneiro da Cunha Universidade Nove de Julho (Uninove) https://orcid.org/0000-0002-1435-055X
André Torres Urdan Universidade Nove de Julho (Uninove) https://orcid.org/0000-0002-4816-0973

DOI:

https://doi.org/10.5585/remark.v21i5.23454

Keywords:

Structured Literature Review; Journals; Articles. Selection criteria

Abstract

Objective: This paper presents a methodological protocol for the selection of bibliographic material for the elaboration of a Structured Literature Review (SLR), a useful resource in most scientific research projects.

Method: This is a theoretical essay based on a critical review of the authors on the process of choosing the materials to be used for conducting a SLR.

Originality: A structured and careful way of selecting support material for a SLR is proposed.

Relevance: We address the importance of the literature review and the types of this resource, with emphasis on the SLR. We then designed the protocol around the questions answered by SLR, the criteria for journal selection, the choice of article selection mechanism, article impact ratings, journal ranking lists, citations by year, and the selection of most cited articles. We exemplify the guidelines of the protocol to propose a non-subjective or random way to choose the materials of a SLR.

Downloads

Download data is not yet available.

Author Biographies

George Bedinelli Rossi, Escola de Artes, Ciências e Humanidades da Universidade de São Paulo (EACH/USP)

Doutorado em Administração de Empresas

Julio Carneiro da Cunha, Universidade Nove de Julho (Uninove)

Doutorado em Administração

André Torres Urdan, Universidade Nove de Julho (Uninove)

Doutorado em Administração

References

Abt, H.A. (2000), “Do important papers produce high citation counts?”, Scientometrics, Vol. 48 No. 1, pp. 65-70.

Alvesson, M. and Deetz, S. (2000), Doing Critical Management Research, Sage, London.

Arksey, H., and O’Malley, L. (2005). “Scoping Studies: Towards a Methodological Framework.” International Journal of Social Research Methodology 8 (1):19–32.

Banks, M. G. (2006). An extension of the Hirsch index: Indexing scientific topics and compounds. Scientometrics, 69(1), 161-168.

Bazrafshan, A., Haghdoost, A.A. and Zare, M. (2015), “A comparison of downloads, readership and citations data for the Journal of Medical Hypotheses and Ideas”, Journal of Medical Hypotheses and Ideas, Vol. 9 No. 1, pp. 1-4.

Bontis, N., & Serenko, A. (2009). A follow‐up ranking of academic journals. Journal of Knowledge Management, 13(1), p. 16-26.

Boote, D. N., & Beile, P. (2005). Scholars before researchers: On the centrality of the dissertation literature review in research preparation. Educational researcher, 34(6), 3-15.

Bornmann, L., Leydesdorff, L., & Wang, J. (2013). Which percentile-based approach should be preferred for calculating normalized citation impact values? An empirical comparison of five approaches including a newly developed citation-rank approach (P100). Journal of informetrics, 7(4), 933-944.

Bouabid, H. and Larivière, V. (2013), “The lengthening of papers’ life expectancy: a diachronous analysis”, Scientometrics, Vol. 97 No. 3, pp. 695-717.

Chang, C. L., & McAleer, M. (2012). Citations and impact of ISI tourism and hospitality journals. Tourism Management Perspectives, 1, 2-8.

Cole, J.R. and Cole, S. (1971), “Measuring the quality of sociological research: problems in the use of the ‘Science Citation Index’”, The American Sociologist, Vol. 6 No. 1, pp. 23-29.

Cooper, R. B., Blair, D., & Pao, M. (1993). Communicating MIS research: A citation study of journal influence. Information Processing & Management, 29(1), 113-127.

Denyer, D., and Tranfield, D. (2006), “Using qualitative research synthesis to build an actionable knowledge base”, Management Decision, Vol. 44 No. 2, pp. 213-227.

Ding, Y., Yan, E., Frazho, A., & Caverlee, J. (2009). PageRank for ranking authors in co‐citation networks. Journal of the American Society for Information Science and Technology, 60(11), 2229-2243.

Dixon-Woods, M. (2011). Using framework-based synthesis for conducting reviews of qualitative studies. BMC medicine, 9(1), 1-2.

Dumay, J. (2014b), “15 years of the journal of intellectual capital and counting: a manifesto for transformational IC research”, Journal of Intellectual Capital, Vol. 15 No. 1, pp. 2-37.

Dumay, J., Bernardi, C., Guthrie, J., & Demartini, P. (2016, September). Integrated reporting: A structured literature review. In Accounting forum (Vol. 40, No. 3, pp. 166-185).

Egghe, L. (2006), ‘‘Theory and practise of the g-index’’, Scientometrics, Vol. 69 No. 1, pp. 131-52.

Egghe, L. (1992), “Citation age data and the obsolescence function: fits and explanations”, Information Processing & Management, Vol. 28 No. 2, pp. 201-217.

Egghe, L. (2010), “The distribution of the uncitedness factor and its functional relation with the impact factor”, Scientometrics, Vol. 83 No. 3, pp. 689-695.

Franke, R. H., Edlund, T. W., & Oster III, F. (1990). The development of strategic management: Journal quality and article impact. Strategic Management Journal, 11(3), 243-253.

Gall, M. D., Borg, W. R., & Gall, J. P. (1996). Education research: An introduction (6th ed.). White Plains, NY: Longman.

Garfield, E. (1989), “Citation classics and citation behavior revisited”, Current Contents, Vol. 12 No. 5, pp. 3-8.

Garfield, E., & Merton, R. K. (1979). Citation indexing: Its theory and application in science, technology, and humanities (Vol. 8). New York: Wiley.

Gursoy, D., & Sandstrom, J. K. (2016). An updated ranking of hospitality and tourism journals. Journal of Hospitality & Tourism Research, 40(1), 3-18.

Guthrie, J., Ricceri, F. and Dumay, J. (2012), “Reflections and projections: a decade of intellectual capital accounting research”, The British Accounting Review, Vol. 44 No. 2, pp. 68-82.

Halevi, G., Moed, H., & Bar-Ilan, J. (2017). Suitability of Google Scholar as a source of scientific information and as a source of data for scientific evaluation—Review of the literature. Journal of informetrics, 11(3), 823-834.

Harzing, A. W., & Alakangas, S. (2016). Google Scholar, Scopus and the Web of Science: a longitudinal and cross-disciplinary Comparison. Scientometrics, 106(2), 787-804.

Harzing, A. W., & Van der Wal, R. (2009). A Google Scholar h‐index for journals: An alternative metric to measure journal impact in economics and business. Journal of the American Society for Information Science and technology, 60(1), 41-46.

Hart, C. (1998). Hart, Chris, Doing a Literature Review: Releasing the Social Science Research Imagination. London: Sage, 1998.

Hicks, D., Wouters, P., Waltman, L., De Rijcke, S., & Rafols, I. (2015). Bibliometrics: the Leiden Manifesto for research metrics. Nature News, 520(7548), 429.

Hirsch, J. E. (2005). An index to quantify an individual's scientific research output. Proceedings of the National academy of Sciences, 102(46), 16569-16572.

Ioannidis, J. P., Baas, J., Klavans, R., & Boyack, K. W. (2019). A standardized citation metrics author database annotated for scientific field. PLoS biology, 17(8), e3000384.

Knopf, J. W. (2006). Doing a literature review. PS: Political Science & Politics, 39(1), 127-132.

Kousha, K. and Thelwall, M. (2007), ‘‘Google Scholar citations and Google Web/URL

citations: a multi-discipline exploratory analysis’’, Journal of the American Society for Information Science and Technology, Vol. 58 No. 7, pp. 1055-65.

Kurtz, M.J., Eichhorn, G., Accomazzi, A., Grant, C., Demleitner, M., Murray, S.S., Martimbeau, N. and Elwell, B. (2005), “The bibliometric properties of article readership information”, Journal of the American Society for Information Science and Technology, Vol. 56 No. 2, pp. 111-128.

Lather, P. (1999). To be of use: The work of reviewing. Review of Educational Research, 69(1), 2–7.

Leblebici, H. (1996). The act of reviewing and being a reviewer. Rhythms of academic life: Personal accounts of careers in academia, 269-274.

Light, R.J. and Pillemer, D.B. (1984), Summing Up, Harvard University Press, Boston, MA. Liang, L. (2006). h-index sequence and h-index matrix: Constructions and applications. Scientometrics, 69(1), 153-159.

Lowry, P.B., Humphreys, S., Malwitz, J. & Nix, J. (2007), ‘‘A scientometric study of the perceived quality of business and technical communication journals’’, IEEE Transactions of Professional Communication, Vol. 50 No. 4, pp. 352-78.

Lowry, P.B., Romans, D., & Curtis, A. (2004), ‘‘Global journal prestige and supporting disciplines: a scientometric study of information systems journals’’, Journal of the Association for Information Systems, Vol. 5 No. 2, pp. 29-77.

McAllister, P.R., Anderson, R.C. and Narin, F. (1980), “Comparison of peer and citation assessment of the influence of scientific journals”, Journal of the American Society for Information Science, Vol. 31 No. 3, pp. 147-152.

Martín-Martín, A., Costas, R., van Leeuwen, T., & López-Cózar, E. D. (2018). Evidence of open access of scientific publications in Google Scholar: A large-scale analysis. Journal of Informetrics, 12(3), 819-841.

Massaro, M., Dumay, J., & Garlatti, A. (2015). Public sector knowledge management: a structured literature review. Journal of Knowledge Management, 19(3), p. 530-558

Massaro, M., Dumay, J., & Guthrie, J. (2016). On the shoulders of giants: undertaking a structured literature review in accounting. Accounting, Auditing and Accountability Journal, 29(5), 767–801. https://doi.org/10.1108/AAAJ-01-2015-1939

Meho, L.I. (2007), ‘‘The rise and rise of citation analysis’’, Physics World, Vol. 20 No. 1, pp. 32-6.

Mohammadi, E. and Thelwall, M. (2013), “Assessing non-standard article impact using F1000 labels”, Scientometrics, Vol. 97 No. 2, pp. 383-395.

Mohammadi, E., Thelwall, M., Haustein, S. and Larivière, V. (2015), “Who reads research articles? An altmetrics analysis of Mendeley user categories”, Journal of the Association for Information Science and Technology.

Nowick, E. (2008). Academic rank of authors publishing in open access journals. Faculty Publications, UNL Libraries, 180.

Ohba, N. and Nakao, K. (2012), “Sleeping beauties in ophthalmology”, Scientometrics, Vol. 93 No. 2, pp. 253-264.

Okoli, C., & Schabram, K. (2010). Working Papers on Information Systems A Guide to Conducting a Systematic Literature Review of Information Systems Research A Guide to Conducting a Systematic Literature Review of Information Systems Research.

Oltheten, E., Theoharakis, V. and Travlos, N. G. (2005), "Faculty perceptions and readership patterns of finance journals: A global view", Journal of Financial & Quantitative Analysis, Vol. 40 No. 1, pp. 223-239.

Petticrew, M. and Roberts, H. (2008), Systematic Reviews in the Social Sciences: A Practical Guide, Kindle ed., Wiley-Blackwell, Oxford.

Randolph, J. (2009). A guide to writing the dissertation literature review. Practical Assessment, Research, and Evaluation, 14(1), 13.

Rinia, E.J., van Leeuwen, T.N., van Vuren, H.G. and van Raan, A.F. (1998), “Comparative analysis of a set of bibliometric indicators and central peer review criteria: evaluation of condensed matter physics in the Netherlands”, Research Policy, Vol. 27 No. 1, pp. 95-107.

Saad, G. (2006). Exploring the h-index at the author and journal levels using bibliometric data of productive consumer scholars and business-related journals respectively. Scientometrics, 69(1), 117-120.

Saresberiensis, J. (1955), The Metalogicon of John of Salisbury, University of California Press, Los Angeles, CA.

Serenko, A., & Bontis, N. (2009). Global ranking of knowledge management and intellectual capital academic journals. Journal of Knowledge Management, 13(1), p. 1-23.

Serenko, A., & Bontis, N. (2013a). Global ranking of knowledge management and intellectual capital academic journals: 2013 update. Journal of Knowledge Management, Vol (17), n.2, pp. 307-326.

Serenko, A., Bontis, N., Booker, L., Sadeddin, K., & Hardie, T. (2010). A scientometric analysis of knowledge management and intellectual capital academic literature (1994‐2008). Journal of knowledge management, v. 14, n. 1, pp. 3-23.

Serenko, A. & Dumay, J. (2015a), “Citation classics published in knowledge management journals. Part I: articles and their characteristics”, Journal of Knowledge Management, Vol. 19 No. 2, pp. 401-431.

Serenko, A., & Dumay, J. (2015b). Citation classics published in Knowledge Management journals. Part II: studying research trends and discovering the Google Scholar Effect. Journal of Knowledge Management, V. 19, n. 5, pp. 1335-1355.

Serenko, A. (2021). A structured literature review of scientometric research of the knowledge management discipline: a 2021 update. Journal of Knowledge Management. Vol. ahead-of-print No. ahead-of-print.

Serenko, A., & Bontis, N. (2013a). Global ranking of knowledge management and intellectual capital academic journals: 2013 update. Journal of Knowledge Management, Vol (17), n.2, pp. 307-326.

Shulman, L. S. (1999). Professing educational scholarship. In E. C. Lagemann & L. S. Shulman (Eds.), Issues in education research: Problems and possibilities (pp.159–165). San Francisco: Jossey-Bass.

Silva, B. F. D., Diniz, J., & Bortoluzzi, M. A. (2009). Minicurso de estatística básica: introdução ao software R. Santa Maria: Universidade Federal de Santa Maria.

Strike, K., and Posner, G. (1983). Types of synthesis and their criteria. In S. Ward and L. Reed (Eds.), Knowledge structure and use: Implications for synthesis and interpretation, (pp. 343-362. Philadelphia: Temple University Press.

Tahai, A. and Meyer, M.J. (1999), ‘‘A revealed preference study of management journals’ direct influences’’, Strategic Management Journal, Vol. 20 No. 3, pp. 279-96.

Tranfield, D., Denyer, D., & Smart, P. (2003). Towards a methodology for developing evidence‐informed management knowledge by means of systematic review. British journal of management, 14(3), 207-222.

Tukey JW. Box-and-Whisker Plots. In: Exploratory Data Analysis. Reading, MA: Addison-Wesley; 1977. p. 39-43.

Van Raan, A.F. (2006), “Comparison of the Hirsch-index with standard bibliometric indicators and with peer judgment for 147 chemistry research groups”, Scientometrics, Vol. 67 No. 3, pp. 491-502.

vom Brocke, J., Schmid, A. M., Simons, A., & Safrudin, N. (2020). IT-enabled organizational transformation: a structured literature review. Business Process Management Journal, 1-26.

Walstrom, K. A., & Leonard, L. N. (2000). Citation classics from the information systems literature. Information & Management, 38(2), 59-72.