A network is a set of nodes connected via edges,with possibly directions and weights on the edges.Sometimes,in a multi-layer network,the nodes can also be heterogeneous.In this perspective,based on previous studies,we...A network is a set of nodes connected via edges,with possibly directions and weights on the edges.Sometimes,in a multi-layer network,the nodes can also be heterogeneous.In this perspective,based on previous studies,we argue that networks can be regarded as the infrastructure of scientometrics in the sense that networks can be used to represent scientometric data.Then the task of answering various scientometric questions related to this data becomes an algorithmic problem in the corresponding network.展开更多
Purpose: The aim of this article is to explore up to seven parameters related to the methodological quality and reproducibility of thematic bibliometric research published in the two most productive journals in biblio...Purpose: The aim of this article is to explore up to seven parameters related to the methodological quality and reproducibility of thematic bibliometric research published in the two most productive journals in bibliometrics, Sustainability(a journal outside the discipline) and Scientometrics, the flagship journal in the field.Design/methodology/approach: The study identifies the need for developing tailored tools for improving the quality of thematic bibliometric analyses, and presents a framework that can guide the development of such tools. A total of 508 papers are analysed, 77% of Sustainability, and 23% published in Scientometrics, for the 2019-2021 period.Findings: An average of 2.6 shortcomings per paper was found for the whole sample, with an almost identical number of flaws in both journals. Sustainability has more flaws than Scientometrics in four of the seven parameters studied, while Scientometrics has more shortcomings in the remaining three variables.Research limitations: The first limitation of this work is that it is a study of two scientific journals, so the results cannot be directly extrapolated to the set of thematic bibliometric analyses published in journals from all fields.Practical implications: We propose the adoption of protocols, guidelines, and other similar tools, adapted to bibliometric practice, which could increase the thoroughness, transparency, and reproducibility of this type of research.Originality/value: These results show considerable room for improvement in terms of the adequate use and breakdown of methodological procedures in thematic bibliometric research, both in journals in the Information Science area and journals outside the discipline.展开更多
Call for PapersThe Organizing Committee would like to invite participants to submit to the 16th International Society of Scientometrics and Informetrics Conference that will be held in Wuhan, China （http：//www.issi2...Call for PapersThe Organizing Committee would like to invite participants to submit to the 16th International Society of Scientometrics and Informetrics Conference that will be held in Wuhan, China （http：//www.issi2017.org）. The ISSI 2017 Conference will provide an international forum for scientists, research managers and administrators, as well as information and communication related professionals to share research and debate the advancements of informetric and scientometric theory and applica- tions. The conference is organized under the auspices of ISSI - the International Society for Informetrics and Scientometrics （http：//www.issi-society.org/）. Paper submission： https：//easychair.org/conferences/？conf=issi2017.展开更多
Purpose:To analyze the diversity of citation distributions to publications in different research topics to investigate the accuracy of size-independent,rank-based indicators.The top percentile-based indicators are the...Purpose:To analyze the diversity of citation distributions to publications in different research topics to investigate the accuracy of size-independent,rank-based indicators.The top percentile-based indicators are the most common indicators of this type,and the evaluations of Japan are the most evident misjudgments.Design/methodology/approach:The distributions of citations to publications from countries and journals in several research topics were analyzed along with the corresponding global publications using histograms with logarithmic binning,double rank plots,and normal probability plots of log-transformed numbers of citations.Findings:Size-independent,top percentile-based indicators are accurate when the global ranks of local publications fit a power law,but deviations in the least cited papers are frequent in countries and occur in all journals with high impact factors.In these cases,a single indicator is misleading.Comparisons of the proportions of uncited papers are the best way to predict these deviations.Research limitations:This study is fundamentally analytical,and its results describe mathematical facts that are self-evident.Practical implications:Respectable institutions,such as the OECD,the European Commission,and the U.S.National Science Board,produce research country rankings and individual evaluations using size-independent percentile indicators that are misleading in many countries.These misleading evaluations should be discontinued because they can cause confusion among research policymakers and lead to incorrect research policies.Originality/value:Studies linking the lower tail of citation distribution,including uncited papers,to percentile research indicators have not been performed previously.The present results demonstrate that studies of this type are necessary to find reliable procedures for research assessments.展开更多
Purpose:This paper reports on a scientometric analysis bolstered by human-in-the-loop,domain experts,to examine the field of metal-organic frameworks(MOFs)research.Scientometric analyses reveal the intellectual landsc...Purpose:This paper reports on a scientometric analysis bolstered by human-in-the-loop,domain experts,to examine the field of metal-organic frameworks(MOFs)research.Scientometric analyses reveal the intellectual landscape of a field.The study engaged MOF scientists in the design and review of our research workflow.MOF materials are an essential component in next-generation renewable energy storage and biomedical technologies.The research approach demonstrates how engaging experts,via human-in-the-loop processes,can help develop a comprehensive view of a field’s research trends,influential works,and specialized topics.Design/methodology/approach:Ascientometric analysis was conducted,integrating natural language processing(NLP),topic modeling,and network analysis methods.The analytical approach was enhanced through a human-in-the-loop iterative process involving MOF research scientists at selected intervals.MOF researcher feedback was incorporated into our method.The data sample included 65,209 MOF research articles.Python3 and software tool VOSviewer were used to perform the analysis.Findings:The findings demonstrate the value of including domain experts in research workflows,refinement,and interpretation of results.At each stage of the analysis,the MOF researchers contributed to interpreting the results and method refinements targeting our focus Research evolution of metal organic frameworks:A scientometric approach with human-in-the-loop on MOF research.This study identified influential works and their themes.Our findings also underscore four main MOF research directions and applications.Research limitations:This study is limited by the sample(articles identified and referenced by the Cambridge Structural Database)that informed our analysis.Practical implications:Our findings contribute to addressing the current gap in fully mapping out the comprehensive landscape of MOF research.Additionally,the results will help domain scientists target future research directions.Originality/value:To the best of our knowledge,the number of publications collected for analysis exceeds those of previous studies.This enabled us to explore a more extensive body of MOF research compared to previous studies.Another contribution of our work is the iterative engagement of domain scientists,who brought in-depth,expert interpretation to the data analysis,helping hone the study.展开更多
Purpose： The purpose of this study is to modernize previous work on science overlay maps by updating the underlying citation matrix, generating new clusters of scientific disciplines, enhancing visualizations, and pr...Purpose： The purpose of this study is to modernize previous work on science overlay maps by updating the underlying citation matrix, generating new clusters of scientific disciplines, enhancing visualizations, and providing more accessible means for analysts to generate their own maps Design/methodology/approach： We use the combined set of 2015 Journal Citation Reports for the Science Citation Index （n of journals = 8,778） and the Social Sciences Citation Index （n = 3,212） for a total of 11,365 journals. The set of Web of Science Categories in the Science Citation Index and the Social Sciences Citation Index increased from 224 in 2010 to 227 in 2015. Using dedicated software, a matrix of 227 × 227 cells is generated on the basis of whole-number citation counting. We normalize this matrix using the cosine function. We first develop the citing-side, cosine-normalized map using 2015 data and VOSviewer visualization with default parameter values. A routine for making overlays on the basis of the map （＂wc 15.exe＂） is available at http：//www.leydesdorff.net/wc 15/index.htm. Findings： Findings appear in the form of visuals throughout the manuscript. In Figures 1 9 we provide basemaps of science and science overlay maps for a number of companies, universities, and technologies. Research limitations： As Web of Science Categories change and/or are updated so is the need to update the routine we provide. Also, to apply the routine we provide users need access to the Web of Science. Practical implications： Visualization of science overlay maps is now more accurate and true to the 2015 Journal Citation Reports than was the case with the previous version of the routine advanced in our paper.Originality/value： The routine we advance allows users to visualize science overlay maps in VOSviewer using data from more recent Journal Citation Reports.展开更多
Purpose: The goal of this study is to explore whether deep learning based embed ded models can provide a better visualization solution for large citation networks. De sign/methodology/approach: Our team compared the v...Purpose: The goal of this study is to explore whether deep learning based embed ded models can provide a better visualization solution for large citation networks. De sign/methodology/approach: Our team compared the visualization approach borrowed from the deep learning community with the well-known bibliometric network visualization for large scale data. 47,294 highly cited papers were visualized by using three network embedding models plus the t-SNE dimensionality reduction technique. Besides, three base maps were created with the same dataset for evaluation purposes. All base maps used the classic Open Ord method with different edge cutting strategies and parameters. Findings: The network embedded maps with t-SNE preserve a very similar global structure to the full edges classic force-directed map, while the maps vary in local structure. Among them, the Node2Vec model has the best overall visualization performance, the local structure has been significantly improved and the maps' layout has very high stability.Research limitations: The computational and time costs of training are very high for network em bedded models to obtain high dimensional latent vector. Only one dimensionality reduction technique was tested. Practical implications: This paper demonstrates that the network embedding models are able to accurately reconstruct the large bibliometric network in the vector space. In the future, apart from network visualization, many classical vector-based machine learning algorithms can be applied to network representations for solving bibliomet ric analysis tasks. Originality/value: This paper provides the first systematic comparison of classical science mapping visualization with network embedding based visualization on a large scale dataset. We showed deep learning based network embedding model with t-SNE can provide a richer,more stable science map. We also designed a practical evaluation method to investigate and compare maps.展开更多
Purpose:Digital literacy and related fields have received interests from scholars and practitioners for more than 20 years;nonetheless,academic communities need to systematically review how the fields have developed.T...Purpose:Digital literacy and related fields have received interests from scholars and practitioners for more than 20 years;nonetheless,academic communities need to systematically review how the fields have developed.This study aims to investigate the research trends of digital literacy and related concepts since the year of 2000,especially in education.Design/methodology/approach:The current study analyzes keywords,co-authorship,and cited publications in digital literacy through the scientometric method.The journal articles have been retrieved from the WoS(Web of Science)using four keywords:"Digital literacy,""ICT literacy,""information literacy,"and"media literacy."Further,keywords,publications,and co-authorship are examined and further classified into clusters for more in-depth investigation.Findings:Digital literacy is a multidisciplinary field that widely embraces literacy,ICT,the Internet,computer skill proficiency,science,nursing,health,and language education.The participants,or study subjects,in digital literacy research range from primary students to professionals,and the co-authorship clusters are distinctive by countries in America and Europe.Research limitations:This paper analyzes one fixed chunk of a dataset obtained by searching for all four keywords at once.Further studies will retrieve the data from diverse disciplines and will trace the change of the leading research themes by time spans.Practical implications:To shed light on the findings,using customized digital literacy curriculums and technology is critical for learners at different ages to nurture digital literacy according to their learning aims.They need to cultivate their understanding of the social impact of exploiting technology and computational thinking.To increase the originality of digital literacy-related studies,researchers from different countries and cultures may collaborate to investigate a broader range of digital literacy environments.Originality/value:The present study reviews research trends in digital literacy and related areas by performing a scientometric study to analyze multidimensional aspects in the fields,including keywords,journal titles,co-authorship,and cited publications.展开更多
Purpose： This paper presents findings of a quasi-experimental assessment to gauge the research productivity and degree of interdisciplinarity of research center outputs. Of special interest, we share an enriched visu...Purpose： This paper presents findings of a quasi-experimental assessment to gauge the research productivity and degree of interdisciplinarity of research center outputs. Of special interest, we share an enriched visualization of research co-authoring patterns. Design/methodology/approach： We compile publications by 45 researchers in each of 1） the iUTAH project, which we consider here to be analogous to a ＂research center,＂ 2） CG1-a comparison group of participants in two other Utah environmental research centers, and 3） CG2--a comparison group of Utah university environmental researchers not associated with a research center. We draw bibliometric data from Web of Science and from Google Scholar. We gather publications for a period before iUTAH had been established （2010-2012） and a period after （2014-2016）. We compare these research outputs in terms of publications and citations thereto. We also measure interdisciplinarity using Integration scoring and generate science overlay maps to locate the research publications across disciplines. Findings： We find that participation in the iUTAH project appears to increase research outputs （publications in the After period） and increase research citation rates relative to the comparison group researchers （although CG 1 research remains most cited, as it was in the Before period）. Most notably, participation in iUTAH markedly increases co-authoring among researchers--in general; and for junior, as well as senior, faculty; for men and women： across organizations; and across disciplines. Research limitations： The quasi-experimental design necessarily generates suggestive, not definitively causal, findings because of the imperfect controls. Practical implications： This study demonstrates a viable approach for research assessment of a center or program for which random assignment of control groups is not possible. It illustrates use of bibliometric indicators to inform R＆D program management. Originality/value： New visualizations of researcher collaboration provide compelling comparisons of the extent and nature of social networking among target cohorts.展开更多
Purpose:Recently,a vast number of scientific publications have been produced in cities in emerging countries.It has long been observed that the publication output of Beijing has exceeded that of any other city in the ...Purpose:Recently,a vast number of scientific publications have been produced in cities in emerging countries.It has long been observed that the publication output of Beijing has exceeded that of any other city in the world,including such leading centres of science as Boston,New York,London,Paris,and Tokyo.Researchers have suggested that,instead of focusing on cities'total publication output,the quality of the output in terms of the number of highly cited papers should be examined.However,in the period from 2014 to 2016,Beijing produced as many highly cited papers as Boston,London,or New York.In this paper,another method is proposed to measure cities'publishing performance by focusing on cities'publishing efficiency(i.e.,the ratio of highly cited articles to all articles produced in that city).Design/methodology/approach:First,554 cities are ranked based on their publishing efficiency,then some general factors influencing cities'publishing efficiency are revealed.The general factors examined in this paper are as follows:the linguistic environment of cities,cities'economic development level,the location of excellent organisations,cities'international collaboration patterns,and their scientific field profile.Furthermore,the paper examines the fundamental differences between the general factors influencing the publishing efficiency of the top 100 most efficient cities and the bottom 100 least efficient cities.Findings:Based on the research results,the conclusion can be drawn that a city's publishing efficiency will be high if meets the following general conditions:it is in a country in the Anglosphere-Core;it is in a high-income country;it is home to top-ranked universities and/or world-renowned research institutions;researchers affiliated with that city most intensely collaborate with researchers affiliated with cities in the United States,Germany,England,France,Canada,Australia,and Italy;and the most productive scientific disciplines of highly cited articles are published in high-impact multidisciplinary journals,disciplines in health sciences(especially general internal medicine and oncology),and disciplines in natural sciences(especially physics,astronomy,and astrophysics).Research limitations:It is always problematic to demarcate the boundaries of cities(e.g.,New York City vs.Greater New York),and regarding this issue there is no consensus among researchers.The Web of Science presents the name of cities in the addresses reported by theauthors of publications.In this paper cities correspond to the spatial units between the country/state level and the institution level as indicated in the Web of Science.Furthermore,it is necessary to highlight that the Web of Science is biased towards English-language journals and journals published in the field of biomedicine.These facts may influence the outcome of the research.Practical implications:Publishing efficiency,as an indicator,shows how successful a city is at the production of science.Naturally,cities have limited opportunities to compete for components of the science establishment(e.g.,universities,hospitals).However,cities can compete to attract innovation-oriented companies,high tech firms,and R&D facilities of multinational companies by for example establishing science parks.The positive effect of this process on the city's performance in science can be observed in the example of Beijing,which publishing efficiency has been increased rapidly.Originality/value:Previous scientometric studies have examined cities'publication output in terms of the number of papers,or the number of highly cited papers,which are largely size dependent indicators;however this paper attempts to present a more quality-based approach.展开更多
Purpose: This study aims to classify research impact indicators based on their characteristics and scope. A concept of evidence-based nomenclature of research impact(RI) indicator has been introduced for generalizatio...Purpose: This study aims to classify research impact indicators based on their characteristics and scope. A concept of evidence-based nomenclature of research impact(RI) indicator has been introduced for generalization and transformation of scope. Design/methodology/approch: Literature was collected related to the research impact assessment. It was categorized in conceptual and applied case studies. One hundred and nineteen indicators were selected to prepare classification and nomenclature. The nomenclature was developed based on the principle—"every indicator is a contextual-function to explain the impact". Every indicator was disintegrated into three parts, i.e. Function, Domain, and Target Areas.Findings: The main functions of research impact indicators express improvement(63%), recognition(23%), and creation/development(14%). The focus of research impact indicators in literature is more towards the academic domain(59%) whereas the environment/sustainability domain is least considered(4%). As a result, research impact related to the research aspects is felt the most(29%). Other target areas include system and services, methods and procedures, networking, planning, policy development, economic aspects and commercialisation, etc. Research limitations: This research applied to 119 research impact indicators. However, the inclusion of additional indicators may change the result. Practical implications: The plausible effect of nomenclature is a better organization of indicators with appropriate tags of functions, domains, and target areas. This approach also provides a framework of indicator generalization and transformation. Therefore, similar indicators can be applied in other fields and target areas with modifications. Originality/value: The development of nomenclature for research impact indicators is a novel approach in scientometrics. It is developed on the same line as presented in other scientific disciplines, where fundamental objects need to classify on common standards such as biology and chemistry.展开更多
Scientometrics is an emerging academic field for the exploration of the structure of science through journal citation relations. However, this article aims to study those subject-relevant journals' contents rather...Scientometrics is an emerging academic field for the exploration of the structure of science through journal citation relations. However, this article aims to study those subject-relevant journals' contents rather than studying their citations contained therein with the purpose of discovering a given disciplinary structure of science such as mechanics in our case. Based on the title wordings of 68,075 articles published in 66 mechanics journals,and using such research tools as the word frequency analysis, multidimensional scaling analysis and factor analysis, this article analyzes similarity and distinctions of those journals' contents in the subject field of mechanics. We first convert complex internal relations of these mechanics journals into a small number amount of independent indicators.The group of selected mechanics journals is then classified by a cluster analysis. This article demonstrates that the relations of the research contents of mechanics can be shown in an intuitively recognizable map, and we can have them analyzed from a perspective by taking into account about how those major branches of mechanics, such as solid mechanics,fluid mechanics, rational mechanics(including mathematical methods in mechanics), sound and vibration mechanics, computational mechanics, are related to the main thematic tenet of our study. It is hoped that such an approach, buttressed with this new perspective and approach, will enrich our means to explore the disciplinary structure of science and technology in general and mechanics in specific.展开更多
Purpose:Methods to tackle Covid-19 have been developed by a wave of biomedical research but the pandemic has also influenced many aspects of society,generating a need for research into its consequences,and potentially...Purpose:Methods to tackle Covid-19 have been developed by a wave of biomedical research but the pandemic has also influenced many aspects of society,generating a need for research into its consequences,and potentially changing the way existing topics are investigated.This article investigates the nature of this influence on the wider academic research mission.Design/methodology/approach:This article reports an inductive content analysis of 500 randomly selected journal articles mentioning Covid-19,as recorded by the Dimensions scholarly database on 19 March 2021.Covid-19 mentions were coded for the influence of the disease on the research.Findings:Whilst two thirds of these articles were about biomedicine(e.g.treatments,vaccines,virology),or health services in response to Covid-19,others covered the pandemic economy,society,safety,or education.In addition,some articles were not about the pandemic but stated that Covid-19 had increased or decreased the value of the reported research or changed the context in which it was conducted.Research limitations:The findings relate only to Covid-19 influences declared in published journal articles.Practical implications:Research managers and funders should consider whether their current procedures are effective in supporting researchers to address the evolving demands of pandemic societies,particularly in terms of timeliness.Originality/value:The results show that although health research dominates the academic response to Covid-19,it is more widely disrupting academic research with new demands and challenges.展开更多
In this opinion paper, we introduce the expressions of dominant terminology and dominant term in the quantitative studies of science in analogy to the notion of dominant design in product development and innovation.
Collaborative research causes problems for research assessments because of the difficulty in fairly crediting its authors.Whilst splitting the rewards for an article amongst its authors has the greatest surface-level ...Collaborative research causes problems for research assessments because of the difficulty in fairly crediting its authors.Whilst splitting the rewards for an article amongst its authors has the greatest surface-level fairness,many important evaluations assign full credit to each author,irrespective of team size.The underlying rationales for this are labour reduction and the need to incentivise collaborative work because it is necessary to solve many important societal problems.This article assesses whether full counting changes results compared to fractional counting in the case of the UK’s Research Excellence Framework(REF)2021.For this assessment,fractional counting reduces the number of journal articles to as little as 10%of the full counting value,depending on the Unit of Assessment(UoA).Despite this large difference,allocating an overall grade point average(GPA)based on full counting or fractional counting gives results with a median Pearson correlation within UoAs of 0.98.The largest changes are for Archaeology(r=0.84)and Physics(r=0.88).There is a weak tendency for higher scoring institutions to lose from fractional counting,with the loss being statistically significant in 5 of the 34 UoAs.Thus,whilst the apparent over-weighting of contributions to collaboratively authored outputs does not seem too problematic from a fairness perspective overall,it may be worth examining in the few UoAs in which it makes the most difference.展开更多
Purpose: This paper aims to point out the scientific development and research density of renewable energy sources such as photovoltaic, wind, and biomass, using a mix of computational tools. Based on this, it was poss...Purpose: This paper aims to point out the scientific development and research density of renewable energy sources such as photovoltaic, wind, and biomass, using a mix of computational tools. Based on this, it was possible to verify the existence of new research trends and opportunities in a macro view regarding management, performance evaluation, and decision-making in renewable energy generation systems and installations.Design/methodology/approach: A scientometric approach was used based on a research protocol to retrieve papers from the Scopus database, and through four scientometric questions, to analyze each area. Software such as the Science Mapping Analysis Software Tool(Sci MAT) and Sci2 Tool were used to map the science development and density.Findings: The scientific development of renewable energy areas is highlighted, pointing out research opportunities regarding management, studies on costs and investments, systemic diagnosis, and performance evaluation for decision-making in businesses in these areas.Research limitations: This paper was limited to the articles indexed in the Scopus database and by the questions used to analyze the scientific development of renewable energy areas.Practical implications: The results show the need for a managerial perspective in businesses related to renewable energy sources at the managerial, technical, and operational levels, including performance evaluation, assertive decision making, and adequate use of technical and financial resources.Originality/value: This paper shows that there is a research field to be explored, with gaps to fill and further research to be carried out in this area. Besides, this paper can serve as a basis for other studies and research in other areas and domains.展开更多
This is the second part of the Journal of Data and Information Science(JDIS)Special Issue on ISSI 2019,the 17thInternational Conference on Scientometrics and Informetrics(ISSI2019)held in Rome,on 2-5 September 2019 an...This is the second part of the Journal of Data and Information Science(JDIS)Special Issue on ISSI 2019,the 17thInternational Conference on Scientometrics and Informetrics(ISSI2019)held in Rome,on 2-5 September 2019 and includes additional 10 selected posters presented during the conference largely expanded by the authors afterwards.展开更多
文摘A network is a set of nodes connected via edges,with possibly directions and weights on the edges.Sometimes,in a multi-layer network,the nodes can also be heterogeneous.In this perspective,based on previous studies,we argue that networks can be regarded as the infrastructure of scientometrics in the sense that networks can be used to represent scientometric data.Then the task of answering various scientometric questions related to this data becomes an algorithmic problem in the corresponding network.
文摘Purpose: The aim of this article is to explore up to seven parameters related to the methodological quality and reproducibility of thematic bibliometric research published in the two most productive journals in bibliometrics, Sustainability(a journal outside the discipline) and Scientometrics, the flagship journal in the field.Design/methodology/approach: The study identifies the need for developing tailored tools for improving the quality of thematic bibliometric analyses, and presents a framework that can guide the development of such tools. A total of 508 papers are analysed, 77% of Sustainability, and 23% published in Scientometrics, for the 2019-2021 period.Findings: An average of 2.6 shortcomings per paper was found for the whole sample, with an almost identical number of flaws in both journals. Sustainability has more flaws than Scientometrics in four of the seven parameters studied, while Scientometrics has more shortcomings in the remaining three variables.Research limitations: The first limitation of this work is that it is a study of two scientific journals, so the results cannot be directly extrapolated to the set of thematic bibliometric analyses published in journals from all fields.Practical implications: We propose the adoption of protocols, guidelines, and other similar tools, adapted to bibliometric practice, which could increase the thoroughness, transparency, and reproducibility of this type of research.Originality/value: These results show considerable room for improvement in terms of the adequate use and breakdown of methodological procedures in thematic bibliometric research, both in journals in the Information Science area and journals outside the discipline.
文摘Call for PapersThe Organizing Committee would like to invite participants to submit to the 16th International Society of Scientometrics and Informetrics Conference that will be held in Wuhan, China （http：//www.issi2017.org）. The ISSI 2017 Conference will provide an international forum for scientists, research managers and administrators, as well as information and communication related professionals to share research and debate the advancements of informetric and scientometric theory and applica- tions. The conference is organized under the auspices of ISSI - the International Society for Informetrics and Scientometrics （http：//www.issi-society.org/）. Paper submission： https：//easychair.org/conferences/？conf=issi2017.
文摘Purpose:To analyze the diversity of citation distributions to publications in different research topics to investigate the accuracy of size-independent,rank-based indicators.The top percentile-based indicators are the most common indicators of this type,and the evaluations of Japan are the most evident misjudgments.Design/methodology/approach:The distributions of citations to publications from countries and journals in several research topics were analyzed along with the corresponding global publications using histograms with logarithmic binning,double rank plots,and normal probability plots of log-transformed numbers of citations.Findings:Size-independent,top percentile-based indicators are accurate when the global ranks of local publications fit a power law,but deviations in the least cited papers are frequent in countries and occur in all journals with high impact factors.In these cases,a single indicator is misleading.Comparisons of the proportions of uncited papers are the best way to predict these deviations.Research limitations:This study is fundamentally analytical,and its results describe mathematical facts that are self-evident.Practical implications:Respectable institutions,such as the OECD,the European Commission,and the U.S.National Science Board,produce research country rankings and individual evaluations using size-independent percentile indicators that are misleading in many countries.These misleading evaluations should be discontinued because they can cause confusion among research policymakers and lead to incorrect research policies.Originality/value:Studies linking the lower tail of citation distribution,including uncited papers,to percentile research indicators have not been performed previously.The present results demonstrate that studies of this type are necessary to find reliable procedures for research assessments.
文摘Purpose:This paper reports on a scientometric analysis bolstered by human-in-the-loop,domain experts,to examine the field of metal-organic frameworks(MOFs)research.Scientometric analyses reveal the intellectual landscape of a field.The study engaged MOF scientists in the design and review of our research workflow.MOF materials are an essential component in next-generation renewable energy storage and biomedical technologies.The research approach demonstrates how engaging experts,via human-in-the-loop processes,can help develop a comprehensive view of a field’s research trends,influential works,and specialized topics.Design/methodology/approach:Ascientometric analysis was conducted,integrating natural language processing(NLP),topic modeling,and network analysis methods.The analytical approach was enhanced through a human-in-the-loop iterative process involving MOF research scientists at selected intervals.MOF researcher feedback was incorporated into our method.The data sample included 65,209 MOF research articles.Python3 and software tool VOSviewer were used to perform the analysis.Findings:The findings demonstrate the value of including domain experts in research workflows,refinement,and interpretation of results.At each stage of the analysis,the MOF researchers contributed to interpreting the results and method refinements targeting our focus Research evolution of metal organic frameworks:A scientometric approach with human-in-the-loop on MOF research.This study identified influential works and their themes.Our findings also underscore four main MOF research directions and applications.Research limitations:This study is limited by the sample(articles identified and referenced by the Cambridge Structural Database)that informed our analysis.Practical implications:Our findings contribute to addressing the current gap in fully mapping out the comprehensive landscape of MOF research.Additionally,the results will help domain scientists target future research directions.Originality/value:To the best of our knowledge,the number of publications collected for analysis exceeds those of previous studies.This enabled us to explore a more extensive body of MOF research compared to previous studies.Another contribution of our work is the iterative engagement of domain scientists,who brought in-depth,expert interpretation to the data analysis,helping hone the study.
文摘Purpose： The purpose of this study is to modernize previous work on science overlay maps by updating the underlying citation matrix, generating new clusters of scientific disciplines, enhancing visualizations, and providing more accessible means for analysts to generate their own maps Design/methodology/approach： We use the combined set of 2015 Journal Citation Reports for the Science Citation Index （n of journals = 8,778） and the Social Sciences Citation Index （n = 3,212） for a total of 11,365 journals. The set of Web of Science Categories in the Science Citation Index and the Social Sciences Citation Index increased from 224 in 2010 to 227 in 2015. Using dedicated software, a matrix of 227 × 227 cells is generated on the basis of whole-number citation counting. We normalize this matrix using the cosine function. We first develop the citing-side, cosine-normalized map using 2015 data and VOSviewer visualization with default parameter values. A routine for making overlays on the basis of the map （＂wc 15.exe＂） is available at http：//www.leydesdorff.net/wc 15/index.htm. Findings： Findings appear in the form of visuals throughout the manuscript. In Figures 1 9 we provide basemaps of science and science overlay maps for a number of companies, universities, and technologies. Research limitations： As Web of Science Categories change and/or are updated so is the need to update the routine we provide. Also, to apply the routine we provide users need access to the Web of Science. Practical implications： Visualization of science overlay maps is now more accurate and true to the 2015 Journal Citation Reports than was the case with the previous version of the routine advanced in our paper.Originality/value： The routine we advance allows users to visualize science overlay maps in VOSviewer using data from more recent Journal Citation Reports.
基金funded by the strategic research project of the Development Planning Bureau of the Chinese Academy of Sciences under Grant No.GHJ-ZLZX-2019-42the Youth Fund Project of Institutes of Science and Development, Chinese Academy of Sciences under Grant name “Research on Key Methods in Comparison of Scientific Funding Layout”。
文摘Purpose: The goal of this study is to explore whether deep learning based embed ded models can provide a better visualization solution for large citation networks. De sign/methodology/approach: Our team compared the visualization approach borrowed from the deep learning community with the well-known bibliometric network visualization for large scale data. 47,294 highly cited papers were visualized by using three network embedding models plus the t-SNE dimensionality reduction technique. Besides, three base maps were created with the same dataset for evaluation purposes. All base maps used the classic Open Ord method with different edge cutting strategies and parameters. Findings: The network embedded maps with t-SNE preserve a very similar global structure to the full edges classic force-directed map, while the maps vary in local structure. Among them, the Node2Vec model has the best overall visualization performance, the local structure has been significantly improved and the maps' layout has very high stability.Research limitations: The computational and time costs of training are very high for network em bedded models to obtain high dimensional latent vector. Only one dimensionality reduction technique was tested. Practical implications: This paper demonstrates that the network embedding models are able to accurately reconstruct the large bibliometric network in the vector space. In the future, apart from network visualization, many classical vector-based machine learning algorithms can be applied to network representations for solving bibliomet ric analysis tasks. Originality/value: This paper provides the first systematic comparison of classical science mapping visualization with network embedding based visualization on a large scale dataset. We showed deep learning based network embedding model with t-SNE can provide a richer,more stable science map. We also designed a practical evaluation method to investigate and compare maps.
基金the Korea Education and Research Information Service(KERIS)。
文摘Purpose:Digital literacy and related fields have received interests from scholars and practitioners for more than 20 years;nonetheless,academic communities need to systematically review how the fields have developed.This study aims to investigate the research trends of digital literacy and related concepts since the year of 2000,especially in education.Design/methodology/approach:The current study analyzes keywords,co-authorship,and cited publications in digital literacy through the scientometric method.The journal articles have been retrieved from the WoS(Web of Science)using four keywords:"Digital literacy,""ICT literacy,""information literacy,"and"media literacy."Further,keywords,publications,and co-authorship are examined and further classified into clusters for more in-depth investigation.Findings:Digital literacy is a multidisciplinary field that widely embraces literacy,ICT,the Internet,computer skill proficiency,science,nursing,health,and language education.The participants,or study subjects,in digital literacy research range from primary students to professionals,and the co-authorship clusters are distinctive by countries in America and Europe.Research limitations:This paper analyzes one fixed chunk of a dataset obtained by searching for all four keywords at once.Further studies will retrieve the data from diverse disciplines and will trace the change of the leading research themes by time spans.Practical implications:To shed light on the findings,using customized digital literacy curriculums and technology is critical for learners at different ages to nurture digital literacy according to their learning aims.They need to cultivate their understanding of the social impact of exploiting technology and computational thinking.To increase the originality of digital literacy-related studies,researchers from different countries and cultures may collaborate to investigate a broader range of digital literacy environments.Originality/value:The present study reviews research trends in digital literacy and related areas by performing a scientometric study to analyze multidimensional aspects in the fields,including keywords,journal titles,co-authorship,and cited publications.
基金The five-year "innovative Urban Transitions and Aridregion Hydro-sustainability" (iUTAH) project was initiated in 2012 with support from the US National Science Foundation’s (NSF) "Established Program to Stimulate Competitive Research" (EPSCo R, award # OIA-1208732)
文摘Purpose： This paper presents findings of a quasi-experimental assessment to gauge the research productivity and degree of interdisciplinarity of research center outputs. Of special interest, we share an enriched visualization of research co-authoring patterns. Design/methodology/approach： We compile publications by 45 researchers in each of 1） the iUTAH project, which we consider here to be analogous to a ＂research center,＂ 2） CG1-a comparison group of participants in two other Utah environmental research centers, and 3） CG2--a comparison group of Utah university environmental researchers not associated with a research center. We draw bibliometric data from Web of Science and from Google Scholar. We gather publications for a period before iUTAH had been established （2010-2012） and a period after （2014-2016）. We compare these research outputs in terms of publications and citations thereto. We also measure interdisciplinarity using Integration scoring and generate science overlay maps to locate the research publications across disciplines. Findings： We find that participation in the iUTAH project appears to increase research outputs （publications in the After period） and increase research citation rates relative to the comparison group researchers （although CG 1 research remains most cited, as it was in the Before period）. Most notably, participation in iUTAH markedly increases co-authoring among researchers--in general; and for junior, as well as senior, faculty; for men and women： across organizations; and across disciplines. Research limitations： The quasi-experimental design necessarily generates suggestive, not definitively causal, findings because of the imperfect controls. Practical implications： This study demonstrates a viable approach for research assessment of a center or program for which random assignment of control groups is not possible. It illustrates use of bibliometric indicators to inform R＆D program management. Originality/value： New visualizations of researcher collaboration provide compelling comparisons of the extent and nature of social networking among target cohorts.
基金supported by the EFOP-3.6.1-16-2016-00022 projectproject is co-financed by the European Union and the European Social Fund
文摘Purpose:Recently,a vast number of scientific publications have been produced in cities in emerging countries.It has long been observed that the publication output of Beijing has exceeded that of any other city in the world,including such leading centres of science as Boston,New York,London,Paris,and Tokyo.Researchers have suggested that,instead of focusing on cities'total publication output,the quality of the output in terms of the number of highly cited papers should be examined.However,in the period from 2014 to 2016,Beijing produced as many highly cited papers as Boston,London,or New York.In this paper,another method is proposed to measure cities'publishing performance by focusing on cities'publishing efficiency(i.e.,the ratio of highly cited articles to all articles produced in that city).Design/methodology/approach:First,554 cities are ranked based on their publishing efficiency,then some general factors influencing cities'publishing efficiency are revealed.The general factors examined in this paper are as follows:the linguistic environment of cities,cities'economic development level,the location of excellent organisations,cities'international collaboration patterns,and their scientific field profile.Furthermore,the paper examines the fundamental differences between the general factors influencing the publishing efficiency of the top 100 most efficient cities and the bottom 100 least efficient cities.Findings:Based on the research results,the conclusion can be drawn that a city's publishing efficiency will be high if meets the following general conditions:it is in a country in the Anglosphere-Core;it is in a high-income country;it is home to top-ranked universities and/or world-renowned research institutions;researchers affiliated with that city most intensely collaborate with researchers affiliated with cities in the United States,Germany,England,France,Canada,Australia,and Italy;and the most productive scientific disciplines of highly cited articles are published in high-impact multidisciplinary journals,disciplines in health sciences(especially general internal medicine and oncology),and disciplines in natural sciences(especially physics,astronomy,and astrophysics).Research limitations:It is always problematic to demarcate the boundaries of cities(e.g.,New York City vs.Greater New York),and regarding this issue there is no consensus among researchers.The Web of Science presents the name of cities in the addresses reported by theauthors of publications.In this paper cities correspond to the spatial units between the country/state level and the institution level as indicated in the Web of Science.Furthermore,it is necessary to highlight that the Web of Science is biased towards English-language journals and journals published in the field of biomedicine.These facts may influence the outcome of the research.Practical implications:Publishing efficiency,as an indicator,shows how successful a city is at the production of science.Naturally,cities have limited opportunities to compete for components of the science establishment(e.g.,universities,hospitals).However,cities can compete to attract innovation-oriented companies,high tech firms,and R&D facilities of multinational companies by for example establishing science parks.The positive effect of this process on the city's performance in science can be observed in the example of Beijing,which publishing efficiency has been increased rapidly.Originality/value:Previous scientometric studies have examined cities'publication output in terms of the number of papers,or the number of highly cited papers,which are largely size dependent indicators;however this paper attempts to present a more quality-based approach.
文摘Purpose: This study aims to classify research impact indicators based on their characteristics and scope. A concept of evidence-based nomenclature of research impact(RI) indicator has been introduced for generalization and transformation of scope. Design/methodology/approch: Literature was collected related to the research impact assessment. It was categorized in conceptual and applied case studies. One hundred and nineteen indicators were selected to prepare classification and nomenclature. The nomenclature was developed based on the principle—"every indicator is a contextual-function to explain the impact". Every indicator was disintegrated into three parts, i.e. Function, Domain, and Target Areas.Findings: The main functions of research impact indicators express improvement(63%), recognition(23%), and creation/development(14%). The focus of research impact indicators in literature is more towards the academic domain(59%) whereas the environment/sustainability domain is least considered(4%). As a result, research impact related to the research aspects is felt the most(29%). Other target areas include system and services, methods and procedures, networking, planning, policy development, economic aspects and commercialisation, etc. Research limitations: This research applied to 119 research impact indicators. However, the inclusion of additional indicators may change the result. Practical implications: The plausible effect of nomenclature is a better organization of indicators with appropriate tags of functions, domains, and target areas. This approach also provides a framework of indicator generalization and transformation. Therefore, similar indicators can be applied in other fields and target areas with modifications. Originality/value: The development of nomenclature for research impact indicators is a novel approach in scientometrics. It is developed on the same line as presented in other scientific disciplines, where fundamental objects need to classify on common standards such as biology and chemistry.
基金supported by the National Science Foundation of China(Grant No.70673019)
文摘Scientometrics is an emerging academic field for the exploration of the structure of science through journal citation relations. However, this article aims to study those subject-relevant journals' contents rather than studying their citations contained therein with the purpose of discovering a given disciplinary structure of science such as mechanics in our case. Based on the title wordings of 68,075 articles published in 66 mechanics journals,and using such research tools as the word frequency analysis, multidimensional scaling analysis and factor analysis, this article analyzes similarity and distinctions of those journals' contents in the subject field of mechanics. We first convert complex internal relations of these mechanics journals into a small number amount of independent indicators.The group of selected mechanics journals is then classified by a cluster analysis. This article demonstrates that the relations of the research contents of mechanics can be shown in an intuitively recognizable map, and we can have them analyzed from a perspective by taking into account about how those major branches of mechanics, such as solid mechanics,fluid mechanics, rational mechanics(including mathematical methods in mechanics), sound and vibration mechanics, computational mechanics, are related to the main thematic tenet of our study. It is hoped that such an approach, buttressed with this new perspective and approach, will enrich our means to explore the disciplinary structure of science and technology in general and mechanics in specific.
文摘Purpose:Methods to tackle Covid-19 have been developed by a wave of biomedical research but the pandemic has also influenced many aspects of society,generating a need for research into its consequences,and potentially changing the way existing topics are investigated.This article investigates the nature of this influence on the wider academic research mission.Design/methodology/approach:This article reports an inductive content analysis of 500 randomly selected journal articles mentioning Covid-19,as recorded by the Dimensions scholarly database on 19 March 2021.Covid-19 mentions were coded for the influence of the disease on the research.Findings:Whilst two thirds of these articles were about biomedicine(e.g.treatments,vaccines,virology),or health services in response to Covid-19,others covered the pandemic economy,society,safety,or education.In addition,some articles were not about the pandemic but stated that Covid-19 had increased or decreased the value of the reported research or changed the context in which it was conducted.Research limitations:The findings relate only to Covid-19 influences declared in published journal articles.Practical implications:Research managers and funders should consider whether their current procedures are effective in supporting researchers to address the evolving demands of pandemic societies,particularly in terms of timeliness.Originality/value:The results show that although health research dominates the academic response to Covid-19,it is more widely disrupting academic research with new demands and challenges.
文摘In this opinion paper, we introduce the expressions of dominant terminology and dominant term in the quantitative studies of science in analogy to the notion of dominant design in product development and innovation.
基金This study was funded by Research England,Scottish Funding Council,Higher Education Funding Council for Wales,and Department for the Economy,Northern Ireland as part of the Future Research Assessment Programme(https://www.jisc.ac.uk/future-research-assessment-programme).
文摘Collaborative research causes problems for research assessments because of the difficulty in fairly crediting its authors.Whilst splitting the rewards for an article amongst its authors has the greatest surface-level fairness,many important evaluations assign full credit to each author,irrespective of team size.The underlying rationales for this are labour reduction and the need to incentivise collaborative work because it is necessary to solve many important societal problems.This article assesses whether full counting changes results compared to fractional counting in the case of the UK’s Research Excellence Framework(REF)2021.For this assessment,fractional counting reduces the number of journal articles to as little as 10%of the full counting value,depending on the Unit of Assessment(UoA).Despite this large difference,allocating an overall grade point average(GPA)based on full counting or fractional counting gives results with a median Pearson correlation within UoAs of 0.98.The largest changes are for Archaeology(r=0.84)and Physics(r=0.88).There is a weak tendency for higher scoring institutions to lose from fractional counting,with the loss being statistically significant in 5 of the 34 UoAs.Thus,whilst the apparent over-weighting of contributions to collaboratively authored outputs does not seem too problematic from a fairness perspective overall,it may be worth examining in the few UoAs in which it makes the most difference.
基金supported by the Conselho Nacional de Desenvolvimento Científico e Tecnológico (CNPq) [grant numbers 142448/2018-4, 308723/2017-1, 311926/2017-7 and 465640/2014-1]Coordenacao de Aperfeicoamento de Pessoal de Nível Superior (CAPES) [grant number 23038.000776/2017-54]+2 种基金Fundacao de Amparo a Pesquisa do Estado do Rio Grande do Sul (FAPERGS) [grant number 17/2551-0000517-1]supported by a post doc grant of CAPES – Brazil (CAPES process Baierle No. 88887.464876/2019-00)CNPq, CAPES, FAPERGS and Institutos Nacionais de Ciência e Tecnologia – Gera■o Distribuída (INCT-GD) for supporting。
文摘Purpose: This paper aims to point out the scientific development and research density of renewable energy sources such as photovoltaic, wind, and biomass, using a mix of computational tools. Based on this, it was possible to verify the existence of new research trends and opportunities in a macro view regarding management, performance evaluation, and decision-making in renewable energy generation systems and installations.Design/methodology/approach: A scientometric approach was used based on a research protocol to retrieve papers from the Scopus database, and through four scientometric questions, to analyze each area. Software such as the Science Mapping Analysis Software Tool(Sci MAT) and Sci2 Tool were used to map the science development and density.Findings: The scientific development of renewable energy areas is highlighted, pointing out research opportunities regarding management, studies on costs and investments, systemic diagnosis, and performance evaluation for decision-making in businesses in these areas.Research limitations: This paper was limited to the articles indexed in the Scopus database and by the questions used to analyze the scientific development of renewable energy areas.Practical implications: The results show the need for a managerial perspective in businesses related to renewable energy sources at the managerial, technical, and operational levels, including performance evaluation, assertive decision making, and adequate use of technical and financial resources.Originality/value: This paper shows that there is a research field to be explored, with gaps to fill and further research to be carried out in this area. Besides, this paper can serve as a basis for other studies and research in other areas and domains.
文摘This is the second part of the Journal of Data and Information Science(JDIS)Special Issue on ISSI 2019,the 17thInternational Conference on Scientometrics and Informetrics(ISSI2019)held in Rome,on 2-5 September 2019 and includes additional 10 selected posters presented during the conference largely expanded by the authors afterwards.
