Determinants of citation impact

Put together, formal parameters other than journal impact – such as the brevity of an article’s title – turned out to be stronger citation predictors.

Guest blog post by Jürgen Dengler

What makes a paper successful?” is something authors would like to know when submitting a manuscript and editors when deciding on the acceptance of papers. 

One answer is: “Write an exciting paper on a relevant topic with up-to-date methods”. 

While this is certainly true, most authors feel that this is not the whole truth. The enormous efforts some authors invest in getting their paper accepted in a “high-rank” journal reflect the belief that the publication venue influences the scientific impact of a paper. Other authors spend quite some time in finding a “fancy” title for their contribution.

But do such “formal” aspects actually influence the impact of articles and, if so, to which degree and which are the most relevant ones? 

Astonishingly, there is very little published evidence on these aspects. 

Thus, I conducted an empirical study using my own publication output over the years. With almost 200 papers in over 50 indexed journals, it already allows some generalisations. With the three IAVS journals, Journal of Vegetation Science, Applied Vegetation Science and Vegetation Classification and Survey, being among the preferred outlets, the journal portfolio is probably also quite similar to that of other IAVS members. 

As a common currency for citation impact, I used the Field-Weighted Citation Impact (FWCI), provided by the Scopus database. While the absolute number of citations is not suitable for a meaningful comparison between papers as the number of citations always increases with time since publication, FWCI standardised citations compared to all articles published in the same year in the same subject field and as the same article type (e.g. research article vs. review article). 

A FWCI of 1 means that an article is cited as much as the average, a FWCI of 2 refers to twice as many citations as an average article, etc. Scopus also provides a corresponding measure to FWCI at the journal level, namely the Source Normalized Impact per Paper (SNIP), which essentially is the mean of the FWCI values of all papers in that journal in the respective period.

According to the multiple regression analysis, journal impact (SNIP) was the strongest predictor of the article impact. 

However, alone it explained only 26.8% of the variance while other formal parameters together explained 31.5% of the variance. 

Among those, the brevity of the title was most influential. Each word less in the title led to 9% more citations. 

Further, both article length and author number had a positive influence on citations.

Publishing in a special feature increased the citation rate by 43%

By contrast, open access or formulating titles as questions or factual statements did not significantly influence citation rates.

In conclusion, selecting a high-impact journal has less influence on the article impact than many people believe – the citation impact of different articles in one journal typically varies more than the mean citation impact between different journals.

For authors, the easiest way to increase the impact of a given article is to shorten the title as much as possible. 

Caption: Variation of the Field-Weighted Citation Impact (FWCI) values of articles in journals represented by at least five articles in the analysed sample, with box height proportional to the number of included papers. All three IAVS journals were well represented. The variation of citation impact within individual journals was very large (note the log-scale of the x-axis). For example, the best cited articles of the author in JVS, AVS and VCS all had a considerably better citation performance than the single Nature paper co-authored by the author (FWCI = 3.70).

Associated journal article:

Dengler J (2024) Determinants of citation impact. Vegetation Classification and Survey 5: 169-177. https://doi.org/10.3897/VCS.126956.

***

Originally published on the Vegetation Science Blog: Official blog post of the IAVS journals.

***

You can follow the Vegetation Classification and Survey (VCS) journal on X (formerly Twitter) and Facebook.

One Ecosystem selected for inclusion in the Web of Science

“Not only does it mean that content is persistent in merit and quality, but that innovative research outputs are already appreciated within academia,” says Editor-in-Chief Prof Dr Benjamin Burkhard

Seven years after its official launch in May 2016, the One Ecosystem journal has successfully completed the rigorous quality and integrity assessment at Web of Science.

Scientific papers published in One Ecosystem from 2021 onwards will be indexed at the Emerging Sources Citation Index (ESCI) and the Journal Citation Reports (JCR), revealed the Indexing team at ARPHA Platform.

The news means that One Ecosystem might see its very first Journal Impact Factor (JIF) as early as 2024, following the latest revision of the metric’s policies Clarivate announced last July. According to the update, all journals from the Web of Science Core Collection are now featured in the Journal Citation Reports, and thereby eligible for a JIF.

“Giving all quality journals a Journal Impact Factor will provide full transparency to articles and citations that have contributed to impact, and therefore will help them demonstrate their value to the research community. This decision is aligned to our position that publications in all quality journals, not just highly cited journals, should be eligible for inclusion in research assessment exercises,” said back then Dr Nandita Quaderi, Editor-in-Chief and Editorial Vice President at Web of Science.

“We are happy to learn that Web of Science has recognised the value and integrity of One Ecosystem in the scholarly landscape. Not only does it mean that the scientific content One Ecosystem has been publishing over the years is persistent in merit and quality, but that innovative research outputs are already widely accepted and appreciated within academia.

After all, one of the reasons why we launched One Ecosystem and why it has grown to be particularly distinguished in the field of ecology and sustainability is that it provides a scholarly publication venue for traditional research papers, as well as ‘unconventional’ scientific contributions,”

comments Prof Dr Benjamin Burkhard, Executive Director at the Institute of Physical Geography & Landscape EcologyLeibniz University Hannover (Germany) and founding Editor-in-Chief of One Ecosystem.

“These ‘unconventional’ research outputs – like software descriptions, ecosystem inventories, ecosystem service mappings and monitoring schema – do not normally see the light of day, let alone the formal publication and efficient visibility. We believe that these outputs can be very useful to researchers, as well as practitioners and public bodies in charge of, for example, setting up indicator frameworks for environmental reporting,”

says Prof Davide Geneletti, Department of Civil, Environmental and Mechanical Engineering of University of Trento, Italy, and Deputy Editor-in-Chief of One Ecosystem.

“In fact, last year, we also launched a new article type: the Ecosystem Accounting table, which follows the standards set by the the System of Environmental-Economic Accounting Ecosystem Accounting (SEEA EA). This publication type provides scientists and statisticians with a platform to publish newly compiled accounting tables,” 

adds Dr Joachim Maes, Policy analyst at the Directorate-General for Regional and Urban Policy of the European Commission and Deputy Editor-in-Chief of One Ecosystem.

***

Previously, One Ecosystem has been accepted for indexing at over 60 major academic databases, including ScopusDOAJCabell’s DirectoryCABI and ERIH PLUS. In June 2022, the journal received a Scopus CiteScore reading 7.0, which placed it in Q1 in five categories: Earth and Planetary Sciences; Ecology; Nature and Landscape Conservation; Agricultural and Biological Sciences (miscellaneous); Ecology, Evolution, Behavior and Systematics.

***

You can follow One Ecosystem on Twitter and Facebook.