Caminhos para adequação da avaliação da produção científica brasileira: impacto nacional versus internacional

Abstract

Many bibliometric indicators have been used to evaluate the scientific performance of researchers, universities and countries.Impact indicators, measured from citations to articles, have been addressed in many studies in the literature.The present study aimed to put forward possible forms of analysis adequacy to Brazilian scientific journals, to improve the scientific production evaluation criteria in the Brazilian framework.Objectives.The research was conducted in agreement with three objectives: (1) To verify if the exclusive use of international indicators leaves the Brazilian scientific policy out of context of its local reality, and if the ISI (Thomson Scientific) indexed journals usage has been justified -the access of which in full article texts has been offered gratuitous to the scientific community by Capes (Coordination for the Improvement of High Education Personnel).(2) To investigate if SciELO (Scientific Electronic Library)-indexed Brazilian scientific production could provide impact indicators to appropriately contribute to the national science evaluation.(3) To find more indicators and new methodologies for science assessment in the context of the Brazilian science reality.Methodology.An exploratory quantitative study was conducted, based on qualitative and quantitative characteristics of scientific journals from three sources: journals classified by Qualis Assessment (years 2001/2002/2003), journals of the "Portal de Periódicos da Capes" and SciELO journals.A comparison between the national and international impact of a set of Brazilian SciELO journals was conducted based on citations received from journals in each database (SciELO and ISI).A methodology of journal analysis was presented applying the multivariate statistical analysis technique to a set of 42 indicators.Results.The analysis of Qualis Assessment showed that the defined criteria favor mainly the publications in international journals by using ISI Impact Factor.The comparison of the annual average of citations received in SciELO by a sample of journals, before and after the availability in it, showed a positive effect, noticed by an increase to 70% of the journals (Life Sciences).The comparison of the national impact versus international impact of SciELO journals showed that those indexed also on ISI are cited more frequently; in the whole sample, SciELO journals received approximately 72% of ISI's citations from international authors; had the articles in collaboration (national and international) cited more often than those with single authorship.It was noticed that journals indexed only in SciELO, are cited in similar numbers in both databases; received 68% of ISI's citations from international authors and have articles with single authorship cited more frequently, followed by those with national collaboration.The multivariate analysis of SciELO journals indicators allowed the identification of different groups of journals, separated according to different practices of scientific communication.Conclusions.The criteria adequacy used in the evaluation of the national scientific production can be met considering impact indicators measured by citations on national journals.Criteria should be defined that value the publication in national journals with renown quality.This will allow the publication of important articles in Portuguese, and will encourage the process of national journals quality improvement.

Cite this work

No public copy is stored for this record, so only the metadata is cited.

Stored only when both papers are in the corpus — 17 citations exist upstream.

Papers that cite the same references — the relational fallback while embeddings are still backfilling.