About

Специальный выпуск 44 "Наукометрия и экспертиза в управлении наукой"

Novikov D., Goubko M. Scientometric and expert methods in research management: an introductory word

Chebotarev P. The use of scientometrics: how to help, not hurt?

The article presents the author’s view on the “diseases” of modern world and Russian science and on the use of scientometrics to treat them.

Orlov A. Two types of methodological errors in research management

Attempts of research activity administration are often based on wrong assumptions and, therefore, do harm to the development of science. The article is devoted to a preliminary discussion of two types of methodological errors in the management of research activities. We show the damage incurred by the methods based on the publications’ count and the number of citations in academic journals. We also demonstrate irrationality of the current system of scientific disciplines.

Voronin A. What sort of efficiency russian science needs

We consider scientometrical, socio-psychological, organizational, and managerial aspects of the evaluation of individual performance in the context of intra-organizational and branch-wide management.

Granovsky Y. Scientometrics in moscow university

Professor V.V. Nalimov pioneered application of scientometrics in Moscow State University in the 1960s. He put forward the informational model of science development. At the same time scientometrical researches in the divisions of the University were started. However, these activities did not receive wide advertisement. The administration of the University turned back to the scientometrics in the second decade of the current century. In this paper we consider several recommendations to improve researchers’ performance: identification of active scientific teams, accounting for their structure, use of the Russian scientific citation index, comparison of teams on different phases of research field development. We provide stocktaking of two performance indicators (that of the impact factor and Hirsch index) and make proposals on how scientometrical methods can be used to improve performance of researches.

Grigor’ev Y. Some problems of transition to modern system of high school science management

We consider several system problems of transition of Russian high-school-based science to the novel management principles and provide recommendations on overcoming some existing negative phenomenona.

Kuznetsova J., Osipov G., Chudova N. Intellectual analysis of scientific publications and the current state of science

This paper outlines problems of identification of advancing scientific researches. Theoretical perspectives and scientometric approaches to the essence, orientation, and productivity of science are analyzed in the context of temporal evolution. Possibility is justified of development of a new approach to measure importance of scientific papers and the output of scientists and research teams. The approach is based on intellectual analysis of text.

Milek O., Schmerling D. Promotion of a russian university on the international educational market

We discuss problems of development of Russian universities at the international academic market and propose some solutions. One of these solutions is issuing several university journals (on economics, sociology, political science, mathematics, physics, chemistry, etc.) in English. These journals should accept most interesting research papers irrespective on the authors’ affiliation.

Mikhailov O. Reflections on scientific activity evaluation

We discuss main objections appeared in the literature in the last years concerning the tendency of broad using of various bibliometric indicators to evaluate scientific activity. We justify applicability of this approach to estimation of most categories of researchers. At the same time, these indicators can be essentially skewed when evaluating, for example, the, so called, “hard-task-solvers”.

Polyak B. Scientometrics: who is the patient for this medicine?

This article is motivated by the discussion paper of P. Chebotarev. We insist on that the situation with the use of scientometrics is dramatically different in the context of Russian and of foreign science. In Russian case the role of formal criteria can be strictly positive.

Aleskerov F., Kataeva E., Pislyakov V., Yakuba V. Evaluation of scientists’ output using the method of threshold aggregation

The new approach to evaluation of scientists’ output is proposed based on aggregation of separate bibliometric indicators using the procedure of threshold aggregation. The method is illustrated on a model dataset.

Gorokhov V. Problem of measuring performance of scientists and of scientific institutions

The article presents the author’s view on the problem of performance measurement of research activities, first of all, in Germany and in Russia, and on the possibility of using scientometrics to analyze of interdisciplinary research areas development (in the case of the nanotechnology).

Marshakova-Shaikevich I. Bibliomertrics – what and how we can evaluate in science

We explain the bibliometric approach (forms, methods and citation indicators) to study science, and give examples of bibliometric evaluation of authors, scientific journals, and Russian universities on the basis of information from Web of Knowledge databases ин ISI/Thomson Reuters Scientific.

Tsiganov A. Brief rewiev of main scientometric indices based on citations

We present standard definitions of some scientometric indexes and discuss their possible applications in various expert ratings.

Shtovba S., Shtovba O. A survey on scientometric indicators for assessment of researcher’s publication activity

Nowadays in order to evaluate productivity of research activities along with expert opinions scientometric indices are being increasingly used. This paper provides an overview of main scientometric indices, which take into account the number of publications and the number of citations both separately and together. Ways to incorporate additional information such as the number of co-authors, journal status, duration of a scientific career, bargain citations, etc. are shown. Pitfalls of scientometric indices associated with hidden and informal citations, as well as errors in reference lists are shown.

Grinchenko S. Whether a solution exists to the problem of permanent evaluation of reseacher’s contribution to science?

The problem specified in the title is reduced to that of scientometric analysis considered as an element of scientific activity within the frameworks of self-controlled humankind system functioning on the basis of optimization algorithms of hierarchic adaptive search. In this framework scientific activity acts as an element of search activity and scientific results represent the form of the system memory of the humankind. For the forms of system memory characteristic modification/fixation time periods were previously revealed. These time periods are also valid for the research activity. These considerations form the basis of the conclusion that the solution to the problem of permanent evaluation of scientists’ contribution cannot be based on short-term observation, but require mid-term or long-term perspective.

Mirkin B. Notion of research impact and current indexes for scoring it

Under the assumption that there exists a comprehensive hierarchical classification of the sciences, the level of research impact of a scientist is defined as the hierarchical level of the field of science created or transformed by the scientist. Current indexes for scoring the research impact are critically discussed with respect to this definition. Ways to make the scoring more adequate are highlighted.

Moskaleva O. Is it possible to evaluate researcher’s work using bibliometric indicators?

Basic bibliometric indicators and their usage for research activities evaluation are reviewed. Special attention is paid to the particular features of bibliometric indicators application at different levels of analysis – at the level of a country, an organization, an individual researcher – and to the use of analytical tools InCites and SciVal Spotlight for research benchmarking. The problems of research activities performance assessment are discussed.

Feigel'man M., Tsirlina G. Bibliometric excitement due to the absence of scientific expert evaluation

Earlier the authors discussed the problem of professional evaluation in science and possibility to solve this problem under conditions currently existing in Russia in Refs [1–5], and partly implemented this approach in volunteer “Expert Corps” project. In this communication the reasons of appearance of this project are addressed, and compatibility with the alternative approaches to evaluation of scientific results is discussed.

Fradkov A. The splendors and miseries of scientific expertise formal criteria

Joint usage of formal and informal criteria of scientific expertise for the mega-grants’ contest is discussed. An attempt to work out a reasonable approach for evaluation of projects from different scientific fields is described.

Marie Deza M., Deza E. Some remarks on the evaluation of scientific publications

We propose to refine the use of publication indices counting separately research announcements, final research program reports, and the majority of publications: intermediate research reports. We also stress the importance of surveys and literature reviews in research publications and, especially, in special dynamic on-line surveys.

Derbenev N., Tolcheev V. What can be improved in sciencemetrics – near-duplicates and plagiarism detection in scientific publications

We conduct the analysis of scientometrics methods, consider their advantages and disadvantages, discuss a new, rather promising, line of development. We suggest applying the methods of near-duplicates and plagiarism detection in scientometric analysis. We give some results of processing a big array of research papers, and provide examples of uncovered near-duplicates.

Savelieva J., Khoperskov A. Scientific journals and efficiency of scientific work: search systems and databases

Problems of scientometric indicators application to research performance assessment are discussed. We compare the impact factors of Russian journals using the database of scholar search systems Scopus, Web of Science and e-library and show that they are two times lower in average than those for the full sample. We consider some reasons for such a poor average result of Russian journals. Statistical analysis shows that high values of researcher’s scientometric indicators in international bibliographic and reference databases correlates with high values of those indicators in e library.

Yurevich A., Tsapenko I. Efficiency of national social science and humanities: scientometrics approach

We demonstrate multiple defects of methods of quantitative assessment of national science efficiency, which have been lately wide spread by science ombudsmen and encounter active resistance of the academic community. We also show that significance of contribution of national science to the world one is exaggerated while assessing efficiency of national science. In particular, our investigation revealed the absence of significant correlation between these indicators of contribution and various indicators of national wellbeing.

Gusein-Zade S. Tale of the «Istina»

On the base of the ISTINA system (used in Moscow State Lomonosov University) as an example, we try to show that the use of publication and citation indices for comparison of scientists from different fields is not rightful.

Zhukova I. Citation indices: sociological point of view

We review the main theories in the sociology of science concerning citation indices and their application in studying the scientific community. We follow briefly the evolution of the views of E. Garfield (the founder of Science Citation Index). The limits of using citation indices as an evaluation tool are discussed.

Nelly M. Real factors of scientific activity and citation count

In this article, which presents the part of the author's publications devoted to problems of measuring scientific activity, the attempt is undertaken to demonstrate that there are the inevitable real factors of research activities being an obstacle to the use of citation count and the other citation indices as of precise instruments of research activity performance assessment. The problem is analyzed on the basis of materials from the past and contemporary state of the philosophical science.

Novochadov V., Shiroky A. How scientometrical indices work: selective research of russian biologists

We analyze efficiency of classic scientometrical indices from the public database of electronic scientific library eLibrary.ru on a large representative sample of Russian biologists. We aim to separate and analyze the comparative indices in the formed groups of biologists using methods of population biology. Comparison of the data with the real situation in modern biology allows looking critically at the use of cumulative indicators of scientific productivity such as number of publications, citations, citation index and h-index to make an assessment of the work of a particular biologist.

Pervozvansky A. Objective attributes of scientific school

The author enumerates major attributes of scientific schools, gives a definition and illustrates it with the example of A.I. Lurie’s school in mechanics and automatic control. The paper is published in accordance with “Pervozvansky A.A. Ob’ektivniye priznaki nauchnoy shkoly / In book: Academic scientific schools of Saint-Petersburg: for 275th anniversary of Academy of Sciences / Eds. E.A. Tropp, E.A. Ivanova, A.S. Fomin. – SPb: Saint-Petersburg Academic Center of RAS, 1998.”

Chebotarev P. Evaluation of scientists: landscape before battle

It is possible to write a fascinating book based on the discussion contained in this volume, in the companion online forum, and in the correspondence between the reviewers and the authors. Indeed, the topic “Evaluation of scientists: expert and scientometric approaches” is important and sensitive, and this special issue brings together a number of bright scholars of completely different ideas. This article focuses on only one aspect of the debate, but it is an aspect that determines not only the approach to the evaluation of scientists, but the direction of development of the whole Russian science. It consists in choosing one of two general directions which can be called internationalism and isolationism.

Orlov A. Scientometrics and research management

Attempts of research activity administration are often based on wrong assumptions and, therefore, do harm to the development of science. This article summarizes the discussion on scientometrics and research management. We provide a critical review and analysis of papers from the Online-conference with minimal involvement of additional information. It has emerged from the discussion that assessment of researchers’ and organizations’ activities requires a strict expert examination and public discussion of scientific results. Scientometric indicators calculated on the basis of publications and citations count in scientific journals, can only play a supporting (reference) role.

Upper level