What is a support system for selection of reviewers?
This is an adaptive knowledge database, which collects information about potential reviewers and selects potential candidates to assess a scientific article or a research proposal. Database query should look like: ‘Select the reviewers to evaluate the project, to assess the article, etc.’. The project was implemented under the Innovative Economy Programme.
How can the system objectify the process of peer reviewing?
The questionnaire survey conducted by National Information Processing Institute demonstrates that just over 35 percent of applicants for grants perceive peer reviews as fair and objective, and among the reviewers this perception is only slightly better. The idea behind the new system is that it will limit the side effects of peer reviewing, for example, cognitive errors arising from the unintentionally applied, simplified rules of inference.
What are the main features provided by the system?
The system comprises of five substantive modules: data collection, classification, identification of individuals, keyword extraction and ranking. These modules are algorithms responsible for data processing. The user has no direct access to them, but the result of their activities is presented by the interface. Three basic functionalities of the system include:
- Ranking of reviewers – recommends the best reviewers.
- Analysis of a document – to extract keywords from the text.
- Databases – provide an opportunity to view a variety of data: fields of science, people, keywords, publications and sources.