2022, Contributo in volume, ENG
Farace D.; Biagioni S.; Carlesi C.; Baars C.
Managing grey literature presents many challenges for libraries, from acquisitions to access. One way libraries can promote access to collected grey literature is through the assignment of persistent identifiers (PIDs) to them.
2021, Poster, ENG
Lombardi S.; Molino A.; Giannini S.
The poster presents the results of a survey on Grey Literature distributed to a heterogeneous set of Italian libraries in a questionnaire. Our analysis moved from the observation that our involvement in the grey community led us in touch with European and international initiatives. However, we do not have a deep knowledge of the Italian panorama. We do not know how much Grey Literature is present in the Italian libraries, if and how it is managed, whether it has an informative value, and is available to the patrons. To fill this gap, we thought of a survey that refers to the seventeen Sustainable Development Goals of the UN 2030 Agenda, focusing on the importance of access to information. We reached 4096 email addresses and received 265 answers. In the poster, we report the results obtained, especially in terms of interest in Grey Literature, the specific types of documentation present in libraries, and the practices implemented to give visibility and favor the use of this documentation. The limited number of answers led us to imagine that Italian libraries do not consider GL a primary interest topic. However, librarians replying to our survey seem to think of GL as an essential portion of libraries' documentary resources either for the patrons or for the implementation of UN SDGs. Therefore, they would be available for future projects dedicated to GL.
2021, Presentazione, ENG
Lombardi S.
Grey Literature in the context of the UN 2030 Agenda: a survey presented at GL2021 International Conference on Grey Literature
2021, Contributo in atti di convegno, ENG
De Angelis G.; Lonetti F.
There is an ongoing interest in the Software Engineering field for multivocal literature reviews including grey literature. However, at the same time, the role of the grey literature is still controversial, and the benefits of its inclusion in systematic reviews are object of discussion. Some of these arguments concern the quality assessment methods for grey literature entries, which is often considered a challenging and critical task. On the one hand, apart from a few proposals, there is a lack of an acknowledged methodological support for the inclusion of Software Engineering grey literature in systematic surveys. On the other hand, the unstructured shape of the grey literature contents could lead to bias in the evaluation process impacting on the quality of the surveys. This work leverages an approach on fuzzy Likert scales, and it proposes a methodology for managing the explicit uncertainties emerging during the assessment of entries from the grey literature. The methodology also strengthens the adoption of consensus policies that take into account the individual confidence level expressed for each of the collected scores.
2020, Articolo in rivista, ENG
Farace D.; Frantzen J.; Biagioni S.; Carlesi C.
GreyNet's web-access portal and repository is the GreyGuide - an internet resource that is fully open access compliant. Having benefited from technical developments, the migration of hundreds of metadata full-text records, and the addition of enriched fields and functionality since its launch, the GreyGuide now offers GreyNet1 a testbed from which to map and measure its capacity in open access publishing. The population of this study is drawn from digital resources accessible via the GreyGuide Portal and Repository . The selection is based on the criteria that GreyNet is the content provider, that they are open access compliant, that they are sustained information resources, and that there are available use statistics from which to draw upon. This study focusses on the open access to GreyNet's range of publications, where attention is drawn to the specific document types that meet the sampling criteria.
2019, Poster, ENG
Biagioni S.; Carlesi C.; Farace D.
The GreyGuide - Repository and Portal to Good Practices and Resources in Grey Literature was launched in 2013 as a collaborative effort between GreyNet International and ISTI-CNR, Pisa, Italy. This year GreyGuide celebrates 6 years of work aimed at achieving results in line with the needs of the scientific community. GreyGuide is in continuous evolution both as regards the repository and the portal and will come to serve as GreyNet's web access portal. The GreyGuide manages Open Source Repositories and provides a unique resource in the field of grey literature that is long awaited and which responds to the information needs of a diverse, international grey literature community adhering to Open Science guiding principles. This year activities dealing with the GreyGuide have focused on oupgrading the new version of its Portal; omanaging and upgrading teh portal for the GreyForum Series enabling access to material produced by the speakers; oincluding an ORCID metadata field in the BIO Collection in the GreyGuide Repository; oincluding a DOI metadata field for GL-Conference Papers and RGL Resources in Grey Literaure in the GreyGuide Repository; oAccessGrey Project. GreyGuide is GreyNet's Web Access Portal and Repository With the recent addition of the RGL Collection (Resources in Grey Literature), the acquisition of generic, multidisciplinary, and diverse grey literature documents types is underway. Each new metadata, full-text record is assigned a DOI and system generated citation.
2019, Abstract in atti di convegno, ENG
Farace D.; Frantzen J.; Biagioni S.; Carlesi C.
Persistent identifiers such as a DOI for a publication and an ORCiD for an author/researcher can be approached from both the demand-side as well as supply-side of information. It appears however that the former attracts more attention. Here emphasis lies in the access to and preservation of research output. Yet, it is on the supply-side regarding the acquisition of research output that persistent identifiers may by the same token have influence in identifying and populating prospective data archives and repositories. This study will look at the influence persistent identifiers have in securing the acquisition of grey literature for public access. The goal of this project is twofold. First, to carry out a survey within the grey literature community as to the opinions, uses, and applications of persistent identifiers. And second, to initiate a project geared to populate a new collection housed in the GreyGuide Repository by using the DOI as an incentive. Resources in Grey Literature (RGL) is as a generic, multidisciplinary collection that will serve for this purpose. Using GreyNet's distribution channels and social media, stakeholders in the field of grey literature are invited to enter one or more of their publications in the RGL collection. Each new entry will receive a DOI minted by GreyNet International and further stored and preserved in the DataCite registry. Also, a system generated citation will be added to each new entry in order to facilitate record use. The types of grey literature documents eligible for entry in the RGL collection are numerous and can be found at http://www.greynet.org/greysourceindex/documenttypes.html. Brief guidelines for record entry require that it be self-archived using the existing online template and that both the metadata record and accompanying full-text document(s) are in English. An additional descriptive field does allow for entry in another language. And, a translation of the document can also be uploaded in the repository. Finally, it is understood that by submitting the metadata record and file(s), they become open access compliant under Creative Commons license CC-BY-SA. The initial phase of the project commences in April 2019 and closes in September 2019. Records harvested during this period along with the results of the survey will be analyzed in its second phase. In the final phase, the project's outcome will be published. Results should indicate whether the AccessGrey Project be extended to other collections in the GreyGuide, and if this project would be of value to other communities of practice in the field of grey literature.
2019, Articolo in rivista, ENG
Resnick M.P.; Ittoo A.; Jamoulle M.; Vanmeerbeek M.; Shamenek F.S.; Hsu C.E.; Vander Stichele R.; Grosjean J.; Darmoni S.; Cardillo E.; Pizzanelli M.
Problem/Goal: In GL19's "Indexing grey literature in General Practice: Family Medicine in the Era of Semantic Web," Jamoulle and colleagues (Jamoulle et al., 2018) propose the use of a relatively new terminology (3CGP) to allow for the indexing and retrieval of (GP/FM) knowledge which otherwise would be lost, or difficult to locate. Though designed to meet Cimino's (Cimino, 1998) twelve desiderata for the design of a controlled healthcare vocabulary, Jamoulle and colleagues (Jamoulle et al., 2018) acknowledge that a detailed requirement by requirement evaluation of 3CGP was not performed. The goal of this paper is to evaluate the Q-Codes component of the 3CGP terminology, in detail, with each of Cimino's twelve desiderata. Research Method/Procedure: In our work, we will focus on qualitative analysis, whereby our taxonomy, the Q-Codes, and in particular, its vocabulary satisfies a standard set of desiderata. Qualitative analysis provides a simple and yet effective way to assess the Q-Codes taxonomy's quality. We will briefly describe each of the desiderata and discuss how our taxonomy satisfies each one of them (or not). Anticipated Results of the Research: The qualitative evaluation is intended as an initial stage, which focuses on the Q-Codes taxonomy's contents, namely, its vocabulary (e.g. terms and definitions). Our aim with the qualitative evaluation is to investigate whether our proposed taxonomy, and in particular its vocabulary, satisfies a set of desiderata. This will enable us to determine whether the knowledge acquisition and (part of) the conceptualization steps of our ontology development process have been performed correctly. We consider that validating our vocabulary against a set of well-defined desiderata is paramount before evaluating other aspects of the taxonomy (such as the relations). As a set of desiderata, we chose that proposed by Cimino in his seminal study entitled "Desiderata for controlled medical vocabularies in the twenty-first century" (Cimino, 1998). These desiderata ensure that our taxonomy can be successfully deployed and exploited in actual GM/FM applications / activities, such as indexing grey literature. The desiderata define a set of (desired) characteristics that (ideally all) standard medical vocabularies should satisfy. Thus, these desiderata help in alleviating inter-operability issues, with the use of common standards ensuring the efficient integration of our taxonomy with other medical vocabularies and resources (taxonomies, ontologies). From the results of this study, improvements can be made to the Q-Codes component of, and thus, the 3CGP terminology. This, in turn, improves the ability to index the grey literature with the 3CGP terminology, providing greater access to needed information. Indication of costs related to the project: This project has not been funded. 3CGP is placed under Attribution-Non-Commercial-Share-Alike 4.0 International (CC BY-NC-SA 4.0) license.
2018, Poster, ENG
Biagioni S.; Carlesi C.; Farace D.
The GreyGuide was launched in 2013 as a collaborative effort between GreyNet International and CNR-ISTI (Networked Multimedia Information Systems Laboratory (NeMIS-Lab), Pisa, Italy. In 2018 GreyGuide celebrates 5 years of work aimed at achieving results in line with the needs of a diverse, international grey literature community adhering to Open Science guiding principles. The GreyGuide provides a unique resource in the field of grey literature that is long awaited and is in continuous evolution both as regards the repository and the portal and will come to serve as GreyNet's web access portal.
2018, Contributo in atti di convegno, ENG
M. P. Resnick, A. Ittoo, M. Jamoulle, M. Vanmeerbeek, F. S. Shamenek, C. Ed Hsu, R. Vander Stichele, J. Grosjean, S. Darmoni, E. Cardillo, M. Pizzanelli
Problem/Goal:In GL19's "Indexing grey multilingual literature in General Practice in the era of Semantic Web," Jamoulle and colleagues proposed the use of a relatively new terminology(3CGP) to allow for the indexing and retrieval of (GP/FM) knowledge which otherwise would be lost, or difficult to locate. Though designed to meet Cimino's (1998) twelve desiderata for the design of a controlled healthcare vocabulary, Jamoulle and colleagues acknowledge that detailed requirement by requirement evaluation of 3CGP was not performed. The goal of this paper is to evaluate the Q-Code component of the 3CGP terminology, in detail, with each of Cimino's twelve desiderata. Research Method/Procedure: In our work, we will focus on qualitative analysis, whereby our taxonomy, the Q-Codes, and in particular, its vocabulary satisfies a standard set of desiderata. The qualitative analysis provides a simple and yet effective way to assess our taxonomy's quality. We will briefly describe each of the desiderata and discuss how our taxonomy satisfies each one of them (or not). Anticipated Results of the Research: The qualitative evaluation is intended as an initial stage, which focuses on our taxonomy's contents, namely, its vocabulary (e.g., terms and definitions). Our aim with the qualitative evaluation is to investigate whether our proposed taxonomy and in particular its vocabulary, satisfies a set of desiderata. This will enable us to determine whether the knowledge acquisition and (part of) the conceptualization steps of our ontology development process have been performed correctly. We consider that validating our vocabulary against a set of well-defined desiderata is paramount before evaluating other aspects of the taxonomy (such as the relations). As a set of desiderata, we chose that proposed by Cimino in his seminal study entitled "Desiderata for controlled medical vocabularies in the twenty-first century" (Cimino, 1998). These desiderata ensure that our taxonomy can be successfully deployed and exploited in actual GM/FM applications/ activities, such as indexing grey literature. The desiderata define a set of (desired) characteristics that (ideally all) standard medical vocabularies should satisfy. Thus, these desiderata help in alleviating interoperability issues, with the use of common standards ensuring the efficient integration of our taxonomy with other medical vocabularies and resources (taxonomies, ontologies). From the results of this study, improvements can be made to the Q-Codes component of, and thus, the 3CGP terminology. This, in turn, improves the ability to index the grey literature with the 3CGP terminology, providing greater access to needed information.
2018, Articolo in rivista, ENG
Jamoulle M.; Cardillo E.; Ittoo A.; Vander Stichele R.; Resnick M.P.; Grosjean J.; Darmoni S.; Vanmeerbeek M.
Problem/Goal: Sharing the results of research with General Practitioners (GPs) is crucial for the survival of the discipline of General Practice / Family Medicine (GP/FM). The production of abstracts in GP/FM probably exceeds 15,000 per year worldwide. Each abstract often represents two years of work for its authors and is expressed in local languages. Only 45% of them are published in indexed medical journals. Usual indexing systems like MeSH are not multilingual nor adapted to the particular field of GP/FM. Consequently, these abstracts are lacking bibliographic control and more than half of the research presented by GPs at congresses is lost. Considering the absence of appropriate domain-specific terminologies or classification systems, we propose a new multilingual indexing system. The existing International Classification of Primary Care (ICPC) is currently used for clinical purposes and has now been expanded with a taxonomy related to contextual aspects (called Q-Codes) such as education, research, practice organization, ethics or policy in GP/FM, currently not captured. The set is proposed under the name Core Content Classification in General Practice (3CGP). The aim is to facilitate indexing of GP/FM specific scientific work and to improve performance in information storage and retrieval for research purposes in this field. Research Method/Procedure: Using qualitative analysis, a corpus of 1,702 abstracts from six GP/FM- related European congresses was analyzed to identify main themes discussed by GPs (e.g., continuity, accessibility or medical ethics), handled in a domain-specific taxonomy called Q-Codes and translated in 8 languages. In addition, a methodology for building a lightweight ontology (in OWL-2) was applied to Q-Codes, adding object and datatype properties to the hierarchical relations, including mapping to the MeSH thesaurus, Babelnet (www.babelnet.org) and Dbpedia. Finally, the Q-Codes in 8 languages have been integrated healthcare terminology service (www.hetop.eu/q) with a companion website (http://3cgp.docpatient.net). Anticipated Results of the Research: The creation and the on-line publication of this multilingual terminological resource, for indexing abstracts and for facilitating Medline searches, could reduce loss of knowledge in the domain. In addition, through better indexing of the grey literature (congress abstracts, master's and doctoral thesis), we hope to enhance the accessibility of research results of GP/FM domain and promote the emergence of networks of researchers. First result of experimental implementations of the new indexing system will be presented. Indication of costs related to the project: This project has not been funded. 3CGP is placed under Attribution-Non-Commercial-Share-Alike 4.0 International (CC BY-NC-SA 4.0). ICPC is copyrighted by WONCA.
2018, Articolo in rivista, ENG
Goggi, Sara; Pardelli, Gabriella; Russo, Irene; Bartolini, Roberto; Monachini, Monica
"In the electronic age, the World Wide Web has played a major role in making scientific information accessible to a wide audience more rapidly and efficiently. This democratic approach to information dissemination in science is changing the way science is perceived and implemented in our daily lives" (Weintraub, 2000).
2018, Contributo in atti di convegno, ENG
Sara Goggi, Gabriella Pardelli, Irene Russo, Roberto Bartolini, Monica Monachini
This work will provide a map of the documentation archived in the CLARIN infrastructure, whose purpose is to share language resources produced and managed in the various European countries but finally merged into the CLARIN data centers for allowing access, interoperability, reuse and preservation of scientific documentation as well as Grey Literature.
2017, Poster, ENG
Biagioni S., Giannini S.
In December 2013, the GreyGuide Project was formerly launched as an online forum and repository of good practice in grey literature. The GreyGuide manages Open Source Repositories and provides a unique resource in the field of grey literature that is long awaited and which responds to the information needs of a diverse, international grey literature community. As GreyNet's web access Portal, the GreyGuide now provides a wealth of content that was previously either confined to web pages or was only in-house accessible.
2017, Abstract in atti di convegno, ENG
Giannini S.; Deluca R.; Molino A.; Biagioni S.
In the recent years the application of strategies, procedures and tools to evaluate the research have become subject of interest and their application is currently matter of discussion. The assessment exercises are regulated at national level and are carried out in different European countries such as France, United Kingdom and The Netherlands. In Italy the first research assessment exercise has been legislated in 2003 and entrusted to a specific Committee named Comitato di Indirizzo per la Valutazione della Ricerca (CIVR)1. Three years later the CIVR and other committees have been replaced by a specific Agency named Agenzia Nazionale di Valutazione del Sistema Universitario e della Ricerca (ANVUR). This Agency, set up at the end of 2006, aims to «...rationalize the system of assessment of the quality of Universities, state and private Research Institutions beneficiary of public funds...» « The results of these activities managed by ANVUR represent a criteria to assign the state funds to Universities and Research Institutions». It is not hard to imagine that the effects of this type of exercise has a strong political implication and determines a significant economic impact on the future of Universities and Research Institutions. The debate concerning the adopted methods and critical aspects about the assessment exercises is studied thoroughly at international level. At the present time, ANVUR has completed two evaluation exercises of the quality of the research named Valutazione della Qualità della Ricerca (VQR): the first one spans the years 2004 - 2010; the second from 2011 to 2014. The work analyzes the environment of VQR in order to understand the organizational set-up, the operational models, the scientific areas involved in the process, the selection and evaluation criteria and indicators of the research products. The work looks at the environment of VQR in order to understand the organizational set-up, the operational models, the scientific Areas involved in the process and the selection and evaluation criteria of the research products. More in detail, our work analyzes and compares the evaluation exercises conducted in Italy with the aim of verifying if and how Grey Literature is involved in the research evaluation processes. The article checked the types of products admissible for the research assessment and those actually presented by the researchers of Universities and Research Institutions. We measured the products from a quantitative point of view and observed their ramification in the different disciplinary fields rather than their transformation during the period of time taken into consideration. At the same time, we focused on the Open Science movement in order to understand what could be its role within the research assessment exercises and how it could affect the future of scholarly scientific communication.
2017, Abstract in atti di convegno, ENG
Sara Goggi, Gabriella Pardelli, Irene Russo, Roberto Bartolini, Monica Monachini
This work will provide a map of the documentation archived in the CLARIN infrastructure, whose purpose is to share language resources produced and managed in the various European countries but finally merged into the CLARIN data centers for allowing access, interoperability, reuse and preservation of scientific documentation as well as Grey Literature.
2017, Contributo in atti di convegno, ENG
E. Cardillo (1), M. Jamoulle (2), M. Vanmeerbeek (2), M. P. Resnick (3), A. Ittoo (4), R. Vander Stichele (5), J. Grosjean (6), S. Darmoni (6)
Problem/Goal: Sharing the results of research with General Practitioners (GPs) is crucial for the survival of the discipline of General Practice / Family Medicine (GP/FM). The production of abstracts in GP/FM exceeds 15,000 per year worldwide. Each abstract often represents two years of work for its authors and is expressed in local languages. Only 45% of them are published in indexed medical journals. Usual indexation systems like MeSH are not multilingual nor adapted to the particular field of GP/FM. Consequently, these abstracts are lacking bibliographic control and more than half of the research presented by GPs at congresses is lost. Considering the absence of appropriate domain-specific terminologies or classification systems, we propose a new multilingual indexing system. The existing International Classification of Primary Care (ICPC) is currently used for clinical purposes and has now been expanded with a taxonomy related to contextual aspects (called Q-Codes) such as education, research, practice organization, ethics or policy in GP/FM, currently not captured. The set is proposed under the name Core Content Classification in General Practice (3CGP). The aim is to facilitate indexing of GP/FM specific scientific work and to improve performance in information storage and retrieval for research purposes in this field. Using qualitative analysis, a corpus of 1,702 abstracts from six GP/FM-related European congresses was analyzed to identify main themes discussed by GPs (as continuity, accessibility or medical ethics), handled in a domain-specific taxonomy called Q-Codes and translated in 8 languages. In addition, a methodology for building a lightweight ontology (in OWL-2) was applied to Q-Codes, adding object and datatype properties to the hierarchical relations, including mapping to the MeSH thesaurus, Babelnet (www.babelnet.org) and Dbpedia. Finally, the ICPC-2 in 19 languages and Q-Codes in 8 languages have been integrated in a healthcare terminology service(www.hetop.eu/q) with a companion website (http://3cgp.docpatient.net). Anticipated Results of the Research: The creation and the on-line publication of this multilingual terminological resource for indexing abstracts and for facilitating Medline searches could reduce the loss of knowledge in the domain. In addition, through better indexing of the grey literature (congress abstracts, master's and doctoral thesis), we hope to enhance the accessibility of research results of GP/FM domain and promote the emergence of networks of researchers. First result of experimental implementations of the new indexing system will be presented.
2017, Articolo in rivista, ENG
Giannini S.; Biagioni S.; Goggi S.; Pardelli G.
The work measures grey citations in the years 2012, 2013 and 2014 and then describes the features of GL documents cited in different areas of knowledge: Computational Linguistics, Computer Science and Engineering. With the aim of surveying a wide and varied range of resources, we selected a sample data based on the bibliographical references of articles contained in four journals - all indexed by Scopus Citation Database and ISI Web of Science, with an Impact Factor (IF) over the last three years - and two proceedings of international conferences held in 2012 and 2014.
2017, Articolo in rivista, ENG
Bartolini R.; Pardelli G.; Goggi S.; Giannini S.; Biagioni S.
"It is by means of terms that the expert usually transfer their knowledge and again through terms scientific communication reaches the highest effectiveness. Therefore we can assert that terminology - in the sense of a set of representative and domain-specific units - is necessary for representing and connecting specialized fields as well as any attempt to represent and/or transfer scientific knowledge requires, more or less extensively, the use of terminology." (Cabré, 2000). "When we read the articles or papers of a particular domain, we can recognize some lexical items in the texts as technical terms. In a domain where new knowledge is generated, new terms are constantly created to fulfill the needs of the domain, while others become obsolete. In addition, existing terms may undergo changes of meaning..." (Kageura K., 1998/1999). Specialized lexicons are made up of the terms which are specific to each field of knowledge, «a subset which is distinct but not separated from the common language» (Cassese, 1992): it is usually difficult to extract the relevant domain-specific terminology, meaning to discern terms which belong to a specialized glossary from those belonging to the common dictionary. The interest in the study of terminology and the "truth" contained in the above definitions has led us to make a "journey" in the Grey Literature (GL) domain in order to offer an overall vision on the terms used and the links between them. Within this scenario, the work analyzes a corpus constituted of the entire amount of full research papers published in the GL conference series over a time-span of more than one decade (2003-2014) with the aim of creating a terminological map of relevant words in the various GL research topics. "... corpora used to extract terminological units can be further investigated to find semantic and conceptual information on terms or to represent conceptual relationships between terms. (Bourigault D. et al., 2001). Another interesting inquiry is the terminology used in the GL conferences for describing the types of documents which can be detected (Pej?ová P. et al., 2012).
2017, Contributo in atti di convegno, ENG
Bartolini R.; Pardelli G.; Goggi S.; Giannini S.; Biagioni S.
The work analyzes a corpus constituted of the entire amount of full research papers published in the GL conference series over a time-span of more than one decade (2003-2014) with the aim of creating a terminological map of relevant words in the various GL research topics. "... corpora used to extract terminological units can be further investigated to find semantic and conceptual information on terms or to represent conceptual relationships between terms. (Bourigault D. et al., 2001). Another interesting inquiry is the terminology used in the GL conferences for describing the types of documents which can be detected (Pej?ová P. et al., 2012).