On the communication of scientific data: The Full-Metadata Format

Riede, Moritz; Schueppel, Rico; Sylvester-Hvid, Kristian O.; Kühne, Martin; Röttger, Michael C; Zimmermann, Klaus; Liehr, Andreas W.

doi:10.1016/j.cpc.2009.11.014

Cited by 14 publications

(13 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To make this header information readable in an automated way, it has to be systematically structured. The Full Metadata Format proposal [20] outlines such an easy to read and easy to parse format.…”

Section: Context and Digitisation Of Ktb Reportsmentioning

confidence: 99%

Curating the web’s deep past – Migration strategies for the German Continental Deep Drilling Program web content

Klump

Ulbricht

Conze

2015

GeoResJ

View full text Add to dashboard Cite

a b s t r a c tOn timescales beyond the life of a research project, a core task in the curation of digital research data is the migration of data and metadata to new storage media, new hardware, and software systems. These migrations are necessitated by ageing software systems, ageing hardware systems, and the rise of new technologies in data management. Using the example of the German Continental Deep Drilling Program (KTB) we outline steps taken to keep the acquired data accessible to researchers and trace the history of data management in KTB from a project platform in the early 1990ies through three migrations up to the current data management platform. The migration steps taken not only preserved the data, but also made data from KTB accessible via internet and citable through Digital Object Identifier (DOI). We also describe measures taken to manage hardware and software obsolescence and minimise the amount of maintenance necessary to keep data accessible beyond the active project phase. At present, data from KTB are stored in an Open Archival Information System (OAIS) compliant repository based on the eSciDoc repository framework. Information packages consist of self-contained packages of binary data files and discovery metadata in Extensible Mark-up Language (XML) format. The binary data files were created from a relational database used for data management in the previous version of the system, and from websites generated from a content management system. Metadata are provided in DataCite, GCMD-DIF, and ISO19139/INSPIRE schema definitions. Access to the KTB data is provided through download pages which are produced by XML transformation from the stored metadata.

show abstract

Section: Context and Digitisation Of Ktb Reportsmentioning

confidence: 99%

Curating the web’s deep past – Migration strategies for the German Continental Deep Drilling Program web content

Klump

Ulbricht

Conze

2015

GeoResJ

View full text Add to dashboard Cite

show abstract

“…So making use of information included in this way always requires user intervention. There are initiatives to create metadata inclusion standards for delimiter-separatedvalue formats, but these have not gained significant adoption and are aimed at either web-based material (Tennison et al, 2015) or small datasets (Riede et al, 2010), or they are very recent proposals (Walsh and Pollock, 2019).…”

Section: Instrumentmentioning

confidence: 99%

How to improve the state of the art in metocean measurement datasets

Quaeghebeur

Zaaijer

2020

Wind Energ. Sci.

View full text Add to dashboard Cite

We present an analysis of three datasets of 10 min metocean measurement statistics and our resulting recommendations to both producers and users of such datasets. Many of our recommendations are more generally of interest to all numerical measurement data producers. The datasets analyzed originate from offshore meteorological masts installed to support offshore wind farm planning and design: the Dutch OWEZ and MMIJ and the German FINO1. Our analysis shows that such datasets contain issues that users should look out for and whose prevalence can be reduced by producers. We also present expressions to derive uncertainty and bias values for the statistics from information typically available about sample uncertainty. We also observe that the format in which the data are disseminated is sub-optimal from the users' perspective and discuss how producers can create more immediately useful dataset files. Effectively, we advocate using an established binary format (HDF5 or netCDF4) instead of the typical text-based one (comma-separated values), as this allows for the inclusion of relevant metadata and the creation of significantly smaller directly accessible dataset files. Next to informing producers of the advantages of these formats, we also provide concrete pointers to their effective use. Our conclusion is that datasets such as the ones we analyzed can be improved substantially in usefulness and convenience with limited effort.Published by Copernicus Publications on behalf of the European Academy of Wind Energy e.V. 286E. Quaeghebeur and M. B. Zaaijer: How to improve the state of the art in metocean measurement datasets dressed? This paper reports the results of that study. In brief, (i) yes, there are shared issues, but, not unexpectedly, not all of them in all datasets, and (ii) dataset producers can address the issues with a few non-burdensome additions to their creation practice. Next to providing arguments for and detailing these conclusions, this paper is meant to raise awareness of the issues mentioned by giving concrete examples. Furthermore, it provides dataset producers with concrete ideas about how to achieve substantial improvements with reasonable effort.The users of the produced datasets are of course the farm developers, but also the academic world, whose usage is not necessarily restricted to wind energy applications. The context of our academic research is offshore wind energy, but the work we present here is relevant outside that area as well. Therefore, we treat all measured quantities on equal footing and do not focus on wind and wave data. When our discussion goes beyond the analysis of the specific datasets we considered, it is also mostly independent of their metocean nature but generally applies to any numerical time series data.We structure the paper into two main sections. We start with an essentially descriptive Sect. 2, to give an overview of the datasets we considered and to identify the issues we encountered. The original contributions here are our thorough description, in-depth analysis, ...

show abstract

“…The evaluation of the thickness maps is entirely handled from within the data analysis framework Pyphant . This tool was developed to facilitate the handling of large pools of measurement data (formatted in the Full Metadata Format ) and, among other features, benefits from the data being organized within so‐called data containers. In practical terms, this implies that the 1940 reflection spectra as, for example, recorded for a single R‐type device are manipulated and analyzed as a single object.…”

Section: Principles Of Measurement and Derivation Of Thickness Mapsmentioning

confidence: 99%

Non‐destructive lateral mapping of the thickness of the photoactive layer in polymer‐based solar cells

Sylvester-Hvid

Tromholt

Jørgensen

et al. 2011

Progress in Photovoltaics

Self Cite

View full text Add to dashboard Cite

Non‐destructive lateral mapping of the thickness of the photoactive layer in poly(3‐hexyl‐thiophene) : 1‐(3‐methoxy‐carbonyl)propyl‐1‐phenyl‐(6,6)C61 (P3HT : PCBM) solar cells is demonstrated. The method employs a spatially resolved (XY) recording of ultraviolet‐visible spectra in reflection geometry at normal incidence, using a dense raster defined by a circular probe spot of 800‐µm diameter. The evaluation of the thickness of the photoactive layer at each raster point employs an algorithm‐driven comparison of the measured absorption spectrum with spectral features, as compiled from the corresponding simulated spectrum. For the robustness of the applied algorithm toward noise in the recorded absorption data to be increased, a new minimum finder algorithm is described and implemented. The thickness evaluation relies on the correct assignment of extrema in the experimental absorption spectra to the corresponding extrema in the simulated absorption spectra, and a new algorithm for this is also implemented and described. For a level of confidence for the method to be established, first thickness mapping is performed for a set of reference samples consisting of P3HT : PCBM spin‐coated on indium tin oxide‐coated float glass substrates. After this, two application examples for solar cells processed either by spin coating or slot die coating of the P3HT : PCBM layer follow. The spin‐coated solar cells have glass as the substrate with the P3HT : PCBM spun at different spinning speeds. The slot die‐coated solar cells were processed on polyethylene terephthalate foil in a roll‐to‐roll experiment involving a continuously changing P3HT : PCBM concentration along the printing direction. Copyright © 2011 John Wiley & Sons, Ltd.

show abstract

On the communication of scientific data: The Full-Metadata Format

Cited by 14 publications

References 14 publications

Curating the web’s deep past – Migration strategies for the German Continental Deep Drilling Program web content

Curating the web’s deep past – Migration strategies for the German Continental Deep Drilling Program web content

How to improve the state of the art in metocean measurement datasets

Non‐destructive lateral mapping of the thickness of the photoactive layer in polymer‐based solar cells

Contact Info

Product

Resources

About