Secure your digital datasets — by letting a data centre look after them!
Mark Fellgett discusses why data centres should be the de facto option for the storage of geoscience data.
10/12/2021Ongoing and innovative geoscience research often depends on the re-use of legacy datasets, which can be valuable long after they have been collected. Of particular interest is data collected by publicly funded research, as it usually has fewer restrictions governing its re-use.
For many research projects that BGS is involved with, outputs and deliverables are hosted by institutions or companies and shared via websites. This method of delivering data to stakeholders may allow for easy and instant access to material, but it leaves data at risk and it is certainly not recommended for long-term storage. Ongoing data management, such as maintenance, compatibility and security of websites, is rarely costed into a project. Over time, this may result in loss of functionality and ultimately loss of access to the data, often occurring as ‘link rot’, where hyperlinks no longer point to the original web page or server.
One such example comes from the NERC-funded Rapid Global Geological Events Project (RGGE), which ran 1995–1998. The aim of RGGE was to identify the effects of climactic changes on modern sediments. The project focused on the Kimmeridge Clay, with two boreholes drilled on the south coast of England at Swanworth Quarry and Metherhills, Dorset. The work involved collecting core, laboratory work and field testing, and went on to support a large number of scientific publications. The quality and variety of data combined with its origins as a publicly funded project also made it ideal material for student projects.
Following completion of the project much of the analytical data and stratigraphic interpretations were stored in an openly accessible website. However, towards the end of 2020, the website was no longer accessible and, with that, all the data was lost. However, BGS held some of the wireline logging data from RGGE through their involvement with the initial project. The data had been rediscovered following unrelated work in 2015. During this time, a BGS member of staff had downloaded the rest of the RGGE data from the website to supply it to a student.
Once the external RGGE website went offline, the copy of the data held by BGS was one of the only copies of the complete dataset representing years of world-leading, publicly funded research. Unfortunately the list of associated publications was not downloaded and, as a result, has been lost. In order to secure this dataset in the long term and make it available for future reuse, it was decided to store it at the National Geoscience Data Centre (NGDC).
At the time of data collection, no metadata standards were available to advise the scientists on acceptable file formats. The NGDC now maintains a list of preferred digital formats, which is updated annually. As many of the researchers on the RGGE project have since retired or left earth science, attribution of this dataset had to be undertaken over 20 years after the data was collected in order to store it in the NGDC.
The RGGE dataset is now secured with a digital object identifier (DOI) and made publicly available under the Open Government License. This not only guarantees the long-term storage and preservation of the data but also promotes its re-use for future research through clear and transparent licensing conditions.
This is a prime example on how project-specific applications such as websites may leave valuable and unique digital data vulnerable. Ongoing and future geoscience research is dependent on these types of datasets and, without securing them, we may compromise our ability to understand the subsurface and thus the quality of future research. Professionally maintained data centres providing long-term data stewardship should be the de facto option for the storage of geoscience data.
About the author
Mark Fellgett
Petrophysicist
Relative topics
Latest blogs
Unlocking key mineral archives at the Zambian Geological Survey Department
23/02/2024
Rachel Talbot recounts a recent visit by BGS Records staff to the Zambian Geological Survey Department, to assist in critical mineral data management.
Will 2024 be the Year of the Aurora?
23/02/2024
The Sun’s approximate eleven-year activity cycle is predicted to peak this year, prompting BGS scientists to anticipate that 2024 will be the ‘Year of the Aurora’.
Hungry like a wolf: new insights from old bones housed in the BGS museum collections
18/01/2024
BGS scientists are studying the diets of ancient British wolves and how they adapted to changing environments.
How BGS is helping the farming sector of Great Britain
17/01/2024
New legislation concerning soil management and technology in modern farming has led to an increase in enquiries about BGS’s Soil Parent Material Model.
Moving stones: faults, slopes and sediments
12/01/2024
Fractured rock along faults affects sediment movement on slopes with implications for the design of infrastructure.
Understanding nutrients in tropical rainforests
11/01/2024
Christopher Bengt talks about carrying out research for his PhD amongst the rainforests and volcanoes of the Philippines.
Linking geochemistry and health in artisanal and small-scale gold mining in the Kakamega-Vihiga gold belt, Kenya
09/01/2024
PhD candidate Maureene Auma Ondayo is investigating major and trace element exposure in the environment in Kenya, aiming to reduce exposure of humans to toxic chemicals.
The Geography Olympiad: Bandung, Indonesia
22/12/2023
School student Dion Thompson joined Team UK at this year’s International Geology Olympiad in Indonesia. We hear from Dion’s mentor Anna Hicks, before Dion reports on the Olympiad itself.
CMIC: critical minerals research review
21/12/2023
Matthew Reeves of Innovate UK provides an overview of the Critical Minerals Strategy, which sets out how the UK will go about securing its supply of critical minerals.
My role as a stable isotope research assistant
19/12/2023
Charlotte Hipkiss has recently taken up a new position in the National Environmental Isotope Facility at BGS and gives us a little insight into her new position.
Groundwater in Taiwan under a changing environment
15/12/2023
BGS’s groundwater team is part of a project to develop the first groundwater forecasts for Taiwan.
In photos: marine surveying a remote volcanic island
14/12/2023
A photo blog by members of the BGS Marine Survey team, who recently completed marine surveys around Ascension Island in the South Atlantic Ocean.