Secure your digital datasets — by letting a data centre look after them!
Mark Fellgett discusses why data centres should be the de facto option for the storage of geoscience data.
10/12/2021
Ongoing and innovative geoscience research often depends on the re-use of legacy datasets, which can be valuable long after they have been collected. Of particular interest is data collected by publicly funded research, as it usually has fewer restrictions governing its re-use.
For many research projects that BGS is involved with, outputs and deliverables are hosted by institutions or companies and shared via websites. This method of delivering data to stakeholders may allow for easy and instant access to material, but it leaves data at risk and it is certainly not recommended for long-term storage. Ongoing data management, such as maintenance, compatibility and security of websites, is rarely costed into a project. Over time, this may result in loss of functionality and ultimately loss of access to the data, often occurring as ‘link rot’, where hyperlinks no longer point to the original web page or server.
One such example comes from the NERC-funded Rapid Global Geological Events Project (RGGE), which ran 1995–1998. The aim of RGGE was to identify the effects of climactic changes on modern sediments. The project focused on the Kimmeridge Clay, with two boreholes drilled on the south coast of England at Swanworth Quarry and Metherhills, Dorset. The work involved collecting core, laboratory work and field testing, and went on to support a large number of scientific publications. The quality and variety of data combined with its origins as a publicly funded project also made it ideal material for student projects.
Following completion of the project much of the analytical data and stratigraphic interpretations were stored in an openly accessible website. However, towards the end of 2020, the website was no longer accessible and, with that, all the data was lost. However, BGS held some of the wireline logging data from RGGE through their involvement with the initial project. The data had been rediscovered following unrelated work in 2015. During this time, a BGS member of staff had downloaded the rest of the RGGE data from the website to supply it to a student.
Once the external RGGE website went offline, the copy of the data held by BGS was one of the only copies of the complete dataset representing years of world-leading, publicly funded research. Unfortunately the list of associated publications was not downloaded and, as a result, has been lost. In order to secure this dataset in the long term and make it available for future reuse, it was decided to store it at the National Geoscience Data Centre (NGDC).
At the time of data collection, no metadata standards were available to advise the scientists on acceptable file formats. The NGDC now maintains a list of preferred digital formats, which is updated annually. As many of the researchers on the RGGE project have since retired or left earth science, attribution of this dataset had to be undertaken over 20 years after the data was collected in order to store it in the NGDC.
The RGGE dataset is now secured with a digital object identifier (DOI) and made publicly available under the Open Government License. This not only guarantees the long-term storage and preservation of the data but also promotes its re-use for future research through clear and transparent licensing conditions.
This is a prime example on how project-specific applications such as websites may leave valuable and unique digital data vulnerable. Ongoing and future geoscience research is dependent on these types of datasets and, without securing them, we may compromise our ability to understand the subsurface and thus the quality of future research. Professionally maintained data centres providing long-term data stewardship should be the de facto option for the storage of geoscience data.
About the author

Mark Fellgett
Petrophysicist
Relative topics
Latest blogs

Mining hazard data from BGS
17/05/2022
Great Britain has over 250 000 documented mining sites and the underground voids resulting from past mining activity pose a possible hazard. Knowledge of the distribution of former mining areas will help us to plan for future development and ongoing maintenance.

Introducing GeoCoast: new coastal datasets from BGS
20/04/2022
GeoCoast is an integrated GIS package of datasets designed to inform and support coastal management and adaptation.

Six changing coastlines and how climate change could affect them
12/04/2022
We explore how parts of the British coastline are changing and what important factors we should consider in terms of natural hazards, adaptation and resilience.

Sea level rise and coastal erosion: what’s the real impact?
05/04/2022
How much of an issue are coastal vulnerabilities and what do we need to consider to increase our resilience to future events?

The importance of staff networks
18/03/2022
A sense of inclusivity in the workplace is essential for staff health and well-being. Staff networks can help this by bringing together people from a diverse group of backgrounds, as Romesh Palamakumbura explores.

Building surveys in La Palma during the 2021 volcanic eruption
18/03/2022
In December 2021, BGS BUFI student Sara Osman visited La Palma in the Canary Islands to assess buildings damaged during the Cumbre Vieja volcanic eruption. In this blog, she talks about her experiences on the island.

My role as a BGS Geochemistry Technician
08/03/2022
Kotryna Savickaite tells us about her new role as she settles in at BGS Keyworth.

Understanding environmental impact through the study of sediments
23/02/2022
A new study aims to understand the range of organic molecules present in urban waterway sediments from different locations around the world.

Investing in nature
14/02/2022
BGS and local community volunteers join together to plant 12 000 spring bulbs and help native wildlife to thrive.

Understanding the resilience of Mexico City to future water crises
25/01/2022
Long-term solutions for water poverty in one of the world’s largest cities in the face of climate change and a growing population.

Going greener at work
04/01/2022
There are many ways to reduce your carbon footprint through small changes in your daily activities, from methods of transport to activities at work or the home office space.

Evidence Week 2021
15/12/2021
Representatives from BGS took part in Evidence Week 2021 to talk to parliamentarians about unlocking the potential of geothermal energy in the UK.