Secure your digital datasets — by letting a data centre look after them!
Mark Fellgett discusses why data centres should be the de facto option for the storage of geoscience data.
10/12/2021![Photograph of drill core from Metherhills 1](https://www.bgs.ac.uk/wp-content/uploads/2021/12/Metherhills.jpg)
Ongoing and innovative geoscience research often depends on the re-use of legacy datasets, which can be valuable long after they have been collected. Of particular interest is data collected by publicly funded research, as it usually has fewer restrictions governing its re-use.
For many research projects that BGS is involved with, outputs and deliverables are hosted by institutions or companies and shared via websites. This method of delivering data to stakeholders may allow for easy and instant access to material, but it leaves data at risk and it is certainly not recommended for long-term storage. Ongoing data management, such as maintenance, compatibility and security of websites, is rarely costed into a project. Over time, this may result in loss of functionality and ultimately loss of access to the data, often occurring as ‘link rot’, where hyperlinks no longer point to the original web page or server.
One such example comes from the NERC-funded Rapid Global Geological Events Project (RGGE), which ran 1995–1998. The aim of RGGE was to identify the effects of climactic changes on modern sediments. The project focused on the Kimmeridge Clay, with two boreholes drilled on the south coast of England at Swanworth Quarry and Metherhills, Dorset. The work involved collecting core, laboratory work and field testing, and went on to support a large number of scientific publications. The quality and variety of data combined with its origins as a publicly funded project also made it ideal material for student projects.
Following completion of the project much of the analytical data and stratigraphic interpretations were stored in an openly accessible website. However, towards the end of 2020, the website was no longer accessible and, with that, all the data was lost. However, BGS held some of the wireline logging data from RGGE through their involvement with the initial project. The data had been rediscovered following unrelated work in 2015. During this time, a BGS member of staff had downloaded the rest of the RGGE data from the website to supply it to a student.
Once the external RGGE website went offline, the copy of the data held by BGS was one of the only copies of the complete dataset representing years of world-leading, publicly funded research. Unfortunately the list of associated publications was not downloaded and, as a result, has been lost. In order to secure this dataset in the long term and make it available for future reuse, it was decided to store it at the National Geoscience Data Centre (NGDC).
At the time of data collection, no metadata standards were available to advise the scientists on acceptable file formats. The NGDC now maintains a list of preferred digital formats, which is updated annually. As many of the researchers on the RGGE project have since retired or left earth science, attribution of this dataset had to be undertaken over 20 years after the data was collected in order to store it in the NGDC.
The RGGE dataset is now secured with a digital object identifier (DOI) and made publicly available under the Open Government License. This not only guarantees the long-term storage and preservation of the data but also promotes its re-use for future research through clear and transparent licensing conditions.
This is a prime example on how project-specific applications such as websites may leave valuable and unique digital data vulnerable. Ongoing and future geoscience research is dependent on these types of datasets and, without securing them, we may compromise our ability to understand the subsurface and thus the quality of future research. Professionally maintained data centres providing long-term data stewardship should be the de facto option for the storage of geoscience data.
About the author
![Mark Fellgett](https://www.bgs.ac.uk/wp-content/uploads/2020/03/Mark-Fellgett_P935655.jpg)
Mark Fellgett
Petrophysicist
Relative topics
Latest blogs
![Nine people in two groups (four to the left; five to the right) standing on grey rocks with brown cliffs behind them.](https://www.bgs.ac.uk/wp-content/uploads/2024/07/tuscany-feature-image.jpg)
The heat beneath our feet: BGS field visit to Tuscan geothermal systems
05/07/2024
BGS visits the active and fossilised geothermal systems of southern Tuscany, Italy.
![Sophia and Job at BGS conducting specialist analysis of Pu in soils.](https://www.bgs.ac.uk/wp-content/uploads/2024/05/Job_Sophia_Lab_T-Barlow_thumbnail.jpg)
Harnessing global collaboration: UK/Kenya partnership in soil erosion research
31/05/2024
Collaboration between scientists is vital in today’s interconnected world to further scientific progress. In environmental research, issues such as soil erosion demand collaboration on an international scale.
![The aurora over Haddington, Scotland. Credit: Migle Petruskeviciute](https://www.bgs.ac.uk/wp-content/uploads/2024/05/aurora-over-haddington-scotland.webp)
A-roaring display
16/05/2024
The dazzling and colourful aurora borealis, or northern lights, observed by many across the UK last weekend was one of the most extreme and long-lasting geomagnetic storms recorded in the last 155 years.
![Scott's Monument, west elevation. © BGS/UKRI](https://www.bgs.ac.uk/wp-content/uploads/2024/04/Scott_monument_thumbnail.jpg)
Building stones spotlight: the Sir Walter Scott Memorial 25 years after its conservation
29/04/2024
BGS geologist, Luis Albornoz-Parra, discusses the iconic Edinburgh monument, the building stones used in its construction and the result (so far) of its conservation efforts.
![Rebecca Mumpansha, a GSD librarian, with the sales stock of geological maps. © Rachel Talbot.](https://www.bgs.ac.uk/wp-content/uploads/2024/02/P1000254-960x645.webp)
Unlocking key mineral archives at the Zambian Geological Survey Department
23/02/2024
Rachel Talbot recounts a recent visit by BGS Records staff to the Zambian Geological Survey Department, to assist in critical mineral data management.
![Aurora borealis in northern Norway. © Jeremy Bishop/Unsplash.](https://www.bgs.ac.uk/wp-content/uploads/2024/02/henrik-heitmann-wQ1UIvNfgYQ-unsplash.webp)
Will 2024 be the Year of the Aurora?
23/02/2024
The Sun’s approximate eleven-year activity cycle is predicted to peak this year, prompting BGS scientists to anticipate that 2024 will be the ‘Year of the Aurora’.
![P1038353](https://www.bgs.ac.uk/wp-content/uploads/2024/01/P1038353.webp)
Hungry like a wolf: new insights from old bones housed in the BGS museum collections
18/01/2024
BGS scientists are studying the diets of ancient British wolves and how they adapted to changing environments.
![The Lewes Nodular Chalk Formation contributes to the chemistry of overlying soils in Culver Down on the Isle of Wight. BGS © UKRI.](https://www.bgs.ac.uk/wp-content/uploads/2024/01/culver-down-p683813.webp)
How BGS is helping the farming sector of Great Britain
17/01/2024
New legislation concerning soil management and technology in modern farming has led to an increase in enquiries about BGS’s Soil Parent Material Model.
![The Codleteth Burn catchment with its outlet fan system and recent debris flow deposits near Talla Linfoots. BGS © UKRI.](https://www.bgs.ac.uk/wp-content/uploads/2024/01/P1038346-scaled-1-960x640.jpg)
Moving stones: faults, slopes and sediments
12/01/2024
Fractured rock along faults affects sediment movement on slopes with implications for the design of infrastructure.
![Chris Bengt, PhD Student, in Stable Isotope Lab, Keyworth. BGS © UKRI.](https://www.bgs.ac.uk/wp-content/uploads/2024/01/chris-bengt-p1038345.webp)
Understanding nutrients in tropical rainforests
11/01/2024
Christopher Bengt talks about carrying out research for his PhD amongst the rainforests and volcanoes of the Philippines.
![Gold mining activities (milled ore washing and sluicing) and community drinking water downslope of ASGM activities. © Maureene Auma Ondayo.](https://www.bgs.ac.uk/wp-content/uploads/2024/01/gold-mining-activities-sluicing-p1038343-960x645.webp)
Linking geochemistry and health in artisanal and small-scale gold mining in the Kakamega-Vihiga gold belt, Kenya
09/01/2024
PhD candidate Maureene Auma Ondayo is investigating major and trace element exposure in the environment in Kenya, aiming to reduce exposure of humans to toxic chemicals.
![Team UK at the International Geography Olympiad. Source: Jo Bayham & Jen Lomas](https://www.bgs.ac.uk/wp-content/uploads/2023/12/1_Team_UK.jpg)
The Geography Olympiad: Bandung, Indonesia
22/12/2023
School student Dion Thompson joined Team UK at this year’s International Geology Olympiad in Indonesia. We hear from Dion’s mentor Anna Hicks, before Dion reports on the Olympiad itself.