History
The Centre for Environmental Data Analysis (CEDA) has evolved over time as its remit has changed and developed in response to the needs of its user community. The following gives a brief history of this evolution and a timeline of significant changes.
The original “CEDA” group followed the merger of two of NERC’s data centres - the BADC and NEODC - in 2005, originally being called the Centre for Environmental Data Archival. However, with greater support for users analysing the data too a slight name change from the A in CEDA from Archival to Analysis occurred in 2015 to reflect this growing and important role for CEDA.
Prior to 2005 CEDA’s history was that as the British Atmospheric Data Centre (BADC), with “CEDA”’s 20th anniversary being celebrated in 2015. Sam Pepler also put together a presentation about CEDA’s evolution during this time which was presented at the 10th International Digital Data Curation conference in 2015.
The BADC was established in 1994 when it superseded a previous facility: the Geophysical Data Facility (GDF). The GDF was previously funded by the then Science and Engineering Research Council (SERC) and primarily supported what was then called the “upper atmosphere” remote sensing community (based as it was on studies of the atmosphere between 10 and 400km). However a survey of the NERC community (Carruthers and Thornes, 1995: Development of the Atmospheric Science and Technology Implementation Plan), resulted in an increased remit for the newly renamed BADC to support the entire NERC atmospheric science community. Over the last decade, it has become apparent that the BADC provides services to a wider community than just the atmospheric sciences community (e.g. medicine, biology, waste management, marine sciences, ecology, etc…)
A timeline of important CEDA events is detailed below:
July 1, 1984
An Advisory Panel (of representatives from a wide range of interested institutions and universities) is set up to oversee the development of the Geophysical Data Facility (GDF) and a number of pilot studies are being undertaken. The GDF is to be set-up to organise and provide access to data from many Science and Engineering Research Council (SERC) Geophysical experiments in the Middle Atmosphere, Climate, Solar Terrestrial and Planetary research.
August 1, 1985
The GDF main aim is to facilitate data exchange to ease the problem of magnetic tape handling which is becoming a severe burden. During the year, data from the NIMBUS series of satellites and Active Magnetospheric Particle Tracer Explorer (AMPTE) have been consolidated into databases on the IBM central computer. These include measured values of temperature of the middle atmosphere and of density, temperature, pressure and energy spectra of electrons and ions in the magnetosphere. A user at a remote site can access catalogues of the data holdings, select data of interest and transfer these to his own installation via JANET.
September 1, 1987
The general interface to the GDF is improved considerably primarily to help and encourage users. By providing cross links to other geophysical datasets at RAL, datasets from different sources can be readily combined. High level command instructions and graph plotting routines are now also available to aid data manipulation.
October 1, 1989
Data now available from the GDF include ground-based and satellite observations from the UK and abroad as well as modelling results from intercomparison and testing measurements. The datasets now include in-situ space plasma data from AMPTE and stratospheric results from SAMS (Stratospheric And Mesospheric Sounder), LIMS and SSU (Stratospheric Sounder Unit) and output from thermospheric and atmospheric models. Solar terrestrial data from the World Data Centre at RAL are also accessible through the GDF environment.
November 1, 1990
These include the MST radar data, the Cambridge D computer model output and 3 NASA aircraft campaigns which studies ozone depletion processes (AAOE, AASE)
December 1, 1991
This link is used by RAL mainly for data transfer from the UARS Central Data Handling Facility at NASA’s Goddard Space Flight Center. GDF now serves over 135 users from 22 university departments, 11 other British institutes and 5 overseas laboratories.
February 1, 1993
Funding for the GDF is now from NERC, the Natural Environment Research Council. First Edition of the GDF Newsletter
November 1, 1994
BADC becomes NERC’s Designated Data Centre for the Atmospheric Sciences - “Meeting the data requirements of the NERC Atmospheric Science Community”
October 1, 1996
A formal agreement was reached between the Natural Environment Research Council (NERC) and the Met Office in which all future requests to the Met Office for data intended for NERC-funded atmospheric research will be coordinated by the BADC. This arrangement avoids duplicate requests for data. A strategy of bulk purchasing is in place, benefiting the wider research community in the long term. The BADC pro-actively organises the bulk acquisition of popular datasets. Examples include ECMWF model analyses and Met Office upper-air and surface data.
September 1, 1997
Following the NERC-UKMO agreement, upper air and surface data from the Met Office are being archived at the BADC together with the ECMWF operational analyses (approx. 697GB)
August 1, 1999
Website includes the new BADC Trajectory service, Met Office stations catalogue, Datasets catalogue and a browsing archive facility (with frames). Explosion in data archive holdings; GOME, virtem, MRF, ozone climatology, worldwide standard radiosonde data, UK high resolution radiosonde data, Met Office Hadley Centre data including GISST and CET, ECMWF trajectory data, Met Office raingauge data from MIDAS, SOAPEX
July 1, 2000
File ingestor in full operation allowing for UTLS and URGENT (NERC thematic programmes) data files to populate the archive. Unified Model data being archived at the BADC, ESA Water vapour, Meteosat images.
June 1, 2002
Work on the Live-Access Server (LAS) facility is under way. this facility will allow users to visualize and subset data via their web browser. This will make possible for users to examine data interactively at BADC without having to download large amounts of data. The BADC now holds over 70 different datasets (approx. 3520 GBs).
March 1, 2004
The BADC archives and distributes data collected onboard the NERC/MO jointly run FAAM aircraft. The BADC has moved from a system based primarily on a central multiprocessor Compaq-Alpha (tornado) to a distributed system based on multiple linux platforms and network attached storage. Total disk storage is currently about 30 TB.
May 1, 2005
The BADC is authorised by the European Space Agency to archive and distribute data from 4 Envisat instruments (MIPAS, SCIAMACHY, GOMOS, MERIS) to ESA Category 1 grant holders, in addition to UTLS and CWVC participants.
April 1, 2007
Council for the Central Laboratory of the Research Councils (CCLRC) and the Particle Physics and Astronomy Research Council (PPARC) merged to form the Science and Technology Facilities Council (STFC).
November 1, 2008
Data Extractor available for MIDAS Surface Data. Data extractor can support Microsoft Internet Explorer.
July 1, 2011
New WPS service launched. BADC CMIP5 Gateway launched. Demonstration of the new CEDA Science Visualisation Service for Earth Observation (SVSeo) at the launch of the new International Space Innovation Centre (ISIC).
July 1, 2012
New CEDA website launched.
June 1, 2014
New myCEDA services launched to replace old BADC and NEODC systems. JASMIN Phase 2 becomes operational.
September 1, 2018
JASMIN Phase 4 becomes operational. Increasing capacity up to 44 Petabytes with over 11,000 cores.
August 1, 2019
First-ever hands-on interactive JASMIN training event. CEDA seen at Living Planet Symposium.
September 1, 2020
New JASMIN helpdesk enabled more appropriate query categorisation improving services for users. Deployment of the new improved performance and capacity archive download service allowing for more simultaneous downloads and an improved system for authorizing downloads. JASMIN User conference was held, the team provided an update to users about key services and new developments. JASMIN Jupyter notebook service launched.
January 15, 2021
CEDA services improve access to global climate data, CEDA awarded Core Trust Seal certificate in June. New Jaspy python3.7 version released in May and provides software environments of common python and non-python packages on the scientific analysis servers and LOTUS cluster on JASMIN.
July 1, 1984
An Advisory Panel (of representatives from a wide range of interested institutions and universities) is set up to oversee the development of the Geophysical Data Facility (GDF) and a number of pilot studies are being undertaken. The GDF is to be set-up to organise and provide access to data from many Science and Engineering Research Council (SERC) Geophysical experiments in the Middle Atmosphere, Climate, Solar Terrestrial and Planetary research.
August 1, 1985
The GDF main aim is to facilitate data exchange to ease the problem of magnetic tape handling which is becoming a severe burden. During the year, data from the NIMBUS series of satellites and Active Magnetospheric Particle Tracer Explorer (AMPTE) have been consolidated into databases on the IBM central computer. These include measured values of temperature of the middle atmosphere and of density, temperature, pressure and energy spectra of electrons and ions in the magnetosphere. A user at a remote site can access catalogues of the data holdings, select data of interest and transfer these to his own installation via JANET.
September 1, 1987
The general interface to the GDF is improved considerably primarily to help and encourage users. By providing cross links to other geophysical datasets at RAL, datasets from different sources can be readily combined. High level command instructions and graph plotting routines are now also available to aid data manipulation.
October 1, 1989
Data now available from the GDF include ground-based and satellite observations from the UK and abroad as well as modelling results from intercomparison and testing measurements. The datasets now include in-situ space plasma data from AMPTE and stratospheric results from SAMS (Stratospheric And Mesospheric Sounder), LIMS and SSU (Stratospheric Sounder Unit) and output from thermospheric and atmospheric models. Solar terrestrial data from the World Data Centre at RAL are also accessible through the GDF environment.
November 1, 1990
These include the MST radar data, the Cambridge D computer model output and 3 NASA aircraft campaigns which studies ozone depletion processes (AAOE, AASE)
December 1, 1991
This link is used by RAL mainly for data transfer from the UARS Central Data Handling Facility at NASA’s Goddard Space Flight Center. GDF now serves over 135 users from 22 university departments, 11 other British institutes and 5 overseas laboratories.
February 1, 1993
Funding for the GDF is now from NERC, the Natural Environment Research Council. First Edition of the GDF Newsletter
November 1, 1994
BADC becomes NERC’s Designated Data Centre for the Atmospheric Sciences - “Meeting the data requirements of the NERC Atmospheric Science Community”
October 1, 1996
A formal agreement was reached between the Natural Environment Research Council (NERC) and the Met Office in which all future requests to the Met Office for data intended for NERC-funded atmospheric research will be coordinated by the BADC. This arrangement avoids duplicate requests for data. A strategy of bulk purchasing is in place, benefiting the wider research community in the long term. The BADC pro-actively organises the bulk acquisition of popular datasets. Examples include ECMWF model analyses and Met Office upper-air and surface data.
September 1, 1997
Following the NERC-UKMO agreement, upper air and surface data from the Met Office are being archived at the BADC together with the ECMWF operational analyses (approx. 697GB)
August 1, 1999
Website includes the new BADC Trajectory service, Met Office stations catalogue, Datasets catalogue and a browsing archive facility (with frames). Explosion in data archive holdings; GOME, virtem, MRF, ozone climatology, worldwide standard radiosonde data, UK high resolution radiosonde data, Met Office Hadley Centre data including GISST and CET, ECMWF trajectory data, Met Office raingauge data from MIDAS, SOAPEX
July 1, 2000
File ingestor in full operation allowing for UTLS and URGENT (NERC thematic programmes) data files to populate the archive. Unified Model data being archived at the BADC, ESA Water vapour, Meteosat images.
June 1, 2002
Work on the Live-Access Server (LAS) facility is under way. this facility will allow users to visualize and subset data via their web browser. This will make possible for users to examine data interactively at BADC without having to download large amounts of data. The BADC now holds over 70 different datasets (approx. 3520 GBs).
March 1, 2004
The BADC archives and distributes data collected onboard the NERC/MO jointly run FAAM aircraft. The BADC has moved from a system based primarily on a central multiprocessor Compaq-Alpha (tornado) to a distributed system based on multiple linux platforms and network attached storage. Total disk storage is currently about 30 TB.
May 1, 2005
The BADC is authorised by the European Space Agency to archive and distribute data from 4 Envisat instruments (MIPAS, SCIAMACHY, GOMOS, MERIS) to ESA Category 1 grant holders, in addition to UTLS and CWVC participants.
April 1, 2007
Council for the Central Laboratory of the Research Councils (CCLRC) and the Particle Physics and Astronomy Research Council (PPARC) merged to form the Science and Technology Facilities Council (STFC).
November 1, 2008
Data Extractor available for MIDAS Surface Data. Data extractor can support Microsoft Internet Explorer.
July 1, 2011
New WPS service launched. BADC CMIP5 Gateway launched. Demonstration of the new CEDA Science Visualisation Service for Earth Observation (SVSeo) at the launch of the new International Space Innovation Centre (ISIC).
July 1, 2012
New CEDA website launched.
June 1, 2014
New myCEDA services launched to replace old BADC and NEODC systems. JASMIN Phase 2 becomes operational.
September 1, 2018
JASMIN Phase 4 becomes operational. Increasing capacity up to 44 Petabytes with over 11,000 cores.
August 1, 2019
First-ever hands-on interactive JASMIN training event. CEDA seen at Living Planet Symposium.
September 1, 2020
New JASMIN helpdesk enabled more appropriate query categorisation improving services for users. Deployment of the new improved performance and capacity archive download service allowing for more simultaneous downloads and an improved system for authorizing downloads. JASMIN User conference was held, the team provided an update to users about key services and new developments. JASMIN Jupyter notebook service launched.
January 15, 2021
CEDA services improve access to global climate data, CEDA awarded Core Trust Seal certificate in June. New Jaspy python3.7 version released in May and provides software environments of common python and non-python packages on the scientific analysis servers and LOTUS cluster on JASMIN.