06 June 2023
21 May 2020
To ensure user readiness, it extremely important that users have access to data that will, in a best possible way, resemble the data that will be available from the future instruments.
Test data of that kind should have the best possible maturity in data content and in format specifications attached to different data. This is valid both for the pre-launch development period and during post-launch commissioning activities.
User test data can take different forms, for instance having more or less scientific values, formats and sizes. However, different test data can be associated with different user preparation processes, from tailoring of data acquisition systems to visualisation and utilisation of the satellite data in an operational environment.
Released test data packages and support data
Flexible Combined Imager (FCI)
AMV product in BUFR format
This MTGTD-384 test dataset simulates a single example of the FCI Level 2 Atmospheric Motion Vectors (AMV) product in BUFR format, using the latest MTG Level 2 processing chain (L2PF). During the operational phase of the FCI instrument on the MTG-I1 (Meteosat-12) satellite, the AMV product will be generated every 30 minutes.
Dataset description
The BUFR product was generated from five L2PF netCDF L2 AMV products, which were generated using three repeat cycles of FCI L1c data simulated from SEVIRI data. These three repeat cycles are used as a triplet in which the centre image is used as the reference image for the winds generation.
Details are available here:
The size of the file composing this delivery is about 26MB.
The BUFR sequence 3 10 077 is used for generating the AMV BUFR product. This is the same as for MSG and the structure of the information written out for FCI MTG is consistent with that of MSG. See the following for a description of the BUFR sequence template:
Package usage
Documentation
ASR product in BUFR format
This MTGTD-463 test dataset simulates a single example of the FCI Level 2 All Sky Radiance (ASR) product in BUFR format, using the latest MTG Level 2 processing chain (L2PF).
The test dataset is representative in terms of scientific content, and data format, with documented limitations. During the operational phase of the FCI instrument on the MTG-I1 (Meteosat-12) satellite, the ASR product will be generated every 10 minutes.
Dataset description
The BUFR product has been generated from an L2PF netCDF L2 ASR product, which was generated using a single repeat cycle of data. Details can be found in :
The size of the file composing this delivery is about 13MB.
The same BUFR sequence has been used as for MSG and the structure of the information written out for FCI MTG is consistent with that of MSG. See also the following for a description of the BUFR sequence template:
Package usage
Documentation
Lightning Imager (LI)
A new set of simulated Level 2 datasets for the Lightning Imager (LI) on MTG-I was released on 3 September 2021, for user familiarisation.
Dataset description
The simulated test datasets were produced with the EUMETSAT LI reference processor, with high scientific and format representativity. Several issues in an earlier 2020 release of LI L2 test data are fixed. Three sequences of 30 seconds length each were simulated based on GLD360 and SEVIRI data from 20 June 2013, starting at 201306200700, 1500, and 1700, respectively. The package is intended to facilitate user familiarity with the LI L2 products.
The datasets were produced according to the LI Level 2 format specification, consisting of the following files in netCDF format:
Initial products
- LGR: containing the properties of the groups within a window of 10 seconds; in detail, group detection time, average group latitude and longitude, total radiance of the group, number of events per group, groups ID, and ID of the flash to which each group belongs, group quality indicator (confidence in the file). Three group products are produced by each simulation.
- LFL: containing the properties of the flashes within a window of time of 10 seconds; in detail, flash start time, average flash latitude and longitude, total radiance of the flash, flash ID, number of groups per flash, number of events per flash, flash duration, flash footprint, flash quality indicator (confidence in the file). Three flash products are produced by each simulation.
Accumulated products
Containing the accumulated information over 30 seconds re-gridded on the FCI 2km IR grid for Accumulated Flash (AF), Accumulated Flash Area (AFA), and Accumulated Flash Radiance (AFR); in detail:
a) the AF product contains the accumulated events normalised by the total number of events in the flash itself computed for all the flashes,
b) the AFA product contains the accumulated footprint of all the flashes,
c) finally, the AFR product contains the accumulated irradiance for all the flashes.
The three products are not provided as images, but as a list of x and y locations on the FCI 2km grid which are an integer representation of the azimuth and zenith angles of the FCI 2km grid. Also for these products, the average flash quality indicator is provided.
Package usage
SFTP access:
The MTG LI Level 2 datasets are delivered as a compressed tar file.
A checksum file (sha256sum.txt) is included.
Documentation
A package description is provided via the above SFTP server.
Infrared Sounder (IRS)
In November 2022, a simulated Level 1B full disc dataset for the Infrared Sounder (IRS) which will fly on Meteosat Third Generation sounding satellites (MTG-S) was made available to users. It replaces an earlier release of this test dataset (MTGTD-406, July 2022), with a fixed anomaly related to radiance scale factors and units.
Dataset description
The dataset consists of a simulated full disc of IRS dwells for all four Local Area Coverage (LAC) zones, containing Level 1B spectra in native and principal component form, provided in netCDF format in line with the current IRS Level 0 and 1 format specification.
It is intended for format familiarisation and system testing.
Package usage
SFTP access
Documentation
Earlier releases of MTG user familiarisation test data
February 2023 - FCI
MTGTD-360 is an evolution to the previously delivered MTGTD-298 FCI 1C 26-Hour test data package that was released to users in October 2021.
While both datasets have the same format specification baseline, the content is radically different. The radiances contained in the previous package were a plain copy of the SEVIRI channels, while this dataset contains simulated channels that are spectrally representative of the actual MTG FCI output, using the latest FCI spectral response functions.
The package contains compressed and uncompressed versions of the data. The compressed data has been generated using external HDF filters based on the CharLS compression (see the MTG FCI L1 Product User Guide [FCIL1PUG] for further information).
Dataset description
This test data contains 24 hours of FCI Level 1C FDHSI datasets to be used for product familiarisation. The format for these test data is derived from:
- MTG Generic Format Specification, V4A
- MTG FCI Level 0 & 1 Format Specification, V4C
Package usage
SFTP access
Documentation
Format Comparison between MTGTD-360 FCI L1C products and operational FCI L1C products
December 2021 - FCI
An updated 26-h FCI L1c test dataset for format familiarisation was released in December 2021 (TD-298), as an update to a previously delivered FCI L1c test dataset that was released to users in July 2020 (TD-272).
Dataset description
This test dataset contains 26 hours of FCI level 1C full-disc FDHSI data to be used for format familiarisation. The format for these data is derived from:
- MTG Generic Format Specification, V4A
- MTG FCI Level 0 & 1 Format Specification, V4C
Thus, providing a data format as close as possible to the data format of the future FCI data. The majority of variables and attributes have been filled with representative values. Remaining limitations are described in the package description. The term dataset refers to a number of associated files. In this case, the files of each dataset are all associated to an FCI repeat cycle.
No internal compression has been applied to this test dataset.
Package usage
SFTP access:
Documentation
July 2020 - FCI
in July 2020 enhanced FCI Level 1C datasets were released, including datasets with non-nominal data. These new datasets are short duration (one full disc repeat cycle) but are much more scientifically representative of future operational data than the 24-hour datasets provided in 2019. Both are complementary.
Dataset description
Two FCI level 1C datasets are provided for format familiarisation:
- One nominal dataset which contains Full Disc High Spectral Imagery (FDHSI) data in nominal acquisition conditions.
- One non-nominal dataset which contains FDHSI data with simulated missing data
Each of these datasets are provided in compressed and uncompressed versions. The compressed versions represent the data that will be disseminated in near real-time during MTG operations, while the uncompressed form is how the data will be archived.
All above datasets contain:
- Full images of the Earth
- 16 channels
The datasets are divided into 40 body chunk files and one trailer chunk file (chunk ‘41’) each.
Package usage
FTP access:
The package contains the following files:
FCI_1C_UNCOMPRESSED_NOMINAL.tar.gz — nominal dataset
FCI_1C_UNCOMPRESSED_NON-NOMINAL.tar.gz — non-nominal dataset with simulated missing data
FCI_1C_COMPRESSED_NOMINAL.tar.gz — same nominal dataset above but with CharLS compression applied to selected variables
FCI_1C_COMPRESSED_NON-NOMINAL.tar.gz — same non-nominal dataset above but with CharLS compression applied to selected variables
FCI_1C_REFGRIDS.tar.gz containing three netCDF files, one for each FCI resolution, with computed latitude and longitude variables for all Earth pixels inside an FCI full-disc:
- CM_OPE_GRIDDEF_MTI1+FCI_20190321090000_1km-V2.nc
- CM_OPE_GRIDDEF_MTI1+FCI_20190321090000_2km-V2.nc
- CM_OPE_GRIDDEF_MTI1+FCI_20190321090000_500m-V2.nc
sha256sum.txt file which contains the checksums for all files in the datasets
In addition, the following is provided on the FTP:
Decompression software
Product user guide
Documentation
May 2020 – LI
On 27 May 2020, a simulated Level 2 dataset of the Lightning Imager for format familiarisation was released.
June 2019 – FCI
The June 2019 release of simulated Meteosat Third Generation (MTG) Flexible Combined Imager (FCI) Level 1C data covers a 24-h period and is based on SEVIRI proxy data. These test datasets are intended for format familiarisation and system testing purposes.
Dataset description
The term 'dataset' refers to a number of files or 'chunks' associated to a FCI repeat cycle (one complete 10-minute Earth disc scan = one repeat cycle). Each dataset comprises several body chunk netCDF-4 files that contain observational data, one trailer chunk netCDF-4 file, and one RGB composite quick-look png file.
These simulated datasets are based on MSG SEVIRI data. They are in the final format and are highly representative of an operational FCI Level 1C dataset. They are intended for format familiarisation and system testing purposes.
Package usage
FTP access:
The datasets are provided in compressed and uncompressed versions:
- Compressed version: The radiance data are compressed with the CharLS algorithm, as they will be when disseminated to users in near-real time during MTG operations. The ‘Compressed’ directory contains a set of tarred and zipped sub-directories (each one contains all the product chunks for a repeat cycle). There are also two check sum files (one for each repeat cycle and one for all chunks).
- Uncompressed version: This is how the data will be archived. The ‘Uncompressed’ directory is set up in the same way as the ‘Compressed’ directory.
In addition, the following is provided on the FTP:
- A decompression software, together with an installation guide and a user guide.
- MTG EUMETCast simulator: The MTG EUMETCast simulator simulates the delivery of MTG products to a EUMETCast reception station. It uses 24 hours of MTG FDSS-FCI L1C test data and transfers the files to a specified target directory on EUMETCast reception station using ftp protocol, in the exact time of their delivery via EUMETCast.
Documentation
MTG test data package description - FCI L1C - 24h test data for users
Disclaimer
Test data are released exclusively for the purposes of facilitating user-preparedness. They are not to be used for operational purposes, nor are they to be cited in scientific publications or disclosed through unauthorised public channels and internet platforms. For further information please consult the Terms of Use for Special Provisions: test data.
