MTG test data

MTG test data

 

MTG test data
MTG test data

Test data is available for the user community to help with preparations for receiving and processing the MTG data.

Last Updated

08 December 2021

Published on

21 May 2020

To ensure user readiness, it extremely important that users have access to data that will, in a best possible way, resemble the data that will be available from the future instruments.

Test data of that kind should have the best possible maturity in data content and in format specifications attached to different data. This is valid both for the pre-launch development period and during post-launch commissioning activities.

User test data can take different forms, for instance having more or less scientific values, formats and sizes. However, different test data can be associated with different user preparation processes, from tailoring of data acquisition systems to visualisation and utilisation of the satellite data in an operational environment.


Released test data packages and support data

Lightning Imager (LI)

A new set of simulated Level 2 datasets for the Lightning Imager (LI) on MTG-I was released on 3 September 2021, for user familiarisation.

Dataset description

The simulated test datasets were produced with the EUMETSAT LI reference processor, with high scientific and format representativity. Several issues in an earlier 2020 release of LI L2 test data are fixed. Three sequences of 30 seconds length each were simulated based on GLD360 and SEVIRI data from 20 June 2013, starting at 201306200700, 1500, and 1700, respectively. The package is intended to facilitate user familiarity with the LI L2 products.

The datasets were produced according to the LI Level 2 format specification, consisting of the following files in netCDF format:

Initial products
  • LGR: containing the properties of the groups within a window of 10 seconds; in detail, group detection time, average group latitude and longitude, total radiance of the group, number of events per group, groups ID, and ID of the flash to which each group belongs, group quality indicator (confidence in the file). Three group products are produced by each simulation.
  • LFL: containing the properties of the flashes within a window of time of 10 seconds; in detail, flash start time, average flash latitude and longitude, total radiance of the flash, flash ID, number of groups per flash, number of events per flash, flash duration, flash footprint, flash quality indicator (confidence in the file). Three flash products are produced by each simulation.
Accumulated products

Containing the accumulated information over 30 seconds re-gridded on the FCI 2km IR grid for Accumulated Flash (AF), Accumulated Flash Area (AFA), and Accumulated Flash Radiance (AFR); in detail:
a) the AF product contains the accumulated events normalised by the total number of events in the flash itself computed for all the flashes,
b) the AFA product contains the accumulated footprint of all the flashes,
c) finally, the AFR product contains the accumulated irradiance for all the flashes.

The three products are not provided as images, but as a list of x and y locations on the FCI 2km grid which are an integer representation of the azimuth and zenith angles of the FCI 2km grid. Also for these products, the average flash quality indicator is provided.

Package usage

SFTP access:

https://sftp.eumetsat.int/public/folder/UsCVknVOOkSyCdgpMimJNQ/User-Materials/Test-Data/MTG/MTG_LI_L2_TD-357_Sep2021/

The MTG LI Level 2 datasets are delivered as a compressed tar file.

A checksum file (sha256sum.txt) is included.

Documentation

A package description is provided via the above SFTP server.

Infrared Sounder (IRS)

On 12 December 2019, a simulated Level 1B dataset of the Infrared Sounder (IRS) which will fly on Meteosat Third Generation sounding satellites (MTG-S) is now available for user familiarisation.

Dataset description

The dataset consists of a IRS dwell containing Level 1B spectra in native and principle component form, provided in netCDF format in line with the current IRS Level 0 and 1 format specification.

It is intended for format familiarisation and system testing.

Package usage

FTP access:

https://sftp.eumetsat.int/public/folder/UsCVknVOOkSyCdgpMimJNQ/User-Materials/Test-Data/MTG/MTG_IRS_L1B_OneDwell-Sp%2BRR_TD-287_Dec2019/

Flexible Combined Imager (FCI)

An updated 26-h FCI L1c test dataset for format familiarisation has been released (TD-298), as an update to a previously delivered FCI L1c test dataset that was released to users in July 2020 (TD-272).

Dataset description

This test dataset contains 26 hours of FCI level 1C full-disc FDHSI data to be used for format familiarisation. The format for these data is derived from:

  • MTG Generic Format Specification, V4A
  • MTG FCI Level 0 & 1 Format Specification, V4C

Thus, providing a data format as close as possible to the data format of the future FCI data. The majority of variables and attributes have been filled with representative values. Remaining limitations are described in the package description. The term dataset refers to a number of associated files. In this case, the files of each dataset are all associated to an FCI repeat cycle.

No internal compression has been applied to this test dataset.

Package usage

SFTP access:

https://sftp.eumetsat.int/public/folder/UsCVknVOOkSyCdgpMimJNQ/User-Materials/Test-Data/MTG/MTG_FCI_L1C_Enhanced-26h_TD-298_Nov2021/

Documentation

Test data package description


Earlier releases of MTG user familiarisation test data

May 2020 – LI

On 27 May 2020, a simulated Level 2 dataset of the Lightning Imager for format familiarisation was released.

FTP access: https://sftp.eumetsat.int/public/folder/UsCVknVOOkSyCdgpMimJNQ/User-Materials/Test-Data/MTG/MTG_LI_L2_TD-57_May2020/

July 2020 - FCI

Following the provision in 2019 of simulated MTG FCI Level 1C datasets, we are now releasing enhanced FCI Level 1C datasets, including datasets with non-nominal data. These new datasets are short duration (one full disk repeat cycle) but are much more scientifically representative of future operational data than the 24-hour datasets provided in 2019. Both are complementary.

Dataset description

Two FCI level 1C datasets are provided for format familiarisation:

  • One nominal dataset which contains Full Disk High Spectral Imagery (FDHSI) data in nominal acquisition conditions.
  • One non-nominal dataset which contains FDHSI data with simulated missing data

Each of these datasets are provided in compressed and uncompressed versions. The compressed versions represent the data that will be disseminated in near real-time during MTG operations, while the uncompressed form is how the data will be archived.

All above datasets contain:

  • Full images of the Earth
  • 16 channels

The datasets are divided into 40 body chunk files and one trailer chunk file (chunk ‘41’) each.

Package usage

FTP access:

https://sftp.eumetsat.int/public/folder/UsCVknVOOkSyCdgpMimJNQ/User-Materials/Test-Data/MTG/MTG_FCI_L1C_Enhanced-NonN_TD-272_July2020/

The package contains the following files:

FCI_1C_UNCOMPRESSED_NOMINAL.tar.gz — nominal dataset

FCI_1C_UNCOMPRESSED_NON-NOMINAL.tar.gz — non-nominal dataset with simulated missing data

FCI_1C_COMPRESSED_NOMINAL.tar.gz — same nominal dataset above but with CharLS compression applied to selected variables

FCI_1C_COMPRESSED_NON-NOMINAL.tar.gz — same non-nominal dataset above but with CharLS compression applied to selected variables

FCI_1C_REFGRIDS.tar.gz containing three netCDF files, one for each FCI resolution, with computed latitude and longitude variables for all Earth pixels inside an FCI full-disk:

  • CM_OPE_GRIDDEF_MTI1+FCI_20190321090000_1km-V2.nc
  • CM_OPE_GRIDDEF_MTI1+FCI_20190321090000_2km-V2.nc
  • CM_OPE_GRIDDEF_MTI1+FCI_20190321090000_500m-V2.nc

sha256sum.txt file which contains the checksums for all files in the datasets

In addition, the following is provided on the FTP:

Decompression software
Product user guide

Documentation

Test data package description

June 2019 – FCI

The June 2019 release of simulated Meteosat Third Generation (MTG) Flexible Combined Imager (FCI) Level 1C data covers a 24-h period and is based on SEVIRI proxy data. These test datasets are intended for format familiarisation and system testing purposes.

Dataset description

The term 'dataset' refers to a number of files or 'chunks' associated to a FCI repeat cycle (one complete 10-minute Earth disc scan = one repeat cycle). Each dataset comprises several body chunk netCDF-4 files that contain observational data, one trailer chunk netCDF-4 file, and one RGB composite quick-look png file.

These simulated datasets are based on MSG SEVIRI data. They are in the final format and are highly representative of an operational FCI Level 1C dataset. They are intended for format familiarisation and system testing purposes.

Package usage

FTP access:

https://sftp.eumetsat.int/public/folder/UsCVknVOOkSyCdgpMimJNQ/User-Materials/Test-Data/MTG/MTG_FCI_L1C_24h_TD-241_Jun2019/

The datasets are provided in compressed and uncompressed versions:

  • Compressed version: The radiance data are compressed with the CharLS algorithm, as they will be when disseminated to users in near-real time during MTG operations. The ‘Compressed’ directory contains a set of tarred and zipped sub-directories (each one contains all the product chunks for a repeat cycle). There are also two check sum files (one for each repeat cycle and one for all chunks).
  • Uncompressed version: This is how the data will be archived. The ‘Uncompressed’ directory is set up in the same way as the ‘Compressed’ directory.

In addition, the following is provided on the FTP:

  • A decompression software, together with an installation guide and a user guide.
  • MTG EUMETCast simulator: The MTG EUMETCast simulator simulates the delivery of MTG products to a EUMETCast reception station. It uses 24 hours of MTG FDSS-FCI L1C test data and transfers the files to a specified target directory on EUMETCast reception station using ftp protocol, in the exact time of their delivery via EUMETCast.

Documentation

Product user guide

MTG test data package description - FCI L1C - 24h test data for users


Planned releases of test data

IRS L1B full-disc simulated dataset for format familiarisation (planned for release in Q2/2022).


Disclaimer

Test data are released exclusively for the purposes of facilitating user-preparedness. They are not to be used for operational purposes, nor are they to be cited in scientific publications or disclosed through unauthorised public channels and internet platforms. For further information please consult the Terms of Use for Special Provisions: test data.