Click here to download report

Regional Training Workshop on Economic Statistics SDMX
24-28 February 2020, Manila, Philippines

Final Report – 10 Mar 2020

Organizers:
Asian Development Bank (ADB)
Association of Southeast Asian Nations (ASEAN)
EU-ASEAN Arise Project
United Nation Statistics Division (UNSD)

BACKGROUND

SDMX, which stands for Statistical Data and Metadata eXchange, is an ISO standard (17369) designed to describe statistical data and metadata, normalize their exchange, and improve their efficient sharing across statistical and similar organizations. It provides an integrated approach to facilitating statistical data and metadata exchange, enabling interoperable implementations within and between systems concerned with the exchange, reporting and dissemination of statistical data and their related meta-information. Further, SDMX was recognized and supported as a preferred standard for the exchange and sharing of data and metadata by UN Statistical Commission in 2008 (Decision 39/112 point (b)).

SDMX for International Merchandise Trade Statistics. An inter-agency working group consisting of Eurostat, the International Trade Centre (ITC), the Organization for Economic Cooperation and Development (OECD), the United Nations Statistics Division (UNSD), and the United Nations Conference on Trade and Development (UNCTAD) was established in 2013 with the purpose of specifying uniform structures, concept definitions and code lists for the transmission of IMTS data and metadata in accordance with SDMX. The working group, chaired by UNSD, had developed a first version of the Global Data Structure Definition (DSD) of SDMX standards for International Merchandise Trade Statistics (IMTS) in consultation with member countries in 2016. The DSD was submitted to SDMX Secretariat in early 2017 for review; and subsequently made public at UNSD website. In September-October 2017, UNSD conducted two pilot implementation projects in Mexico and Morocco resulting to amendment of DSD to the version 1.1 (2018). UNSD and AUC undertook SDMX-IMTS regional training workshops for African countries in September 2018 and February 2019. The workshop aimed to introduce global DSD of SDMX-IMTS and train staff of National Statistical Offices in data mapping and utilizing SDMX tools.

SDMX for System of National Accounts. The adoption of the System of National Accounts (SNA) 2008 the work on the associated transmission programmed created a new momentum for the alignment of international standards for the compilation and dissemination of macro-economic statistics. The SDMX sponsors (BIS, ECB, Eurostat, IMF, OECD, United Nations and World Bank) mandated the ECB, Eurostat and the OECD to propose Data Structure Definitions (DSDs) to implement SDMX in National Accounts according to the SNA 2008.This DSD is now available on the SDMX registry for: main national accounts aggregates, sector accounts, Supply-Use & Input-Output tables, and Government Finance Statistics. The international organizations involved in collecting national accounts data have commenced the exchange of this data using SDMX and are promoting the use of SDMX for country reporting in order to minimize burden.

The DSDs of SNA and IMTS are available at the SDMX Global Registry: https://registry.sdmx.org/data/datastructure.html

OPENING

Mr. Joseph E. Zveglich, Deputy Chief Economist of ADB, welcomed the participants and underlined the importance of SDMX due to single reason: there is no a single approach to data sharing and exchange, therefore, countries/organizations need to re-invest and re-invent repeatedly. Until the arrival of SDMX which harmonizes data models and backed by international organizations. This would lead to timely and more accessible data and statistics. He re-iterated full support to this initiative.

Ms. Eden Lumilan, Head of UN Resident Coordinator’s Office described that seamless data exchange is a key component to monitor implementation of Agenda 2030 to disseminate data in a timely matter. This is also critical for a regular review mechanism. Besides, this is also related to the growth of internet-connected devices as part of the data revolution initiative. She thanked the host and partners in organizing the workshop and welcome all participants.

Mr. Sueka Putra from ASEAN Secretariat recounted the past SDMX training workshop with Eurostat for ASEAN Data Dissemination Working Group in 2019. The training provided the first insight and knowledge about SDMX including challenges in their implementation. He indicated that the community of experts in SDMX will be established in the near future to assist ASEAM member states.

Finally, each organization made a presentation on their activities of International/Regional Organization in the area of SNA, IMTS, and SDMX.

SESSION 1: Country Presentations on SDMX Activities

Main points

  • In general, countries recognize the overall benefits of SDMX in streamlining data dissemination and reporting (i.e., reducing reporting burden)
  • Several ASEAN countries have eGDDS portal which offers dissemination of macro-economic and financial statistics in SDMX
  • Few countries have integrated SDMX into their national data strategy (i.e., long term transformation plan)
  • There was concern on data dissemination policy including the level of details for data dissemination
  • In the decentralized system, it is crucial to reach out to other agencies which are responsible for data dissemination in certain domains

Representatives from all ASEAN countries (Brunei was connected through Skype) made a presentation on the status of SDMX in countries focusing on the following subjects:

  • Working SDMX relationships with international/regional organizations
  • The current status/plan in applying SDMX including information about which SDMX domains are being implemented and/or in which data production cycle (i.e., collection, dissemination)
  • Challenges/benefits in implementing SDMX


SESSION 2: Overview of SDMX

Main points

Experts from UNSD introduced SDMX concepts notably information model, content-oriented guidelines, IT architecture, concepts scheme, code lists, and data structure definition. It was followed by a general discussion.

BREAKOUT SESSION 2.1: International Merchandise Trade Statistics

Participants were shown the latest developments on IMTS including a summary of its concepts and definitions related to SDMX data structure definitions. It was followed by a detailed explanation of IMTS DSD artifacts; concept scheme, code lists, dimensions, and attributes. Finally, participants conducted generic mapping exercises from national to SDMX codes (i.e., Customs Procedure Codes).

BREAKOUT SESSION 2.2: System of National Accounts

A series of presentations explaining the ongoing initiatives on SDMX for SNA were presented, as well as a detailed explanation of the available SDMX artifacts for SNA. Later, the participants were introduced to the ILO SMART tool for mapping local databases to SDMX dataflows. Towards the end of the session, a mapping exercise from NAQ to SDMX using a sample dataset.

BREAKOUT SESSION 2.3: IT

Participants were introduced to SDMX-RI tools (https://ec.europa.eu/eurostat/web/sdmx-infospace/sdmx-it-tools/sdmx-ri). These tools included SDMX Mapping Assistant, SDMX Test Client and SDMX Web Services. After introduction to the tools, participants were assisted to install and use the tools on their computers using their own datasets and provide SDMX outputs.


SESSION 3: Self-Paced Hands-on Exercise (Generic Data)

Main points

  • Most participants were able to follow the exercise to produce SDMX output from generic data file and mapping


UNSD expert presented SDMX tools used in this session, notably SMART tools and SDMX-RI from ILO and Eurostat, respectively. Then participants undertook hands-on exercise using those SDMX tools by applying a pre-prepared generic data file.

SESSION 4: Self-Paced Hands-on Exercise (Own Data)

Main points

  • Most participants were able to follow the exercise to complete mapping exercise from national codes to SDMX codes and to produce SDMX output utilizing own data file

This session was a continuation from the previous session of “Self-Paced hands-on Exercise Using Generic Data”. The participants were expected to apply their knowledge of SDMX, DSD of SNA/Trade and SDMX tools in order to generate SDMX output. In addition, experts from UNSD presented a step-by-step guide on using SMART tools. At the end of the day, participants shared their original data, mapping file and result in SDMX.

SESSION 6: Disseminating in SDMX

The session was started by undertaking a review on transforming own IMTS and SNA data into SDMX. Best practices from the previous day were shared and explained for future references. The main challenge was to transform data from the original format to the format required by tools. After reviewing, the session was closed by presentation and demo on another set of tools on dissemination: SDMX loader and SDMX browser. In addition, website visualizing data using SDMX was also shown.

MAIN CONCLUSION

The participants of the workshop:

  1. Shared that they were able to understand SDMX and follow exercises to produce SDMX output. This positive outcome of the workshop has significantly increased their confidence to be able to convert their data into SDMX.
  2. Recognized that SDMX is a useful way to disseminate and exchange data utilizing reducing reporting burden, and at the same time also recognized challenges in accurately conducting map national data elements to SDMX codes.
  3. Appreciated Eurostat and ILO which have made the SDMX tools available not only in the workshop but also in the regular production of SDMX data. Besides, the participants requested international/regional organizations to develop step-by-step training materials in using the tools.
  4. Requested technical assistance on designing data structure definitions using SDMX standards to further implement SDMX not only at the dissemination phase but also at collecting and/or processing phases at the national level. This may increase overall efficiency in internal data exchanges among national agencies.
  5. Concluded that even though SDMX has a clear advantage in data dissemination and reporting, it is necessary to have support from higher management. In this regard, ADB, ASEAN, and UNSD would continue promoting SDMX to all levels of management. Besides, continuous support and training would be also crucial for the successful implementation of SDMX.
  6. Agreed to continue exploring SDMX with the aims of regional/international data reporting. In this regard, if necessary, ADB, ASEAN, and UNSD are ready to provide technical assistance in collaboration with development partners and SDMX sponsors organizations that have some experience and expertise in SDMX such as UNSD, Eurostat. At the same time, these join activities should lead to building a community of SDMX subject matter and IT experts in the region. 

ANNEX: USEFUL LINKS

ANNEX: List of Participants