Check Database Consistency Web Service - Revision history

Plazarou at 15:44, 16 April 2025

2025-04-16T15:44:53Z

Plazarou: /* Example Output */

2025-04-04T15:51:22Z

‎Example Output

Plazarou: /* Example Output */

2025-04-04T15:46:58Z

‎Example Output

Plazarou: /* Example Output */

2025-04-04T15:46:44Z

‎Example Output

Plazarou: /* Check Database Consistency Web Service */

2025-04-04T15:41:53Z

‎Check Database Consistency Web Service

Plazarou: /* Overview */

2025-04-04T15:35:11Z

‎Overview

Plazarou: /* Detail */

2025-04-04T15:34:26Z

‎Detail

Plazarou: /* Detail */

2025-04-04T15:33:45Z

‎Detail

Plazarou: /* Detail */

2025-04-04T15:32:09Z

‎Detail

Plazarou at 15:31, 4 April 2025

2025-04-04T15:31:40Z

@@ Line 1: / Line 1: @@
 [[Category:FMR_REST_API_Reference]]
 =Overview=
-The Fusion Metadata Registry (version 11), stores maintainable structures in a number of forms within its database. It is extremely unlikely that these formats become inconsistent, but a mechanism exists to check that the various formats are consistent. This mechanism is a simple Web Service that can be invoked by any user with administration privileges.
+The Fusion Metadata Registry (version 11), stores maintainable structures in a number of forms within its database. It is extremely unlikely that these formats become inconsistent, but a mechanism exists to check that the various formats are consistent. This mechanism is a simple Web Service that can be invoked by any user with administration privileges. This Web Service is available in FMR version 11.19.6 and later.
 ==Detail==
@@ Line 64: / Line 64: @@
   https://example.registry.com/ws/secure/structure/databaseconsistency

← Older revision		Revision as of 15:51, 4 April 2025
Line 52:		Line 52:

	This shows that the database is not consistent, and that 2,053 items were checked. Since the field 'DifferingSdmx' has an empty JSON array, the items in the table 'registry_maintainable_sdmx' do not differ to the metadata in memory. The field 'DifferingTxn" has a JSON array containing a single URN for the codelist SDMX:AAA(1.0). This means that the codelist stored in the table 'tx_backup' is not consistent with the codelist held in memory.		This shows that the database is not consistent, and that 2,053 items were checked. Since the field 'DifferingSdmx' has an empty JSON array, the items in the table 'registry_maintainable_sdmx' do not differ to the metadata in memory. The field 'DifferingTxn" has a JSON array containing a single URN for the codelist SDMX:AAA(1.0). This means that the codelist stored in the table 'tx_backup' is not consistent with the codelist held in memory.
		+
		+	To determine what the differences are, please refer to the log file of the Registry. An example of output stating the difference is:
		+
		+	WARN qtp258754732-94 io.sdmx.core.fmr.manager.report.DatabaseConsistencyChecker - Difference exists for : urn:sdmx:org.sdmx.infomodel.codelist.Codelist=SDMX:AAA(1.0)
		+	WARN qtp258754732-94 io.sdmx.core.fmr.manager.report.DatabaseConsistencyChecker - [EDIT,urn:sdmx:org.sdmx.infomodel.codelist.Codelist=SDMX:AAA(1.0),Name,AAA,AAA-Updated]
		+
		+	This shows that for this codelist, there is a difference ('EDIT') for the property ''''Name'''' and that in memory the codelist name is ''''AAA'''' but in the database it is stored as ''''AAA-Updated''''.

	==Examples==		==Examples==

@@ Line 35: / Line 35: @@
 * the number of maintainables that were checked
 * a JSON Array listing the URNs of Maintainable Structures that differ in the table 'registry_maintainable_sdmx'
-* a JSON Array listing the URNs of Maintainable Structures that differ in the table ''
+* a JSON Array listing the URNs of Maintainable Structures that differ in the table 'tx_backup'
 An example of the full output:

@@ Line 31: / Line 31: @@
 ==Example Output==
-The Web Service produces JSON output like the following:
+The Web Service produces JSON output stating the following:
 <pre>
+{
@@ Line 44: / Line 50: @@
+}
 </pre>
 ==Examples==

@@ Line 26: / Line 26: @@
 |}
-Note: Because the service has to talk to the back-end database, it may take a while to run. The time taken depends upon the speed of connection to the database and the number of structural metadata within your Registry.
+Note: Because the service has to communicate with the database, it may take a while to run. The time taken depends upon the speed of connection to the database and the number of structural metadata within your Registry. If you wish to see the progress of the Web Service inspect the Fusion Registry log. The process will write a number of log statements (at INFO level) which will state the number of the current item being checked, along with the total number of items to process. An example of a log entry showing that the process is at structure number 226 out of a total of 2,053 items is:
 ==Example Output==

@@ Line 8: / Line 8: @@
 * '''registry_maintainable_sdmx''': this table stores the SDMX-ML form of the individual metadata structure. This table is a backup for the "serialised" table. If an structure cannot be deserialsed, then the structure is obtained from this table.
 * '''tx_backup''': this table stores the SDMX-ML form of structures, grouped together by the transaction they were submitted within rather than storing each structure individually.
 ==Check Database Consistency Web Service==

@@ Line 5: / Line 5: @@
 ==Detail==
 The Fusion Metadata Registry stores structure metadata in the following tables:
-* '''registry_maintainable_ser''': the Java serialised form of the structure. This is loaded on application startup since it is faster than constructing a new Java object from the XML.
+* '''registry_maintainable_ser''': this table stores the Java serialised form of each individual metadata structure. There serialised objects are loaded on application startup, since it is faster than constructing a new Java object from the XML.
-* '''registry_maintainable_sdmx''': the SDMX-ML form of the individual metadata structure
+* '''registry_maintainable_sdmx''': this table stores the SDMX-ML form of the individual metadata structure. This table is a backup for the "serialised" table. If an structure cannot be deserialsed, then the structure is obtained from this table.
-* '''tx_backup''': the SDMX-ML form of structures, grouped together by the transaction they were submitted within rather than storing each structure individually.
+* '''tx_backup''': this table stores the SDMX-ML form of structures, grouped together by the transaction they were submitted within rather than storing each structure individually.
 ==Check Database Consistency Web Service==

← Older revision		Revision as of 15:31, 4 April 2025
Line 1:		Line 1:
		+	[[Category:FMR_REST_API_Reference]]
	=Overview=		=Overview=
	The Fusion Metadata Registry (version 11), stores maintainable structures in a number of forms within its database. It is extremely unlikely that these formats become inconsistent, but a mechanism exists to check that the various forms are consistent.		The Fusion Metadata Registry (version 11), stores maintainable structures in a number of forms within its database. It is extremely unlikely that these formats become inconsistent, but a mechanism exists to check that the various forms are consistent.