Welcome to the Meta-Data Service Documentation Web

This website is for the documentating the design, issues and work process associated with metadata service and changes. Contributors include DataWebTeam , DavidHisel

Design

Replication

Design Issues

Replication

• Issues
  • Should we roll our own replication so that the transaction is the load of a complete dataset's metadata, meaning that the entire metadata is rolled back?
    • Can we use MySQL 's replication
    • Should we just use XML and load each replicated system individually?
    • It has to run on socket 80 or 334
    • It has to scale massively, what is the time to load metadata?
  • Shouldn't we use private key / public key to insure that no one is loading illegal metadata on the hub?
  • Shouldn't we use private key / public key to insure that no replicating MySql data is illegal.

Work Process Notes, Status etc.

Replication
1. MySQL replication - at this point, will replicate only those tables used by SSD

DID will set up an instance for testing purposes SSD will provide the following info for DID: host for slave and tables for replicating After successful testing, the Master will be located in outside DMZ (pronghorn); Slave will be located in internal DMZ (develop.ssd.census.gov)

2. Change in process of updating SSD items in ferret database (done in parallel with MySQL replication step described above)

DID will provide URL (and instructions) for uploading XML files with updates (using the test instance described above) DID will provide URI for retrieving long description files

3. Replication using DID's standard java mechanism thru port 80: DID will schedule a future meeting to discuss architecture, plans for testing and implementing java replication, and utilizing web services for requests

4. DID access to SSD data repository -

SSD will work with CsVD to arrange for a new blade to hold the repository, tomcat, and associated software. DID will provide documentation to SSD on required software and configurations for tomcat ,etc.

EmailTraffic