Data & Database Migration Services

What is a data or database migration?

At its core, a data migration is the process of either:

  1. converting data from one format into another
  2. moving data from one storage location to another, or
  3. a combination of both; that is, converting from one data format into another, while also changing the storage location.

Who needs a data or database migration?

This is a good question. While more often than not, companies that require some kind of data or database migration will certainly know that they need it, but there are a fair number of cases where business don't necessarily know that they could benefit from a data or database migration. For example, with technological advances and new and improved software being released quite often, companies look to upgrade their legacy systems to benefit from the improvements and features that are present within new software and platforms. But simply purchasing a new software system, or subscribing to a Software as a Service (Saas) provider is just the first step. The implementation of this new software often times will require more than just the installation and configuration. One of the leading questions for any legacy system upgrade is - how do I get all my data and content from my old system, into my new system?

While this is just one example of a case where a company could or would require a data migration (eg. a legacy system upgrade - see our Migrate Legacy System service page for more information on this specific case), below are some other instances to describe who might require a data or database migration:

  • A company changing its backend database (eg from MS Access to MySQL)
  • A company upgrading from a legacy system
  • A company seeking analysis or reports on unstructured data
  • A company seeking analysis or reports on fragmented data (eg, company has 10,000 CSV or Excel files but has no way to run reports against that data)
  • A company that needs data to be accessible from a storage location, but the data is currently located elsewhere
  • A company that requires the format of their data to be changed

Examples of data & data migration services we have delivered to clients

Below are just a few examples of data & data migration services that we have rendered for clients across the world:

Client's Industry Client's Objective Our Service Delivery / Solution
Manufacturing Our client was headquartered in Sweden and manufactured large mining equipment. The had 8 different sites across the world that produced technical documentation (eg, Parts Catalogs, Technical Service Manuals, Safety Bulletins etc), and most of the sites were using different legacy systems. Our client purchased a new SaaS system for all of their technical documentation, and required all of their legacy technical information to be migrated into the new SaaS system. Our client used various legacy systems, including LinkOne, Catbase, SparePort2, and some home grown systems. Our solution involved us writing enterprise level custom migration software that could ingest the data from each of these various legacy systems, analyze it, convert it according to our client's specific business rules (which could vary across sites or regions), and ultimately produce XML and SVG files that could be published into the target SaaS system. We also wrote tools to integrate with the SaaS system's APIs in order to bulk publish all of the converted content.

In total, we migrated:
  • 1,000,000+ parts
  • 300,000+ Engineering Bills of Material (BOMs), aka assemblies
  • 100,000+ Engineering Diagrams
  • 15,000+ Parts Catalog Manuals
  • 100,000+ Related Technical Manuals (TSMs, Service Manuals, Safety Bulletins, etc)
Non-Profit Our client works with non-profits, and just recently the IRS made all IRS Form 990s publicly available via large CSV files (the listing), and all of the actual Non-Profit Form 990's by company by year available via an XML API. Our client tasked us with ingesting all of this new IRS data into a brand new MySQL database, so that the data could be much more easily searched and analyzed (since the IRS provided only the lists, and the forms as XML, with no easy way to analyze or search the data). Because the Form 990 data was in XML format, and the schema for these XML documents has changed from year to year, and from version to version, it made this task quite challenging. Rather than trying to write a custom conversion plugin for each of the schemas, we instead wrote a single, but completely dynamic, tool that could handle all of the forms and ingest all of the data into a database, regardless of which IRS Form 990 Schema it came from.

In total, we migrated:
  • 1,000,000+ Index Entries
  • 1,000,000+ Form 990 Documents
In addition, we created a web application to search through the non-profit data and provide useful reports about non-profits over the last 20 years (eg, by income, location, industry, etc).
Legal Our client had a website with a large backend database hosted with one hosting provider, and was looking to have all of their content (their website, database, email sub-system, forms, documents etc) migrated over to a new host. Our solution was to develop a plan to migrate all of their content and data, without incurring any data loss during the migration period, and with as little downtime as possible. We ensured that we were able to accurately aggregate all of their content, files and artifacts, as well as all of the data and records in their database.

In total, we migrated:
  • 100,000+ files and documents
  • 55,000+ records

Inquires about a data or database migration

If you or your company would like to inquire about working with Data Migration Services Services to perform a database or data migration for you, please contact us or use our free consultation form page to request a free consultation with one of our Lead Solutions Architects.