Overview

This section of the documentation contains helpful guides for setting up and troubleshooting datastores in Metamapper.

Supported Datastores

Metamapper currently supports automatic crawling and indexing of these database management systems with plans to add more in the near future.

• Amazon Redshift
• AWS Athena
• AWS Glue Data Catalog
• Azure SQL Database
• Azure Synapse
• Google BigQuery
• Hive Metastore
• Microsoft SQL Server
• MySQL
• Oracle
• PostgreSQL
• Snowflake

Safety

The Metamapper team wants to minimize the impact Metamapper has on your databases.

It can make sense to connect Metamapper to a read-replica so that you can isolate syncing from your production workloads. But some databases (e.g., Snowflake and Redshift) do not have support replicas.

That is why the database connectors are designed to have the lowest possible computational footprint. We accomplish this by having the entire sync process operate off a single query that we cache and use in downstream processes. This means we are most issuing a single query to your database per scheduled run.

Open Source

Metamapper is an open source project. The database connectors it uses are publicly available.

Don't see your datastore on this list? Pull requests (or even just a feature request) are always appreciated.