3 apps Collibra
OpenMetadata screenshot thumbnail

OpenMetadata

OpenMetadata builds a unified knowledge graph connecting schemas, tables, columns, dashboards, pipelines, ML models, and data products into one searchable catalog accessible at port 8585. The ingestion framework ships 130+ connectors covering Snowflake, BigQuery, Redshift, Databricks, PostgreSQL, MySQL, Kafka, Airflow, dbt, Tableau, Looker, Power BI, Metabase, and Superset, automatically extracting metadata on configurable schedules. Column-level lineage traces data flow across transformations, joins, and aggregations, while built-in data quality testing executes profiling and validation rules as data contracts with automated alerting on failures. Governance features include role-based access control, PII auto-detection, glossary term propagation, and domain-based ownership assignment. The native MCP server and AI SDK expose semantic search, lineage queries, and governance metadata as tools any LLM agent can call, enabling AI systems to discover and reason about enterprise data with full trust context. The architecture requires only PostgreSQL or MySQL plus Elasticsearch, no Kafka, no graph database, and deploys via a single Docker Compose file. Created by the founders of Apache Hadoop, Apache Atlas, and Uber's Databook, the platform has earned over 14,700 GitHub stars and adoption by 3,000+ organizations. Apache 2.0 licensed.

Deploy
DataHub screenshot thumbnail

DataHub

DataHub maps your entire data ecosystem into a searchable, governed catalog where every table, pipeline, dashboard, and metric is discoverable and traceable from source to consumer. Originally built at LinkedIn to manage metadata at hyperscale and proven to handle 10 million+ assets and billions of relationships in production, the platform is now trusted by 3,000+ organizations including Netflix, Visa, Slack, and Pinterest. The Spring Java backend (GMS) exposes both GraphQL and OpenAPI REST endpoints, while the React frontend delivers an intuitive interface for searching, browsing, and governing data assets. The Python-based ingestion framework provides 80+ production-grade connectors extracting deep metadata from Snowflake, BigQuery, Redshift, Databricks, dbt, Airflow, Spark, Kafka, Looker, Tableau, Power BI, Superset, PostgreSQL, MySQL, Hive, Glue, S3, Iceberg, and Unity Catalog through pull-based scheduled crawls and push-based emission via Python and Java SDKs. Automatic table-level and column-level lineage detection uses SQL parsing with 97-99% accuracy, tracing data flows from ingestion pipelines through warehouses to BI dashboards. Real-time metadata streaming via Kafka keeps the catalog continuously synchronized as schemas evolve and pipelines execute. The governance layer provides business glossary management, tag propagation along lineage graphs, domain-based organization, and fine-grained access control policies. DataHub Actions triggers automated responses to metadata changes, enabling notifications, quality checks, and downstream workflows. Elasticsearch powers full-text search with faceted filtering across entities. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.

Deploy
Marmot screenshot thumbnail

Marmot

Cataloging tables, topics, queues, and APIs across fragmented data stacks usually demands heavyweight enterprise governance suites, yet Marmot delivers fast full-text asset discovery and AI-ready metadata context in a single self-hosted service. Data engineering and platform teams use its 71 official plugins to automatically ingest schemas, run histories, and dependencies from Apache Kafka, Airflow, Iceberg, Superset, PostgreSQL, BigQuery, and AsyncAPI specifications without moving raw table rows or message payloads. From the web interface, analysts can run structured boolean queries, filter assets by custom tags or PII classifications, and inspect column-level schemas in seconds. Interactive upstream and downstream lineage graphs let engineers trace how events flow from message brokers into warehouse tables and BI dashboards so they can assess what breaks before renaming a column or deprecating an endpoint. Shared business glossaries, bidirectional ownership assignments, and curated data product bundles ensure every department speaks the same language and knows exactly which team maintains each pipeline. Through the built-in Model Context Protocol server, AI assistants in Cursor, Claude Desktop, and LibreChat can invoke tools like discover_data, find_ownership, and lookup_term to answer natural-language questions against live catalog metadata instead of guessing. Platform administrators can also manage catalog resources declaratively using the REST API, CLI, Terraform provider, or Pulumi integration. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy