Overview
Product Features The solution offers a centralized metadata catalog and schema registry, data lineage tracking, and quality validation. It supports policy-based access control and auditing, hybrid deployments (on-prem for development/testing and AWS EKS for production), Kubernetes microservices architecture with Prometheus/Grafana observability, and integrates with AWS services like S3, RDS/Aurora, IAM, CloudWatch, and Secrets Manager. Security is ensured via RBAC, IRSA, TLS, and KMS encryption.
Product Benefits It unifies metadata management, data quality, and governance, accelerates cloud adoption with flexible hybrid deployment options, and guarantees data trust, regulatory compliance, and scalability. The platform reduces manual tasks through automation and integration, fostering cross-functional collaboration among diverse data roles.
Product Usage Users deploy the solution on Amazon EKS (Kubernetes 1.27+), connect data sources to ingest metadata, define data quality rules and governance policies, monitor systems via CloudWatch and Grafana, and manage operations with OpenMetadata UI and Apache Ranger.
Other Information The product is production-ready and actively supported, delivering a unified, secure data governance solution on AWS EKS. It features stateless microservices, encrypted storage, and VPC isolation. Security mechanisms include RBAC, IRSA, TLS, audit logging, and KMS encryption. Performance is optimized with horizontal pod autoscaling, multi-AZ RDS, and asynchronous validation for large datasets. Typical users are data engineers, stewards, compliance officers, and analysts. It depends on Amazon EKS, RDS/Aurora, S3, IAM, Helm, and kubectl, and stands out as an AWS-native, open-source core solution providing real-time compliance capabilities.
Highlights
- Provides a unified catalog with automated metadata ingestion, data lineage tracking, and schema discovery across all data sources.
- Enables rule-based profiling and real-time data quality checks to ensure trust in analytics and reporting.
- Uses Apache Ranger and IAM integration to enforce fine-grained access policies and audit trails for compliance and security.
Details
Unlock automation with AI agent solutions
