Sold by: GlobalLogicÂ
Build a scalable data quality & validation pipeline using the modular and extensible Data Platform components to perform checks on data quality of the data being brought into the data lake. It can also be used to compare the completeness and accuracy of the data across the source and target data sources.
Overview
GlobalLogic offers a trial service with focus on performing data quality & validation of data on AWS cloud based Data Platform.
The Data Quality and Validation Accelerator is a module under GL Data Platform which provides the component library required to perform different validation and quality checks. The components in the library are PySpark code that can be deployed and executed in any Spark environment like AWS Glue.
The accelerator allows the user to provide the required source, sink, transformations and validations on a source & target datasource through a simple YAML based configuration file. This module can help considerably reduce the effort required in developing custom integration and validation solutions.
The free trial includes:
- Setup an AWS Glue environment by following the instructions as documented in the GitHub .
- Running a bunch of pre-defined validation rules across a CSV and Parquet data stored in AWS S3 storage
- Review the validation output for the returned results
The GL Data Quality and Validation accelerator provides a modular and scalable framework that can be deployed on cloud serverless Spark environments to validate a variety of sources. Reach out to us at  dpa@globallogic.com on your needs and we would be happy to discuss with you on the next steps.
Highlights
- Centralized and unified data quality & validation setup for data lake infrastructure on cloud.
- Standard Architecture leveraging Industry best practices using cloud native PAAS technologies
- Modular, flexible and extensible template based framework that allows customisations at run time, enabling easy to create tailored solutions
Details
Sold by
Categories
Delivery method
Deployed on AWS
Unlock automation with AI agent solutions
Fast-track AI initiatives with agents, tools, and solutions from AWS Partners.
Pricing
Custom pricing options
Pricing is based on your specific requirements and eligibility. To get a custom quote for your needs, request a private offer.
Legal
Content disclaimer
Vendors are responsible for their product descriptions and other product content. AWS does not warrant that vendors' product descriptions or other product content are accurate, complete, reliable, current, or error-free.
Resources
Vendor resources
Support
Vendor support
For further inquiries on scope and the consulting service, please reach out to: Â dpa@globallogic.comÂ
Software associated with this service
TPC-DS connector for AWS Glue
By Amazon Web Services
Generate the TPC-DS compliant datasets from AWS Glue.