Category: AWS Glue

Learn how to build scalable, real-time data lakes by combining Amazon S3 Tables with Snowflake integration. This solution enables efficient streaming data ingestion and analysis while automatically managing table optimization and maintenance. Discover how manufacturing companies can leverage this architecture to transform IoT sensor data into actionable insights, combining operational analytics with predictive maintenance capabilities. The integration between S3 Tables and Snowflake, along with SageMaker Lakehouse’s Iceberg REST endpoint, creates a robust foundation for streaming analytics that can handle high-volume data streams while maintaining performance and security.

Effective aftermarket management can boost revenue, profitability, and customer loyalty for equipment manufacturers. Syncron’s Service Lifecycle Management platform addresses challenges like siloed operations and high costs by consolidating aftermarket activities on AWS. This unified approach aligns decision-making, enhances agility, and enables data-driven insights across departments. The platform offers instant data access, analytics capabilities, and the ability to create custom data products, transforming raw data into actionable intelligence that drives efficiency and profitability in aftermarket operations.

This post explains how Shorthills AI’s collaboration with AWS and DataStax’s Astra DB employs advanced search technologies and natural language processing for enterprise search. This collaboration supports customers making data driven business decisions by leveraging AWS’s enterprise-grade security features alongside DataStax’s high-performance vector search capabilities.

Data governance becomes increasingly important for Customers building large data lakes on Amazon Web Services (AWS) to democratize their access to data. AWS Lake Formation provides fine-grained data access permissions for AWS services like Amazon Redshift, Amazon Athena, and Amazon EMR. Dremio supports AWS Lake Formation data governance framework to create a consistent governance model for enterprise customers.

TCS partnered with a leading Australian bank to implement Consumer Data Right (CDR) compliance through an open banking solution, enabling secure data sharing for 400,000+ customers while maintaining existing banking operations. The solution architecture leverages AWS services including Amazon Kinesis Data Streams, AWS DMS, Data Firehose, Glue, and Aurora MySQL to process 6 million records daily in real-time, with comprehensive security controls and 99.99% uptime. The implementation demonstrates TCS’s expertise in creating scalable, secure enterprise data platforms that enable financial institutions to modernize their data streaming capabilities while protecting core operations and meeting regulatory requirements.

Discover how AWS Partner Genese Solution transforms data analytics with Gandalf Insights, enabling business users to query complex databases using natural language. Learn how this AWS-powered solution reduces time-to-insight from days to minutes while decreasing IT support costs and improving business team autonomy.

HCLTech’s Intelligent Ingestion solution provides automated low-code to no-code approach, simplifying ETL build efforts for both batch and real-time data ingestion workloads. It is built using rich set of AWS services like AWS Step Functions, AWS Glue, AWS Glue DataBrew, AWS Lambda, AWS Lake Formation, Amazon Kinesis, Amazon S3, Amazon Simple Notification Service (SNS), etc., among other services to achieve seamless data integration, transformation and quality assurance. This solution entirely automates ETL ingestion upon a single click (event trigger) and provides reusable ETL workflows for rapid ETL development. It also brings quick actionable insights and decision making into business.

By Israel Mendes, Data Engineering leader – Caylent By Washim Nawaz, Analytics Specialist – AWS By Isaac Owusu-Hemeng, Customer Solutions Manager – AWS By Muz Syed, Sr. Partner Solutions Architect – AWS Caylent  In this post, we will discuss how APN Premier partner Caylent leveraged a 3-Day Experience Based Acceleration (EBA) workshop to finalize and […]

The Amazon Athena web-based query editor enables data consumers to author and run SQL queries on data sources that are registered with the AWS Glue Data Catalog and other data sources such as Amazon S3. This post describes the setup to provide federated access with OneLogin as the identity provider to securely access, author, and run queries in the Athena web-based editor via the AWS console, without the need for users to install a JDBC driver or run a SQL client on their machines.

It can be challenging for companies to consolidate data from multiple sources into one system, which is why many use AWS Glue to build ETL workflows to load their data into data lakes. Learn how AWS has collaborated with Protegrity to enable organizations with strict security requirements to protect their data while being able to obtain the powerful insights. We’ll demonstrate how data tokenization for data in transit is performed using Protegrity’s Cloud API and AWS Glue.