AWS Storage Blog
Category: Advanced (300)
Creating an ETL pipeline trigger for existing AWS DataSync tasks
Organizations look for ways to leverage the compute power of the cloud to analyze their data and produce reports to help drive business decisions. They want to load their data sets into extract-transform-load (ETL) pipelines for data processing. Once the data is processed, business decision makers at these organizations rely on accurate report generation to […]
Increase your recovery point agility with custom snapshot policies on Amazon FSx for NetApp ONTAP
Data has become a vital asset for individuals and businesses alike. As data continues to grow at an unprecedented pace, it becomes increasingly important for organizations to have robust data management solutions in place that address specific data protection and recovery requirements. When making decisions on how to achieve their recovery point SLAs, customers evaluate […]
Implementing HA and DR for SQL Server Always-On Failover Cluster Instance using Amazon FSx for NetApp ONTAP
One of the most difficult challenges organizations face today is ensuring data availability and accessibility across their locations. Maintaining high availability and accessibility for SQL Server databases across different AWS Regions is a top data protection requirement for enterprises considering moving to the cloud. Amazon FSx for NetApp ONTAP offers a quick way to fail […]
Migrating Azure Blob Storage to Amazon S3 using AWS DataSync
UPDATE (7/25/2023): AWS DataSync now supports copying data to and from Azure Blob Storage, view the what’s new post and view our video for more information. UPDATE (3/26/2024): When deploying the AWS DataSync agent, this repository contains a script designed to convert the DataSync Agent VHDX to VHD on Amazon Linux 2 (AL2), and upload […]
Using Quality of Service in Amazon FSx for NetApp ONTAP
When building file systems in the cloud, one major advantage is that administrators are no longer constrained by the traditional large storage controller. This makes the entry point much lower, which means that they can provision individual file systems for each workload. However, customers may occasionally have to combine workloads into a central file system. […]
Building a disaster recovery site on AWS for workloads on Microsoft Azure
Some enterprises run their IT operations using a multi-cloud environment, often for compliance, cost, or redundancy reasons. At times, these enterprises may be required to host a copy of their data, or even a full disaster recovery (DR) solution, on another cloud provider to provide an additional layer of protection. In this post, we show […]
Data migration and cost saving at scale with Amazon S3 File Gateway
Migrating data to the cloud requires experience with different data types and the ability to preserve source data structure and metadata attributes. Customers often have on-premises file data stored on traditional file servers, retaining original timestamp of data creation for varying reasons including data lifecycle management. Customers find it challenging to identify a path to […]
On-demand archival and retrieval of documents from Amazon WorkDocs to Amazon S3
Cloud storage of documents has seen rapid growth over the years as more and more customers and businesses move away from traditional physical storage. As the size and number of documents continue to grow, customers want to manage their documents and retain them using long term, durable, cost-effective document archives. Businesses such as medical research […]
Automatically compress and archive satellite imagery for Amazon S3
Satellite imagery often comes as large, high-resolution files, and organizations that work with this data typically have high storage costs. Additionally, large imagery files can take time and resources when downloaded for use with machine learning (ML), data analytics tools, or manual analyst review. Using standard compression techniques lets us achieve reductions in file size […]
Large scale migration of encrypted objects in Amazon S3 using S3 Batch Operations
Many organizations have data governance strategies or compliance requirements that mandate their data be replicated and redundant across different management accounts and global regions. Moving encrypted data at scale can often take a few additional steps due to the need to decrypt and re-encrypt objects as part of the replication process. Amazon Simple Storage Service […]