AWS Storage Blog
Category: Advanced (300)
Securing AWS Transfer Family with AWS Web Application Firewall and Amazon API Gateway
AWS Transfer Family is a fully managed, serverless file transfer service for Amazon S3 and Amazon EFS. The service provides you with the flexibility to authenticate your file transfer client users using credentials stored in an identity provider (IdP) of your choice. You can achieve this by integrating an Amazon API Gateway endpoint backed by an AWS Lambda function that […]
Secure data recovery with cross-account backup and Cross-Region copy using AWS Backup
UPDATE: On April 12, 2021, AWS announced support for copying Amazon FSx file system backups across AWS Regions and AWS accounts. For more information, read this blog post on cross-Region and cross-account backups for Amazon FSx using AWS Backup. There are many benefits to using more than one AWS account, including resource and operational isolation, disaster […]
Implementing sensor workflows using AWS Snowcone and AWS IoT Greengrass
In our first blog of this series, we covered using an IoT device to store the sensor data on an Amazon EC2 instance running on AWS Snowcone. That use case covered collecting data from sensors in locations such as a factory floor or a mine with austere network connectivity. There are other instances where you […]
Video transcoding at the edge with AWS Snowcone
A customer doing video analysis in remote locations has the following problem: they must capture high-resolution video in the field and then transfer that data to a durable, highly available data store in the cloud for long-term storage. They also want to keep copies of video files in the remote location so that they can […]
Using job tags to manage permissions for Amazon S3 Batch Operations jobs
As organizations grow their use of AWS, they often find that a variety of teams and applications begin to use the data stored in Amazon S3. While customers love the agility benefits of this, they also seek to govern their data’s security, productivity, and cost. Earlier this year we announced support for job tags with […]
AWS re:Invent recap: Modernize your applications with Amazon EFS
Development teams are modernizing their applications by adopting containers, serverless, and microservices-based architectures. As containers are transient in nature, long-running applications can benefit from keeping state in durable file storage. At the same time, serverless computing enables you to be more agile while spending less time dealing with the security, scalability, and availability of your […]
Running Kubernetes cluster with Amazon EKS Distro across AWS Snowball Edge
AWS Snowball Edge customers are running applications for edge local data processing, analysis, and machine learning using Amazon EC2 compute instances on Snowball Edge devices in remote or disconnected locations. Customers use Snowball Edge devices in locations including, but not limited to, cruise ships, oil rigs, and factory floors with no or limited network connectivity. […]
From on premises to AWS: Hybrid-cloud architecture for network file shares
Enterprises often operate on-premises file servers or Network Attached Storage (NAS) to provide a centralized solution for storing and accessing user and enterprise data, such as workflow backups. Most organizations acknowledge that having a centralized solution has its practical advantages, but it also comes with inherent challenges of setting up and maintaining storage infrastructure at […]
Building a central asset register with Amazon S3 Inventory
UPDATE 7/12/2022: Amazon SQS policy updated to support every AWS Region (step 3 in the architecture diagram) in the central.yml template. Many AWS customers store millions of objects in their Amazon S3 buckets, due to the scalability, durability, and performance that S3 provides. Customers compelled to build an information asset register for compliance reasons or […]
Persistent storage for container logging using Fluent Bit and Amazon EFS
UPDATE 9/8/2021: Amazon Elasticsearch Service has been renamed to Amazon OpenSearch Service. See details. Logging is a powerful debugging mechanism for developers and operations teams when they must troubleshoot issues. Containerized applications write logs to standard output, which is redirected to local ephemeral storage, by default. These logs are lost when the container is terminated […]