Enabling hybrid cloud workflows on StorageGRID with AWS

Hybrid cloud models are reshaping how organizations across industries are functioning now and will function in the future. Hybrid cloud is enabling businesses to combine private and public cloud capabilities—a necessity for customers who need to leverage the benefits of both. The hybrid cloud approach helps customers become more agile and efficient in managing their resources as their business needs change. NetApp^® StorageGRID^® is on this journey to help customers enable hybrid cloud in their environments. StorageGRID services like CloudMirror, event notification service, and search integration service help make data available to various cloud services on the public cloud.

This blog focuses on how you can make a StorageGRID bucket available to services in AWS using the event notification service, which is part of our platform services and lambda function on AWS services.

• Appropriate permissions to access Amazon Simple Notification Service (Amazon SNS) and lambda services on AWS.
• SNS topic on AWS with email and lambda function as the endpoints. Copy the ARN ID of the SNS topic.
• IAM access keys to access Amazon SNS service on AWS.
• StorageGRID tenant account with appropriate level of permissions to create platform services endpoints.

Follow these steps to enable SNS notification and lambda function on your StorageGRID bucket.

1. In your StorageGRID tenant UI, select S3 > Endpoints.

To test this configuration, you can add an object in your StorageGRID bucket. You should receive an email message from AWS SNS similar to the following screenshot, detailing various metadata associated with your object. This confirms that your SNS notification part is working.

Now let’s set up the lambda function on AWS to take actions on the newly ingested object in StorageGRID. Here is a sample lambda function in Python to help you get started writing lambda functions for StorageGRID. After you deploy this code on your lambda function, test the function by ingesting an object in your StorageGRID bucket. You can then check for logs in CloudWatch—select the Monitor tab in your lambda function and then select View Logs in CloudWatch. This concept can be extended by enabling lambda functions to help you interact with many other services in AWS, such as MediaConvert, MediaLive, Rekognition, and SageMaker.

A hybrid cloud workflow that helps you enable your data to be available on AWS services adds tremendous value to your on-premises data. StorageGRID reduces the complexity of enabling hybrid cloud workflows and brings significant benefits to organizations in terms of cost, agility, and compliance. Various services that are available on AWS could be helpful for your organization. Make your on-premises data on StorageGRID available to these services with StorageGRID platform services and get the best out of both public and private cloud.

To learn more about how StorageGRID object storage can benefit your environment, visit the StorageGRID page.