Menu

Enabling hybrid cloud workflows on StorageGRID with AWS

looking down at desk
Table of Contents

Share this page

Image of Joseph Kandatilparambil
Joseph Kandatilparambil
194 views

Hybrid cloud models are reshaping how organizations across industries are functioning now and will function in the future. Hybrid cloud is enabling businesses to combine private and public cloud capabilities—a necessity for customers who need to leverage the benefits of both. The hybrid cloud approach helps customers become more agile and efficient in managing their resources as their business needs change. NetApp® StorageGRID® is on this journey to help customers enable hybrid cloud in their environments. StorageGRID services like CloudMirror, event notification service, and search integration service help make data available to various cloud services on the public cloud.

hybrid cloud model

This blog focuses on how you can make a StorageGRID bucket available to services in AWS using the event notification service, which is part of our platform services and lambda function on AWS services.

Prerequisites

  • Appropriate permissions to access Amazon Simple Notification Service (Amazon SNS) and lambda services on AWS.
  • SNS topic on AWS with email and lambda function as the endpoints. Copy the ARN ID of the SNS topic.
  • IAM access keys to access Amazon SNS service on AWS.
  • StorageGRID tenant account with appropriate level of permissions to create platform services endpoints.

Follow these steps to enable SNS notification and lambda function on your StorageGRID bucket.

  1. In your StorageGRID tenant UI, select S3 > Endpoints.
Image of steps to follow
2. Click Create to create a new endpoint, fill in the required fields, and click Save.
Image of steps to follow
3. In the StorageGRID tenant UI, select S3 > Buckets.
Image of steps to follow
4. Click the bucket to enable SNS and then select Configure Notifications.
Image of steps to follow
5. Enter the XML configuration for your AWS SNS and click Save.

To test this configuration, you can add an object in your StorageGRID bucket. You should receive an email message from AWS SNS similar to the following screenshot, detailing various metadata associated with your object. This confirms that your SNS notification part is working.

 

notification statement

Now let’s set up the lambda function on AWS to take actions on the newly ingested object in StorageGRID. Here is a sample lambda function in Python to help you get started writing lambda functions for StorageGRID. After you deploy this code on your lambda function, test the function by ingesting an object in your StorageGRID bucket. You can then check for logs in CloudWatch—select the Monitor tab in your lambda function and then select View Logs in CloudWatch. This concept can be extended by enabling lambda functions to help you interact with many other services in AWS, such as MediaConvert, MediaLive, Rekognition, and SageMaker.

An easier hybrid cloud workflow with StorageGRID

A hybrid cloud workflow that helps you enable your data to be available on AWS services adds tremendous value to your on-premises data. StorageGRID reduces the complexity of enabling hybrid cloud workflows and brings significant benefits to organizations in terms of cost, agility, and compliance. Various services that are available on AWS could be helpful for your organization. Make your on-premises data on StorageGRID available to these services with StorageGRID platform services and get the best out of both public and private cloud.

To learn more about how StorageGRID object storage can benefit your environment, visit the StorageGRID page.

Joseph Kandatilparambil

Joseph Kandatilparambil is Solutions Architect for NetApp StorageGRID. Joseph helps with customer driven innovation at NetApp by empowering customers with solutions that help them focus on driving their product forward and expand their horizons. Outside of work, Joseph enjoys kite-surfing, rock climbing and hiking.

View all Posts by Joseph Kandatilparambil