Data Ingestion Using Snowpipe and AWS

Data Ingestion Using Snowpipe and AWS

SUMMARY: This tutorial walks through the precise, multi-step configuration required to establish a serverless, continuous, and near-real-time data ingestion pipeline, utilizing Snowpipe to automatically load data from AWS S3 into Snowflake The setup begins by...
Amazon Outage and Multi Cloud Strategies

Amazon Outage and Multi Cloud Strategies

SUMMARY: Recent prominent Amazon Web Services (AWS) outages compel IT leaders to shift away from reliance on a single cloud provider toward a Multi-Cloud or Hybrid-Cloud strategy by immediately highlighting the immense risk associated with the Single Point of Failure...
Manage Public IPs in AWS

Manage Public IPs in AWS

When using public IP addresses in AWS, it is a good idea to regularly monitor and audit them.  This can be cumbersome as IPs can be assigned to a wide range of services across multiple accounts.  Whether using a stand-alone account or an Organization, AWS provides a...
AWS S3 Batch Operations

AWS S3 Batch Operations

When creating an S3 Replication Rule, objects that were uploaded prior to the rule being created will not be replicated. These will need to be replicated manually with an S3 Batch Operation. This can also be used for occasional one-off replications if needed....
AWS S3 Cross-Account Replication

AWS S3 Cross-Account Replication

When you create a general-purpose S3 bucket, AWS automatically redundantly saves all data across a minimum of 3 availability zones in the region where the bucket was created. This allows for 99.999999999% file durability, which ensures that you will never lose any of...
AWS IP Addresses No Longer Free

AWS IP Addresses No Longer Free

One of AWS’s excellent features is that public IP addresses, known as Elastic IPs, have been free as long as they were assigned to a resource. That is about to change on February 1, 2024. All Elastic IPs will be charged at $0.005 per hour while allocated to your...
12 Tips and Tricks for AWS

12 Tips and Tricks for AWS

You’ve heard of 12 days of Christmas!? Well, below are 12 Tips and tricks for AWS! Enjoy! #1 Require MFA for all users To help secure your AWS environment, it is highly recommended to require MFA for all users logging into the AWS Management Console. Follow the...