Python and AWS: Boto3 for AWS S3 and DynamoDB

Table of Contents

  1. Introduction
  2. Prerequisites
  3. Setup
  4. Working with AWS S3
  5. Working with DynamoDB
  6. Conclusion

Introduction

In this tutorial, we will explore how to use Boto3, the AWS SDK for Python, to work with AWS S3 and DynamoDB services. Boto3 provides an easy-to-use interface to interact with various AWS services using Python code. By the end of this tutorial, you will be able to perform basic operations such as creating, retrieving, updating, and deleting objects in AWS S3 as well as working with data in DynamoDB.

Prerequisites

Before you begin, make sure you have the following prerequisites:

  • An AWS account
  • Python installed on your machine
  • Boto3 library installed (pip install boto3)

Setup

To start working with Boto3, you need to configure your AWS credentials. Follow these steps:

  1. Log in to your AWS Management Console.
  2. Open the IAM service.
  3. Click on “Users” in the left navigation pane.
  4. Click on your username.
  5. In the “Permissions” tab, click on “Add Inline Policy”.
  6. Select “Choose a service” and search for “S3”.
  7. Choose the appropriate actions you want to allow (e.g., ListAllMyBuckets, GetObject, PutObject, etc.).
  8. Click on “Review Policy”, provide a name for the policy, and click on “Create Policy”.

Now, let’s move on to working with AWS S3 using Boto3.

Working with AWS S3

Creating a Bucket

To create a bucket in AWS S3, follow these steps:

  1. Import the necessary modules: 
     import boto3
  2. Create a session using your AWS credentials: 
     session = boto3.Session(
     aws_access_key_id='YOUR_ACCESS_KEY',
     aws_secret_access_key='YOUR_SECRET_ACCESS_KEY'
 )
  3. Create an S3 client using the session: 
     s3 = session.client('s3')
  4. Use the create_bucket method to create a bucket: 
     bucket_name = 'your-bucket-name'
 s3.create_bucket(Bucket=bucket_name)

    Uploading an Object

To upload an object (file) to an existing bucket in AWS S3, follow these steps:

  1. Use the upload_file method to upload a file: 
     file_name = 'path/to/your/file.txt'
 object_name = 'your-file-name'
 s3.upload_file(file_name, bucket_name, object_name)

    Downloading an Object

To download an object from an existing bucket in AWS S3, follow these steps:

  1. Use the download_file method to download a file: 
     file_name = 'path/to/save/your-file.txt'
 object_name = 'your-file-name'
 s3.download_file(bucket_name, object_name, file_name)

    Listing Objects

To list all objects in a bucket in AWS S3, follow these steps:

  1. Use the list_objects method to list objects: 
     response = s3.list_objects(Bucket=bucket_name)
 objects = response['Contents']
 for obj in objects:
     print(obj['Key'])

    Deleting an Object

To delete an object from an existing bucket in AWS S3, follow these steps:

  1. Use the delete_object method to delete an object: 
     object_name = 'your-file-name'
 s3.delete_object(Bucket=bucket_name, Key=object_name)

    Now, let’s move on to working with DynamoDB using Boto3.

Working with DynamoDB

Creating a Table

To create a table in DynamoDB, follow these steps:

  1. Create a DynamoDB client using the session: 
     dynamodb = session.client('dynamodb')
  2. Use the create_table method to create a table: 
     table_name = 'your-table-name'
 dynamodb.create_table(
     TableName=table_name,
     KeySchema=[
         {
             'AttributeName': 'id',
             'KeyType': 'HASH'
         }
     ],
     AttributeDefinitions=[
         {
             'AttributeName': 'id',
             'AttributeType': 'N'
         }
     ],
     ProvisionedThroughput={
         'ReadCapacityUnits': 5,
         'WriteCapacityUnits': 5
     }
 )

    Adding an Item

To add an item to a table in DynamoDB, follow these steps:

  1. Use the put_item method to add an item: 
     table_name = 'your-table-name'
 item = {
     'id': {'N': '1'},
     'name': {'S': 'John Doe'},
     'age': {'N': '30'}
 }
 dynamodb.put_item(TableName=table_name, Item=item)

    Retrieving an Item

To retrieve an item from a table in DynamoDB, follow these steps:

  1. Use the get_item method to retrieve an item: 
     item_id = '1'
 response = dynamodb.get_item(TableName=table_name, Key={'id': {'N': item_id}})
 item = response['Item']
 print(item)

    Updating an Item

To update an item in a table in DynamoDB, follow these steps:

  1. Use the update_item method to update an item: 
     item_id = '1'
 update_expression = 'SET age = :new_age'
 expression_attribute_values = {':new_age': {'N': '35'}}
 dynamodb.update_item(
     TableName=table_name,
     Key={'id': {'N': item_id}},
     UpdateExpression=update_expression,
     ExpressionAttributeValues=expression_attribute_values
 )

    Deleting a Table

To delete a table in DynamoDB, follow these steps:

  1. Use the delete_table method to delete a table: 
     table_name = 'your-table-name'
 dynamodb.delete_table(TableName=table_name)

    Conclusion

In this tutorial, we have learned how to use Boto3, the AWS SDK for Python, to work with AWS S3 and DynamoDB. We covered basic operations such as creating, retrieving, updating, and deleting objects in AWS S3 as well as working with data in DynamoDB. By using Boto3, you can easily interact with these services using Python code and automate various tasks. Now you can explore more advanced features and functionalities of Boto3 to build powerful applications on AWS.

Published:

Related Articles