How to specify credentials when connecting to boto3 S3

Question

On boto I used to specify my credentials when connecting to S3 in such a way   import boto from boto s3 connection import Key  S3Connection S3   S3Connection  settings AWS SERVER PUBLIC KEY  settings AWS SERVER SECRET KEY     I could then use S3 to perform my operations  in my case deleting an object from a bucket    With boto3 all the examples I found are such   import boto3 S3   boto3 resource   s3    S3 Object  bucket name  key name   delete     I couldn t specify my credentials and thus all attempts fail with InvalidAccessKeyId error   How can I specify credentials with boto3

User · Answer

This is older but placing this here for my reference too. boto3.resource is just implementing the default Session, you can pass through boto3.resource session details.

Help on function resource in module boto3:

resource(*args, **kwargs)
    Create a resource service client by name using the default session.

    See :py:meth:`boto3.session.Session.resource`.

https://github.com/boto/boto3/blob/86392b5ca26da57ce6a776365a52d3cab8487d60/boto3/session.py#L265

you can see that it just takes the same arguments as Boto3.Session

import boto3
S3 = boto3.resource('s3', region_name='us-west-2', aws_access_key_id=settings.AWS_SERVER_PUBLIC_KEY, aws_secret_access_key=settings.AWS_SERVER_SECRET_KEY)
S3.Object( bucket_name, key_name ).delete()

User · Answer

There are numerous ways to store credentials while still using boto3 resource    I m using the AWS CLI method myself  It works perfectly   https   boto3 amazonaws com v1 documentation api latest guide configuration html fbclid IwAR2LlrS4O2gYH6xAF4QDVIH2Q2tzfF VZ6loM3XfXsPAOR4qA-pX qAILys

User · Answer

You can get a client with new session directly like below     s3 client   boto3 client  s3                          aws access key id settings AWS SERVER PUBLIC KEY                         aws secret access key settings AWS SERVER SECRET KEY                         region name REGION NAME

User · Answer

You can create a session   import boto3 session   boto3 Session      aws access key id settings AWS SERVER PUBLIC KEY      aws secret access key settings AWS SERVER SECRET KEY      Then use that session to get an S3 resource   s3   session resource  s3

User · Answer

I d like expand on  JustAGuy s answer  The method I prefer is to use AWS CLI to create a config file  The reason is  with the config file  the CLI or the SDK will automatically look for credentials in the    aws folder  And the good thing is that AWS CLI is written in python    You can get cli from pypi if you don t have it already  Here are the steps to get cli set up from terminal    gt  pip install awscli   can add user flag    gt  aws configure AWS Access Key ID                  ABCD   enter your key here  AWS Secret Access Key                  xyz   enter your secret key here  Default region name  us-west-2   enter your region here  Default output format  None     After this you can access boto and any of the api without having to specify keys  unless you want to use a different credentials

[python] How to specify credentials when connecting to boto3 S3?

Examples related to python

Examples related to amazon-web-services

Examples related to amazon-s3

Examples related to boto3