Boto3 Error botocore exceptions NoCredentialsError Unable to locate credentials

Question

When I simply run the following code  I always gets this error  s3   boto3 resource  s3   bucket name    quot python-sdk-sample- s quot    uuid uuid4   print  quot Creating new bucket with name  quot   bucket name  s3 create bucket Bucket bucket name   I have saved my credential file in C  Users myname  aws credentials  from where Boto should read my credentials  Is my setting wrong  Here is the output from boto3 set stream logger  botocore   level  DEBUG    2015-10-24 14 22 28 761 botocore credentials  DEBUG  Skipping environment variable credential check because profile name was explicitly set  2015-10-24 14 22 28 761 botocore credentials  DEBUG  Looking for credentials via  env 2015-10-24 14 22 28 773 botocore credentials  DEBUG  Looking for credentials via  shared-credentials-file 2015-10-24 14 22 28 774 botocore credentials  DEBUG  Looking for credentials via  config-file 2015-10-24 14 22 28 774 botocore credentials  DEBUG  Looking for credentials via  ec2-credentials-file 2015-10-24 14 22 28 774 botocore credentials  DEBUG  Looking for credentials via  boto-config 2015-10-24 14 22 28 774 botocore credentials  DEBUG  Looking for credentials via  iam-role

User · Answer

The boto3 is looking for the credentials in the folder like

C:\ProgramData\Anaconda3\envs\tensorflow\Lib\site-packages\botocore\.aws

You should save two files in this folder credentials and config.

You may want to check out the general order in which boto3 searches for credentials in this link. Look under the Configuring Credentials sub heading.

User · Answer

I also had the same issue it can be solved by creating a config and credential file in the home directory  Below show the steps I did to solve this issue   Create a config file    touch    aws config   And in that file I entered the region   default  region   us-west-2   Then create the credential file   touch    aws credentials   Then enter your credentials   Profile1  aws access key id   XXXXXXXXXXXXXXXXXXXX  aws secret access key   YYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYYY   After set all these  then my python file to connect bucket  Run this file will list all the contents   import boto3 import os  os environ  AWS PROFILE      Profile1  os environ  AWS DEFAULT REGION      us-west-2   s3   boto3 client  s3   region name  us-west-2   print   INFO   Connecting to cloud      Retrieves all regions endpoints that work with S3  response   s3 list buckets   print  Regions    response    You can also refer below links    Amazon S3 with Python Boto3 Library  Boto 3 documentation Boto3  Amazon S3 as Python Object Store

User · Answer

I just had this problem  This is what worked for me  pip install botocore  1 13 20  Source  https   github com boto botocore issues 1892

User · Answer

These instructions are for windows machine with a single user profile for AWS  Make sure your    aws credentials file looks like this     profile name  aws access key id   yourAccessId aws secret access key   yourSecretKey   I had to set the AWS DEFAULT PROFILEenvironment variable to profile name found in your credentials  Then my python was able to connect  eg from here   import boto3    Let s use Amazon S3 s3   boto3 resource  s3      Print out bucket names for bucket in s3 buckets all        print bucket name

User · Answer

I had the same issue and found out that the format of my    aws credentials file was wrong   It worked with a file containing    default  aws access key id XXXXXXXXXXXXXX aws secret access key YYYYYYYYYYYYYYYYYYYYYYYYYYY   Note that the profile name must be   default    Some official documentation make reference to a profile named   credentials    which did not work for me

User · Answer

I work for a large corporation and encountered this same error  but needed a different work around  My issue was related to proxy settings  I had my proxy set up so I needed to set my no proxy to whitelist AWS before I was able to get everything to work  You can set it in your bash script as well if you don t want to muddy up your Python code with os settings   Python   import os os environ  NO PROXY      s3 amazonaws com    Bash   export no proxy    s3 amazonaws com    Edit  The above assume a US East S3 region  For other regions  use s3  region  amazonaws com where region is something like us-east-1 or us-west-2

User · Answer

try specifying keys manually      s3   boto3 resource  s3            aws access key id ACCESS ID           aws secret access key  ACCESS KEY    Make sure you don t include your ACCESS ID and ACCESS KEY in the code directly for security concerns  Consider using environment configs and injecting them in the code as suggested by  Tiger Mike   For Prod environments consider using rotating access keys  https   docs aws amazon com IAM latest UserGuide id credentials access-keys html Using RotateAccessKey

User · Answer

If you are looking for an alternative way  try adding your credentials using  AmazonCLI  from the terminal type -  aws configure   then fill in your keys and region

User · Answer

If you re sure you configure your aws correctly  just make sure the user of the project can read from   aws or just run your project as a root

User · Answer

If you have multiple aws profiles in    aws credentials like      Profile 1  aws access key id                       aws secret access key                                               Profile 2  aws access key id                       aws secret access key                                                Follow two steps    Make one you want to use as a default using export AWS DEFAULT PROFILE Profile 1 command in terminal  Make sure to run above command in the same terminal from where you use boto3 or you open an editor  Understand the following scenario    Scenario    If you have two terminal open called t1 and t2  And you run the export command in t1 and you open JupyterLab or any other from t2  you will get NoCredentialsError  Unable to locate credentials error    Solution    Run the export command in t1 and then open JupyterLab or any other from the same terminal t1

User · Answer

Exporting the credential also work  In linux  export AWS SECRET ACCESS KEY  quot XXXXXXXXXXXX quot  export AWS ACCESS KEY ID  quot XXXXXXXXXXX quot

User · Answer

Make sure your    aws credentials file in Unix looks like this    MyProfile1  aws access key id   yourAccessId aws secret access key   yourSecretKey   MyProfile2  aws access key id   yourAccessId aws secret access key   yourSecretKey   Your Python script should look like this  and it ll work   from   future   import print function import boto3 import os  os environ  AWS PROFILE      MyProfile1  os environ  AWS DEFAULT REGION      us-east-1   ec2   boto3 client  ec2      Retrieves all regions endpoints that work with EC2 response   ec2 describe regions   print  Regions    response  Regions      Source  https   boto3 readthedocs io en latest guide configuration html interactive-configuration

User · Answer

Create an S3 client object with your credentials AWS S3 CREDS          quot aws access key id quot   quot your access key quot     os getenv  quot AWS ACCESS KEY quot        quot aws secret access key quot   quot your aws secret key quot    os getenv  quot AWS SECRET KEY quot     s3 client   boto3 client  s3    AWS S3 CREDS   It is always good to get credentials from os environment To set Environment variables run the following commands in terminal if linux or mac   export AWS ACCESS KEY  quot aws access key quot    export AWS SECRET KEY  quot aws secret key quot   if windows c System  gt  set AWS ACCESS KEY  quot aws access key quot  c System  gt  set AWS SECRET KEY  quot aws secret key quot

User · Answer

from the terminal type -  aws configure   then fill in your keys and region   after this do next step use any environment  You can have multiple keys depending your account  Can manage multiple enviroment or keys  import boto3 aws session   boto3 Session profile name  prod     Create an S3 client s3   aws session client  s3

[boto] Boto3 Error: botocore.exceptions.NoCredentialsError: Unable to locate credentials

Examples related to boto

Examples related to boto3