How to log in to a website using Python s Requests module

Question

I am trying to post a request to log in to a website using the Requests module in Python but its not really working  I m new to this   so I can t figure out if I should make my Username and Password cookies or some type of HTTP authorization thing I found         from pyquery import PyQuery import requests  url    http   www locationary com home index2 jsp    So now  I think I m supposed to use  post  and cookies      ck     inUserName    USERNAME EMAIL    inUserPass    PASSWORD    r   requests post url  cookies ck   content   r text  q   PyQuery content   title   q  title   text    print title   I have a feeling that I m doing the cookies thing wrong   I don t know   If it doesn t log in correctly  the title of the home page should come out to  Locationary com  and if it does  it should be  Home Page    If you could maybe explain a few things about requests and cookies to me and help me out with this  I would greatly appreciate it   D  Thanks      It still didn t really work yet  Okay   so this is what the home page HTML says before you log in    lt  td gt  lt td gt  lt img src  http   www locationary com img LocationaryImgs icons txt email gif  gt      lt  td gt   lt td gt  lt input class  Data Entry Field Login  type  text  name  inUserName  id  inUserName   size  25  gt  lt  td gt   lt td gt  lt img src  http   www locationary com img LocationaryImgs icons txt password gif  gt   lt  td gt   lt td gt  lt input  class  Data Entry Field Login   type  password  name  inUserPass      id  inUserPass  gt  lt  td gt    So I think I m doing it right  but the output is still  Locationary com   2nd EDIT   I want to be able to stay logged in for a long time and whenever I request a page under that domain  I want the content to show up as if I were logged in

User · Answer

The requests Session   solution assisted with logging into a form with CSRF Protection  as used in Flask-WTF forms    Check if a csrf token is required as a hidden field and add it to the payload with the username and password   import requests from bs4 import BeautifulSoup  payload          email    email example com        password    passw0rd          with requests Session   as sess      res   sess get server name     signin       signin   BeautifulSoup res  content   html parser       payload  csrf token     signin find  input   id  csrf token    value       res   sess post server name     auth login   data payload

User · Answer

I know you ve found another solution  but for those like me who find this question  looking for the same thing  it can be achieved with requests as follows   Firstly  as Marcus did  check the source of the login form to get three pieces of information - the url that the form posts to  and the name attributes of the username and password fields  In his example  they are inUserName and inUserPass   Once you ve got that  you can use a requests Session   instance to make a post request to the login url with your login details as a payload  Making requests from a session instance is essentially the same as using requests normally  it simply adds persistence  allowing you to store and use cookies etc   Assuming your login attempt was successful  you can simply use the session instance to make further requests to the site  The cookie that identifies you will be used to authorise the requests   Example  import requests    Fill in your details here to be posted to the login form  payload          inUserName    username        inUserPass    password       Use  with  to ensure the session context is closed after use  with requests Session   as s      p   s post  LOGIN URL   data payload        print the html returned or something more intelligent to see if it s a successful login page      print p text        An authorised request      r   s get  A protected web page url       print r text           etc

User · Answer

Find out the name of the inputs used on the websites form for usernames  lt    name username     gt  and passwords  lt    name password    gt  and replace them in the script below  Also replace the URL to point at the desired site to log into   login py     usr bin env python  import requests from requests packages urllib3 exceptions import InsecureRequestWarning requests packages urllib3 disable warnings InsecureRequestWarning  payload      username    user email com    password    blahblahsecretpassw0rd    url    https   website com login html  requests post url  data payload  verify False    The use of disable warnings InsecureRequestWarning  will silence any output from the script when trying to log into sites with unverified SSL certificates    Extra   To run this script from the command line on a UNIX based system place it in a directory  i e  home scripts and add this directory to your path in    bash profile or a similar file used by the terminal     Custom scripts export CUSTOM SCRIPTS home scripts export PATH  CUSTOM SCRIPTS  PATH   Then create a link to this python script inside home scripts login py  ln -s   home scripts login py   home scripts login   Close your terminal  start a new one  run login

User · Answer

Let me try to make it simple  suppose URL of the site is http   example com  and let s suppose you need to sign up by filling username and password  so we go to the login page say http   example com login php now and view it s source code and search for the action URL it will be in form tag something like     lt form name  loginform  method  post  action  userinfo php  gt    now take userinfo php to make absolute URL which will be  http   example com userinfo php   now run a simple python script   import requests url    http   example com userinfo php  values     username    user              password    pass    r   requests post url  data values  print r content   I Hope that this helps someone somewhere someday

User · Answer

Some pages may require more than login pass  There may even be hidden fields  The most reliable way is to use inspect tool and look at the network tab while logging in  to see what data is being passed on

User · Answer

If the information you want is on the page you are directed to immediately after login     Lets call your ck variable payload instead  like in the python-requests docs   payload     inUserName    USERNAME EMAIL    inUserPass    PASSWORD   url    http   www locationary com home index2 jsp  requests post url  data payload    Otherwise     See https   stackoverflow com a 17633072 111362 below

[python] How to "log in" to a website using Python's Requests module?

Examples related to python

Examples related to python-requests

Examples related to pyquery