How to save and load cookies using Python Selenium WebDriver

Question

How can I save all cookies in Python s Selenium WebDriver to a  txt file  and then load them later  The documentation doesn t say much of anything about the getCookies function

User · Answer

Remember  you can only add a cookie for the current domain  If you want to add a cookie for your Google account  do browser get  http   google com   for cookie in cookies      browser add cookie cookie

User · Answer

You can save the current cookies as a Python object using pickle  For example  import pickle import selenium webdriver  driver   selenium webdriver Firefox   driver get  quot http   www google com quot   pickle dump  driver get cookies     open  quot cookies pkl quot   quot wb quot     And later to add them back  import pickle import selenium webdriver  driver   selenium webdriver Firefox   driver get  quot http   www google com quot   cookies   pickle load open  quot cookies pkl quot    quot rb quot    for cookie in cookies      driver add cookie cookie

User · Answer

This is a solution that saves the profile directory for Firefox  similar to the user-data-dir  user data directory  in Chrome   it involves manually copying the directory around  I haven t been able to find another way   It was tested on Linux   Short version   To save the profile  driver execute script  quot window close   quot   time sleep 0 5  currentProfilePath   driver capabilities  quot moz profile quot   profileStoragePath    quot  tmp abc quot  shutil copytree currentProfilePath  profileStoragePath                  ignore dangling symlinks True                     To load the profile  driver   Firefox executable path  quot geckodriver-v0 28 0-linux64 quot                    firefox profile FirefoxProfile profileStoragePath                      Long version  with demonstration that it works and a lot of explanation -- see comments in the code  The code uses localStorage for demonstration  but it works with cookies as well   initial imports  from selenium webdriver import Firefox  FirefoxProfile  import shutil import os path import time    Create a new profile  driver   Firefox executable path  quot geckodriver-v0 28 0-linux64 quot                         I m using this particular version  If yours is                     named  quot geckodriver quot  and placed in system PATH                     then this is not necessary                      Navigate to an arbitrary page and set some local storage driver get  quot https   DuckDuckGo com quot   assert driver execute script r quot  quot  quot           const tmp   localStorage a  localStorage a  quot 1 quot           return  tmp  localStorage a        quot  quot  quot       None   quot 1 quot      Make sure that the browser writes the data to profile directory    Choose one of the below methods if 0        Wait for some time for Firefox to flush the local storage to disk        It s a long time  I tried 3 seconds and it doesn t work      time sleep 10   elif 1        Alternatively      driver execute script  quot window close   quot         NOTE  It might not work if there are multiple windows         Wait for a bit for the browser to clean up        shutil copytree might throw some weird error if the source directory changes while copying      time sleep 0 5   else      pass       I haven t been able to find any other  more elegant way        close    and  quit    both delete the profile directory     Copy the profile directory  must be done BEFORE driver quit     currentProfilePath   driver capabilities  quot moz profile quot   assert os path isdir currentProfilePath  profileStoragePath    quot  tmp abc quot  try      shutil rmtree profileStoragePath  except FileNotFoundError      pass  shutil copytree currentProfilePath  profileStoragePath                  ignore dangling symlinks True   There s a lock file in the                                                 profile directory that symlinks                                                 to some IP address   port                   driver quit   assert not os path isdir currentProfilePath    Selenium cleans up properly if driver quit   is called    but not necessarily if the object is destructed     Now reopen it with the old profile  driver Firefox executable path  quot geckodriver-v0 28 0-linux64 quot                  firefox profile FirefoxProfile profileStoragePath                     Note that the profile directory is   copied   -- see FirefoxProfile documentation assert driver profile path  profileStoragePath assert driver capabilities  quot moz profile quot    profileStoragePath    Confusingly    assert driver profile path  driver capabilities  quot moz profile quot     And only the latter is updated    To save it again  use the same method as previously mentioned    Check the data is still there  driver get  quot https   DuckDuckGo com quot    data   driver execute script r quot  quot  quot return localStorage a quot  quot  quot   assert data   quot 1 quot   data  driver quit    assert not os path isdir driver capabilities  quot moz profile quot    assert not os path isdir driver profile path    What doesn t work   Initialize Firefox capabilities   quot moz profile quot    quot  path to directory quot    -- the driver will not be able to connect  options Options    options add argument  quot profile quot    options add argument  quot  path to directory quot    Firefox options options  -- same as above

User · Answer

Based on the answer by Eduard Florinescu  but with newer code and the missing imports added    cat work-auth py    usr bin python3    Setup    sudo apt-get install chromium-chromedriver   sudo -H python3 -m pip install selenium  import time from selenium import webdriver from selenium webdriver chrome options import Options  chrome options   Options   chrome options add argument  quot --user-data-dir chrome-data quot   driver   webdriver Chrome   usr bin chromedriver  options chrome options  chrome options add argument  quot user-data-dir chrome-data quot   driver get  https   www somedomainthatrequireslogin com   time sleep 30     Time to enter credentials driver quit      cat work py    usr bin python3  import time from selenium import webdriver from selenium webdriver chrome options import Options  chrome options   Options   chrome options add argument  quot --user-data-dir chrome-data quot   driver   webdriver Chrome   usr bin chromedriver  options chrome options  driver get  https   www somedomainthatrequireslogin com      Already authenticated time sleep 10  driver quit

User · Answer

Just a slight modification for the code written by Roel Van de Paar  as all credit goes to him  I am using this in Windows and it is working perfectly  both for setting and adding cookies  from selenium import webdriver from selenium webdriver chrome options import Options  chrome options   Options   chrome options add argument  quot --user-data-dir chrome-data quot   driver   webdriver Chrome  chromedriver exe  options chrome options  driver get  https   web whatsapp com      Already authenticated time sleep 30

User · Answer

When you need cookies from session to session  there is another way to do it  Use the Chrome options user-data-dir in order to use folders as profiles  I run    You need to  from selenium webdriver chrome options import Options chrome options   Options   chrome options add argument  quot user-data-dir selenium quot    driver   webdriver Chrome chrome options chrome options  driver get  quot www google com quot    Here you can do the logins that check for human interaction  I do this and then the cookies I need now every time I start the Webdriver with that folder everything is in there  You can also manually install the Extensions and have them in every session  The second time I run  all the cookies are there    You need to  from selenium webdriver chrome options import Options     chrome options   Options   chrome options add argument  quot user-data-dir selenium quot    driver   webdriver Chrome chrome options chrome options  driver get  quot www google com quot     Now you can see the cookies  the settings  extensions  etc   and the logins done in the previous session are present here    The advantage is you can use multiple folders with different settings and cookies  Extensions without the need to load  unload cookies  install and uninstall Extensions  change settings  change logins via code  and thus no way to have the logic of the program break  etc  Also  this is faster than having to do it all by code

User · Answer

This is code I used in Windows  It works  for item in COOKIES split           name value   item split      1      name name replace          replace   r       replace   n           value   value replace          replace   r       replace   n           cookie dict                name  name               value  value               quot domain quot    quot  quot      Google Chrome              quot expires quot    quot  quot                path                     httpOnly   False               HostOnly   False               Secure   False               self driver  add cookie cookie dict

[python] How to save and load cookies using Python + Selenium WebDriver

Examples related to python

Examples related to python-2.7

Examples related to selenium

Examples related to webdriver