Open web in new tab Selenium Python

Question

So I am trying to open websites on new tabs inside my WebDriver  I want to do this  because opening a new WebDriver for each website takes about 3 5secs using PhantomJS  I want more speed     I m using a multiprocess python script  and I want to get some elements from each page  so the workflow is like this   Open Browser  Loop throught my array For element in array - gt  Open website in new tab - gt  do my business - gt  close it   But I can t find any way to achieve this   Here s the code I m using  It takes forever between websites  I need it to be fast    Other tools are allowed  but I don t know too many tools for scrapping website content that loads with JavaScript  divs created when some event is triggered on load etc  That s why I need Selenium    BeautifulSoup can t be used for some of my pages      usr bin env python import multiprocessing  time  pika  json  traceback  logging  sys  os  itertools  urllib  urllib2  cStringIO  mysql connector  shutil  hashlib  socket  urllib2  re from selenium import webdriver from selenium webdriver common keys import Keys from PIL import Image from os import listdir from os path import isfile  join from bs4 import BeautifulSoup from pprint import pprint  def getPhantomData parameters       try            We create WebDriver         browser   webdriver Firefox             Navigate to URL         browser get parameters  target url              Find all links by Selector         links   browser find elements by css selector parameters  selector             result              for link in links                Extract link attribute and append to our list             result append link get attribute parameters  attribute             browser close           browser quit           return json dumps   data   result       except Exception  err          browser close           browser quit           print err  def callback ch  method  properties  body       parameters   json loads body      message   getPhantomData parameters       if message  data            ch basic ack delivery tag method delivery tag      else          ch basic reject delivery tag method delivery tag  requeue True   def consume        credentials   pika PlainCredentials  invitado    invitado       rabbit   pika ConnectionParameters  localhost  5672     credentials      connection   pika BlockingConnection rabbit      channel   connection channel          Conectamos al canal     channel queue declare queue  com stuff images   durable True      channel basic consume callback queue  com stuff images        print       Waiting for messages  To exit press CTRL C      try          channel start consuming       except KeyboardInterrupt          pass  workers   5 pool   multiprocessing Pool processes workers  for i in xrange 0  workers       pool apply async consume   try      while True          continue except KeyboardInterrupt      print       Exiting         pool terminate       pool join

User · Answer

In a discussion  Simon clearly mentioned that      While the datatype used for storing the list of handles may be ordered by insertion  the order in which the WebDriver implementation iterates over the window handles to insert them has no requirement to be stable  The ordering is arbitrary      Using Selenium v3 x opening a website in a New Tab through Python is much easier now  We have to induce an WebDriverWait for number of windows to be 2  and then collect the window handles every time we open a new tab window and finally iterate through the window handles and switchTo   window newly opened  as required  Here is a solution where you can open http   www google co in in the initial TAB and https   www yahoo com in the adjacent TAB    Code Block   from selenium import webdriver from selenium webdriver support ui import WebDriverWait from selenium webdriver support import expected conditions as EC  options   webdriver ChromeOptions    options add argument  start-maximized   options add argument  disable-infobars   driver   webdriver Chrome chrome options options  executable path r C  Utility BrowserDrivers chromedriver exe   driver get  http   www google co in   print  Initial Page Title is    s   driver title  windows before    driver current window handle print  First Window Handle is    s   windows before  driver execute script  window open  https   www yahoo com     WebDriverWait driver  10  until EC number of windows to be 2   windows after   driver window handles new window    x for x in windows after if x    windows before  0  driver switch to window new window  print  Page Title after Tab Switching is    s   driver title  print  Second Window Handle is    s   new window   Console Output   Initial Page Title is   Google First Window Handle is   CDwindow-B2B3DE3A222B3DA5237840FA574AF780 Page Title after Tab Switching is   Yahoo Second Window Handle is   CDwindow-D7DA7666A0008ED91991C623105A2EC4  Browser Snapshot        Outro  You can find the java based discussion in Best way to keep track and iterate through tabs and windows using WindowHandles using Selenium

User · Answer

You can achieve the opening closing of a tab by the combination of keys COMMAND   T or COMMAND   W  OSX   On other OSs you can use CONTROL   T   CONTROL   W   In selenium you can emulate such behavior  You will need to create one webdriver and as many tabs as the tests you need   Here it is the code   from selenium import webdriver from selenium webdriver common keys import Keys  driver   webdriver Firefox   driver get  http   www google com      open tab driver find element by tag name  body   send keys Keys COMMAND    t      You can use  Keys CONTROL    t   on other OSs    Load a page  driver get  http   stackoverflow com      Make the tests       close the tab    Keys CONTROL    w   on other OSs  driver find element by tag name  body   send keys Keys COMMAND    w      driver close

User · Answer

OS  Win 10   Python 3 8 1   selenium  3 141 0    from selenium import webdriver import time  driver   webdriver Firefox executable path r TO Your Path geckodriver exe   driver get  https   www google com       Open a new window driver execute script  window open          Switch to the new window driver switch to window driver window handles 1   driver get  http   stackoverflow com   time sleep 3     Open a new window driver execute script  window open          Switch to the new window driver switch to window driver window handles 2   driver get  https   www reddit com    time sleep 3    close the active tab driver close   time sleep 3     Switch back to the first tab driver switch to window driver window handles 0   driver get  https   bing com   time sleep 3     Close the only tab  will also close the browser  driver close     Reference  Need Help Opening A New Tab in Selenium

User · Answer

The other solutions do not work for chrome driver v83  Instead  it works as follows  suppose there is only 1 opening tab  driver execute script  quot window open      quot   driver switch to window driver window handles 1   driver get  quot https   www example com quot    If there are already more than 1 opening tabs  you should first get the index of the last newly-created tab and switch to the tab before calling the url  Credit to tylerl    driver execute script  quot window open      quot   driver switch to window len driver window handles -1  driver get  quot https   www example com quot

User · Answer

Opening the new empty tab within same window in chrome browser is not possible up to my knowledge but you can open the new tab with web-link  So far I surfed net and I got good working content on this question  Please try to follow the steps without missing  import selenium webdriver as webdriver from selenium webdriver common keys import Keys  driver   webdriver Chrome   driver get  https   www google com q python q python   first link   driver find element by class name  l      Use  Keys CONTROL   Keys SHIFT   Keys RETURN to open tab on top of the stack  first link send keys Keys CONTROL   Keys RETURN     Switch tab to the new tab  which we will assume is the next one on the right driver find element by tag name  body   send keys Keys CONTROL   Keys TAB   driver quit    I think this is better solution so far  Credits  https   gist github com lrhache 7686903

User · Answer

tabs       def new tab        global browser     hpos   browser window handles index browser current window handle      browser execute script  quot window open      quot       browser switch to window browser window handles hpos   1       return browser current window handle       def switch tab name       global tabs     global browser     if not name in tabs keys            tabs name      window handle   new tab     url   url name          browser get tabs name   url        else          browser switch to window tabs name   window handle

User · Answer

After struggling for so long the below method worked for me    driver find element by tag name  body   send keys Keys CONTROL    t   driver find element by tag name  body   send keys Keys CONTROL   Keys TAB   windows   driver window handles  time sleep 3  driver switch to window windows 1

User · Answer

I tried for a very long time to duplicate tabs in Chrome running using action keys and send keys on body  The only thing that worked for me was an answer here  This is what my duplicate tabs def ended up looking like  probably not the best but it works fine for me   def duplicate tabs number  chromewebdriver    Once on the page we want to open a bunch of tabs url   chromewebdriver current url for i in range number       print  opened tab    str i       chromewebdriver execute script  window open    url      new window  str i          It basically runs some java from inside of python  it s incredibly useful  Hope this helps somebody   Note  I am using Ubuntu  it shouldn t make a difference but if it doesn t work for you this could be the reason

User · Answer

This is a common code adapted from another examples    from selenium import webdriver from selenium webdriver common keys import Keys  driver   webdriver Firefox   driver get  http   www google com      open tab       take the code from the options below    Load a page  driver get  http   bings com     Make the tests       close the tab driver quit     the possible ways were    Sending  lt CTRL gt     lt T gt  to one element   open tab driver find element by tag name  body   send keys Keys CONTROL    t    Sending  lt CTRL gt     lt T gt  via Action chains  ActionChains driver  key down Keys CONTROL  send keys  t   key up Keys CONTROL  perform    Execute a javascript snippet  driver execute script    window open  http   bings com    blank          In order to achieve this you need to ensure that the preferences browser link open newwindow and browser link open newwindow restriction are properly set  The default values in the last versions are ok  otherwise you supposedly need   fp   webdriver FirefoxProfile   fp set preference  browser link open newwindow   3  fp set preference  browser link open newwindow restriction   2   driver   webdriver Firefox browser profile fp    the problem is that those preferences preset to other values and are  frozen at least selenium 3 4 0  When you use the profile to set them with the java binding there comes an exception and with the python binding the new  values are ignored   In Java there is a way to set those preferences without specifying a profile object when talking to geckodriver  but it seem to be not implemented yet in the python binding   FirefoxOptions options   new FirefoxOptions   setProfile fp   options addPreference  browser link open newwindow   3   options addPreference  browser link open newwindow restriction   2   FirefoxDriver driver   new FirefoxDriver options      The third option did stop working for python in selenium 3 4 0   The first two options also did seem to stop working in selenium 3 4 0  They do depend on sending CTRL key event to an element  At first glance it seem that is a problem of the CTRL key  but it is failing because of the new multiprocess feature of Firefox  It might be that this new architecture impose new ways of doing that  or maybe is a temporary implementation problem  Anyway we can disable it via   fp   webdriver FirefoxProfile   fp set preference  browser tabs remote autostart   False  fp set preference  browser tabs remote autostart 1   False  fp set preference  browser tabs remote autostart 2   False   driver   webdriver Firefox browser profile fp        and then you can use successfully the first way

User · Answer

I d stick to ActionChains for this  Here s a function which opens a new tab and switches to that tab  import time from selenium webdriver common action chains import ActionChains  def open in new tab driver  element  switch to new tab True       base handle   driver current window handle       Do some actions     ActionChains driver             move to element element             key down Keys COMMAND             click              key up Keys COMMAND             perform              Should you switch to the new tab      if switch to new tab          new handle    x for x in driver window handles if x  base handle          assert len new handle    1   assume you are only opening one tab at a time                    Switch to the new window         driver switch to window new handle 0              I like to wait after switching to a new tab for the content to load           Do that either with time sleep   or with WebDriverWait until a basic           element of the page appears  such as  quot body quot   -- reference for this is            provided below         time sleep 0 5                     NOTE  if you choose to switch to the window tab  be sure to close           the newly opened window tab after using it and that you switch back           to the original  quot base handle quot  -- gt  otherwise  you ll experience many           errors and a painful debugging experience     Here s how you would apply that function    Remember your starting handle base handle   driver current window handle    Say we have a list of elements and each is a link  links   driver find elements by css selector  a href       Loop through the links and open each one in a new tab for link in links      open in new tab driver  link  True             Do something on this new page     print driver current url             Once you re finished  close this tab and switch back to the original one     driver close       driver switch to window base handle             You re ready to continue to the next item in your loop  Here s how you could wait until the page is loaded

User · Answer

Strangely  so many answers  and all of them are using surrogates like JS and keyboard shortcuts instead of just using a selenium feature   def newTab driver  url  about blank        wnd   driver execute selenium webdriver common action chains Command NEW WINDOW      handle   wnd  value    handle       driver switch to window handle      driver get url    changes the handle     return driver current window handle

User · Answer

browser execute script    window open  http   bings com    blank          Where browser is the webDriver

[python] Open web in new tab Selenium + Python

Outro

Examples related to python

Examples related to selenium

Examples related to webdriver

Examples related to phantomjs