最近基于selenium寫了一個python小工具,記錄下學習記錄,自己運行的環境是Ubuntu 14.04.4, Python 2.7,Chromium 49.0,ChromeDriver 2.16
selenium簡介
selenium提供了一個通用的接口,可模擬用戶來操作瀏覽器,比如用于自動化測試等.
selenium的核心是WebDriver,它提供了一組接口,這些接口能夠操作各種跨平臺的瀏覽器.
各大瀏覽器廠商.
各大瀏覽器廠商也支持Selenium,將其作為瀏覽器的一部分.
selenium工具集提供了WebDriver,Selenium IDE,Selenium-Grid等
Selenium 1.0 + WebDriver = Selenium 2.0
Selenium WebDriver是Selenium Remote Control(Selenium-RC)的繼承者.
-
WebDriver提供了更簡單和簡潔的接口,克服了Selenium-RC API一些限制. - 相比
Selenium 1.0,WebDriver是面向對象式的服務. -
WebDriver驅動瀏覽器更有效率,提供了比Selenium 1.0更多的功能 -
Selenium RC只能在單機上運行,WebDriver則提供了遠程操作的功能
selenium基本使用
selenium運行需要什么
主要包括三部分:selenium selenium,瀏覽器driver,瀏覽器。
selenium selenium是一組通用的接口,而不同的瀏覽器提供其自身的driver(大部分是官方的),瀏覽器則被模擬控制操作的終端.
安裝
pip install selenium --upgrade
apt-get install chromium-browser
wget http://chromedriver.storage.googleapis.com/2.10/chromedriver_linux`getconf LONG_BIT`.zip
unzip chromedriver_linux32.zip
cp chromedriver /usr/local/share
chmod +x /usr/local/share/chromedriver
ln -s /usr/local/share/chromedriver /usr/local/bin/chromedriver
ln -s /usr/bin/chromedriver /usr/local/share/chromedriver
簡單的使用
from selenium import webdriver
driver = webdriver.Chrome('/usr/local/bin/chromedriver')
driver.get('http://mail.sina.net');
print(driver.title)
API使用
可參考/usr/local/lib/python2.7/dist-packages/selenium
Chrome WebDriver
selenium.webdriver.chrome.webdriver.WebDriver(executable_path='chromedriver', port=0, chrome_options=None, service_args=None, desired_capabilities=None, service_log_path=None)
ChromeOptions
可以通過ChromeDriver session配置ChromeDriver session
ChromeDriverconvenient methods for setting ChromeDriver-specific capabilities
from selenium.webdriver.chrome.options import Options
chrome_options = Options()
chrome_options.add_argument("--disable-extensions")
chrome_options.add_argument('--disable-logging')
chrome_options.add_experimental_option('prefs', {'download.default_directory':
'/tmp'})
chrome_options.binary_location='/usr/bin/chromium-browser'
driver = webdriver.Chrome(chrome_options=chrome_options)
直接使用DesiredCapabilities
ChromeOptions是構建在DesiredCapabilities之上的,為了使用DesiredCapabilities,必須
知道capability的Key/value對.
chrome_options = Options()
capabilities={}
capabilities['platform'] = "WINDOWS"
capabilities['version'] = "10"
capabilities.update(chrome_options.to_capabilities())
driver = webdriver.Chrome(desired_capabilities=capabilities)
chromedriver運行方式
The ChromeDriver class不斷的創建實例,會浪費很多的時間,可以通過兩個方式解決.
使用ChromeDriverService
import selenium.webdriver.chrome.service as service
service = service.Service('/usr/bin/chromedrive')
service.start()
capabilities = { }
driver = webdriver.Remote(service.service_url, capabilities)
driver.get('http://mail.sina.net');
print(driver.title)
開啟單獨的ChromeDriver服務
./chromedriver
driver = webdriver.Remote('http://127.0.0.1:9515', DesiredCapabilities.CHROME)
driver.get('http://mail.sina.net');
RemoteWebDriverServer
The RemoteWebDriver is composed of two pieces: a client and a server. The client is your WebDriver test and the server is simply a Java servlet, which can be hosted in any modern JEE app server. The server will always run on the machine with the browser you want to test.
wget http://selenium-release.storage.googleapis.com/2.53/selenium-server-standalone-2.53.0.jar
java -jar selenium-server-standalone-2.53.0.jar
from selenium import webdriver
from selenium.webdriver.common.desired_capabilities import DesiredCapabilities
driver = webdriver.Remote( command_executor='http://127.0.0.1:4444/wd/hub',des
desired_capabilities=DesiredCapabilities.CHROME)
driver.get('http://mail.sina.net');
其他
參考網站:
used pyvirtualdisplay to simulate a display:
由于使用的是Ubuntu服務器版,所以無法運行chrome,通過pyvirtualdisplay解決該問題
sudo apt-get install Xvfb
sudo pip install pyvirtualdisplay
from pyvirtualdisplay import Display
display = Display(visible=0, size=(1024, 768))
display.start()
driver = webdriver.Chrome('/usr/local/bin/chromedriver')
driver.get('http://mail.sina.net');
print(driver.title)
display.stop()
Explicit Wait:
由于是模擬用戶操作瀏覽器,瀏覽器加載需要時間,為確保成功加載完成才繼續執行下去,解決方案如下
from selenium.webdriver.support.ui import WebDriverWait
driver = webdriver.Chrome()
driver.get('http://mail.sina.net/login');
el = WebDriverWait(driver, 10).until(lambda x: x.find_element_by_id("loginfromemail"))
print(el.text)
