Crawler cracking 12306 verification code to realize login operation

Crawler cracking 12306 verification code to realize login operation 1, Preparation 2, Full code 3, Code analysis 1, Preparation Before crawling, let's see what the 12306 verification code looks like See this verification code, have wood very flustered, this tm can also crack??? Answer: of course ...

Posted by mr_tron on Tue, 23 Jun 2020 04:18:34 +0200

2020, eight essential Selenium tips for writing automated use cases

When you start automation, you may encounter various methods, technologies, frameworks, and tools that may be included in your automation code. Sometimes, this versatility results in more complex code than providing better flexibility or better ways to solve problems. When writing automated code, it's i ...

Posted by nev25 on Tue, 09 Jun 2020 08:31:59 +0200

Day 76: Scrapy analog login

by Leisure Want to crawl website data? Log in first! For most large-scale websites, the first threshold to crawl their data is to log in to the website. Now please follow my steps to learn how to simulate landing on the website. Why do I log in? There are two kinds of websites on the Internet: need to log in and don't need to log in. (this ...

Posted by sousousou on Mon, 01 Jun 2020 08:43:33 +0200

Selenium series - Basic Practice of Web UI automation

If you want to learn Selenium from scratch, you can read this series of articles! https://www.cnblogs.com/poloyy/category/1680176.html   Secondly, if you don't know the basic knowledge of the front-end, you need to supplement it yourself. The blogger hasn't summarized it for the moment (although I can, so I don't need to review the front-end ...

Posted by kurky on Sun, 05 Apr 2020 16:47:40 +0200

Write a python Google automated test library by yourself

I've been exposed to selenium before. There are call interfaces in various languages and browser kernels But we need to build an automatic test library by ourselves for convenience. We can use it when we throw it under our program. We only support window s at present Each kernel browser has its own web debugging protocol Here I use Google's ...

Posted by scottybwoy on Wed, 18 Mar 2020 17:51:09 +0100

Java crawler (chrome driver + selenium Implementation) and webmagic framework

Background In order to get novel coronavirus epidemic data in time, the project team needs to construct a crawler running batch crawl data. You may be familiar with crawlers. Common crawler technologies include requests + LXM + beautiful soup in Python, or the crawler framework of python, such as th ...

Posted by mistcat on Mon, 17 Feb 2020 05:31:48 +0100

selenium skips webdriver detection and crawls the data of Taobao I have purchased

brief introduction The previous blog has described how to use selenium to skip webdriver detection and crawl tmall's product data, so we will not talk about it in detail here, and you can view another blog if you need some ideas. source code # -*- coding: utf-8 -*- from selenium import webdriver from selenium.webdriver.common.by import By ...

Posted by Jaehoon on Mon, 02 Dec 2019 22:38:37 +0100

Python data analysis of old fish -- Part 6: using selenium to obtain dynamic data

At present, the data on many pages is dynamically loaded, so using the method of "scrape" to crawl the page can only get the layout code of the page HTML, but not the data. And for novices, it's difficult to use scratch on the road, so use selenium to open the game, and then load the page to get data. Demand: Statis ...

Posted by AmandaF on Fri, 29 Nov 2019 16:18:01 +0100

jmeter and Java selenium automation

Jmeter can complete the UI automation test through WebDriver, and can also test the browser side pressure on the system. The following jiar package is required Basic configuration 1: Download JMeterPlugins-WebDriver-1.3.1.zip, and after decompression, copy all jar files under the lib directory and JMeterPlugins-WebDriver.jar files under the l ...

Posted by millesm on Tue, 12 Nov 2019 18:45:24 +0100

selenium notes arrangement

Common methods of scattered   from selenium import webdriver # Keys package to be introduced when calling keyboard key operation from selenium.webdriver.common.keys import Keys # Create browser object by calling PhantomJS browser specified by environment variable driver = webdriver.PhantomJS() ...

Posted by freewholly on Fri, 25 Oct 2019 23:32:07 +0200