Crawler | Python grabs all answers under the question (with complete code)
Hello, I'm 👉
[year of fighting]
This issue introduces you step by step how to crawl all the Q & a related data. I hope it will be helpful to you.
Target website:
https://www.zhihu.com/question/368550554
Crawl field: crawl the release time, author, approval number, content, etc. of all answers under the question (other fields ca ...
Posted by jv2222 on Wed, 29 Sep 2021 23:50:28 +0200
Python Crawler Self-Study Notes Scrapy Framework
Python has many useful frameworks, and the Scrapy framework is the most important one in the crawling world.
1. Installation and Startup
Installation (Command Line)
pip3 install scrapy
Create a scrapy project (command line goes to the directory where the scrapy project is to be created):
scrapy startproject Project Name
Create a crawle ...
Posted by scheols on Fri, 24 Sep 2021 20:11:25 +0200