Record curl submit data encoding and javascript transform unicode problem

1. Data coding problem of curl submission When using curl to send a POST request under windows, there is a problem. The parameters transmitted are not UTF-8 encoded. 1. In the GIT bash test, locale is UTF-8, no effect, the server received or GBK encoding. 2. Tested under cmd, chcp 65001 has no effect. The server receives GBK code. 3. Wri ...

Posted by boiy on Sun, 10 May 2020 16:19:42 +0200

1-20 crawler urlib module

cookie usage for urlib: If you already know the cookie, or the cookie you obtained through packet grabbing, you can log in directly in the header's information; The cookie information on the website of Jingdong is different from that on the website of Jingdong, You can log in to JD, grab the cookie information, and t ...

Posted by clanstyles on Wed, 06 May 2020 02:06:44 +0200

docx document to pdf file

Note: only docx file can be converted here. doc is not allowed. The source code is at the end of the article. It can be run on windows and linux, with the function of content replacement added, because some document contents need to be generated dynamically by code. The following are the specific operation steps: ma ...

Posted by AJW on Sun, 03 May 2020 23:41:37 +0200

Baidu Encyclopedia crawler

WebMagic configuration: http://www.cnblogs.com/justcooooode/p/7913365.html Crawling target Recently, we need to analyze some domain concepts, choose to use Baidu Encyclopedia to crawl corresponding terms, and get information and knowledge from them. I divide the query results into two categories, one is included in the encyclopedia, the othe ...

Posted by kryles on Sat, 02 May 2020 22:45:32 +0200

Angular2 configuration Electron project (desktop cross platform)

Electron A desktop cross platform framework. In order to be able to use TypeScript for development, so the integration of configuration Configuration process To create an Angular2 project ng new ang-electron2 *cd enters the project file after creation npm install electron --save-dev --save-exact In the project, we need to Electro ...

Posted by Redlightpacket on Thu, 30 Apr 2020 17:55:55 +0200

In 315 cities across the country, use python to crawl the store information of KFC grandpa

    I think I have lived in this world for more than 20 years. The most popular restaurant I have ever been to is KFC's birthday when I was a child. Now I grow up, KFC has become my daily snack. When I go hungry from the front door after work, I will go in and buy a cup of coffee in the morning. It's mainly fast, delicious and full, and it's ...

Posted by integravtec on Wed, 29 Apr 2020 14:40:14 +0200

Crawling cache agent free ip, build its own agent ip pool, no longer afraid of anti crawling (with code)

In the process of doing crawler, we often encounter the following situations: at first, the crawler runs normally and grabs data normally, but the effort of a cup of tea may make mistakes, such as 403 Forbidden; at this time, the web page may appear the prompt of "your IP access frequency is too high", which may be unsealed after a l ...

Posted by phpfreak on Sat, 25 Apr 2020 09:53:12 +0200

Websocket live room chat tutorial - go easy to quickly implement chat room

This tutorial and the full set of source code have been open-source on the OSChina code cloud and will be updated continuously. Please visit the latest version https://gitee.com/goeasy-io/GoEasyDemo-Live-Chatroom.git That fire has been broadcast live in the last two years. It's really indescribable! Often a friend asks, I want to realize a live ...

Posted by Zup on Tue, 21 Apr 2020 05:25:39 +0200

Mongodb Installation Required Read System Optimization

Mongodb released two available service versions: Community and Enterprise The Monodb we use is a community versionOfficial Recommendation:For the best installation experience, MongoDB provides packages for popular Linux distributions.These packages are the preferred way to run MongoDB. 1. linux platform support Install on Red Hat Supports the ...

Posted by comtek on Thu, 09 Apr 2020 23:24:20 +0200

[WPF Learning] Chapter 65 Creating Appearance-Free Controls

Original: [WPF Learning] Chapter 65 Creating Appearance-Free Controls The goal of user controls is to provide a design surface for supplementary control templates, providing a quick way to define controls at the expense of losing future flexibility.This is a problem if you like the functionality of user controls but need to modify them to ...

Posted by radman08 on Thu, 09 Apr 2020 07:19:18 +0200