Scratch: Top 250 crawling
Content of this article
Climb to the top 250 page of Douban movie. The fields include:Ranking, title, director, one sentence Description: some are blank, rating, number of evaluation, release time, release country, category
Grab data storage
scrapy introduction
Scrapy crawler framework tutorial (1) -- getting started with scrapy
Create projec ...
Posted by JCBarry on Thu, 12 Dec 2019 20:53:55 +0100
About wechat H5 payment (wechat payment and jump connect payment)
I haven't updated my blog for a long time. Recently, I met wechat payment for my project. I need to sort out the demand. I need to adjust wechat payment for an activity page!Application framework THINKPHP5.1
Note: for wechat payment, if it is the h5 page, you need to obtain the code in a silent login state, so as to ensure that the parameter o ...
Posted by tronicsmasta on Wed, 11 Dec 2019 15:15:40 +0100
Android Jetpack architecture component - detailed explanation of Navigation in the pit
This article starts with WeChat public's "Android development tour". Welcome to pay more attention to get more dry goods.
Preface
Navigation is a direct translation of navigation, which is one of Android Jetpack components, making single Activity application the preferred architecture. The jump of Fragment page in the application is h ...
Posted by BRAINDEATH on Wed, 11 Dec 2019 10:14:30 +0100
Learning Android RxJava operators -- combining and merging operators -- combining and judging multiple events
1. Demand scenario
Multiple events need to be judged jointly at the same time
For example, when filling in the form, all information (name, age, occupation, etc.) in the form must be filled in before clicking the "submit" button
2. Function description
Fill in the form as the joint judgment function display he ...
Posted by coffeeguy on Wed, 11 Dec 2019 07:17:54 +0100
ContentProvider for IPC inter process communication
ContentProvider for interprocess communication
First, introduce
1. The underlying implementation is Binder
2. In addition to the onCreate method running on the main thread, the other four methods are called back from the outside and run in the Binder thread pool.
3. To register ContentProvider, an attribute android:authorities ...
Posted by zipdisk on Wed, 11 Dec 2019 04:15:25 +0100
Spring MVC: forwarding and redirection, image file upload, Jason
Be careful:
Project: war and project: war expanded
They are not the same. idea runs the project: war expanded
<dependency>
<groupId>org.springframework</groupId>
<artifactId>spring-webmvc</artifactId>
<version>4.3.10.RELEASE</version>
...
Posted by ruben- on Tue, 10 Dec 2019 23:46:04 +0100
hive opens the Kerberos beeline connection
1.kerberos installation
kerberos installation configuration and use: https://blog.csdn.net/qq_21383435/article/details/83625252
2. Generate keytab
Execute the following command on cdh1 node, KDC server node:
cd /var/kerberos/krb5kdc/
kadmin.local -q "addprinc -randkey hive/cdh-server1@YONG.COM "
kadmin.local -q "addprinc - ...
Posted by smpdawg on Tue, 10 Dec 2019 17:22:35 +0100
Native js implements Ajax and JSONP
Several execution steps inside Ajax
Create XMLHttpRequest object (new XMLHttpRequest())
Set request header
Connect to server (open())
Set callback (onreadyStateChange)
Send data (send())
Get data in callback function
JSONP
script tags can be used to request resources across domains to solve cross domain problems. Detailed explanation can be s ...
Posted by mrtechguy on Tue, 10 Dec 2019 05:22:45 +0100
Alicloud builds big data platform: flume installation, deployment and testing
I. flume installation
1. decompress
tar -zxvf flume-ng-1.6.0-cdh5.15.0.tar.gz -C /opt/modules/
2. Change name
mv apache-flume-1.6.0-cdh5.15.0-bin/ flume-1.6.0-cdh5.15.0-bin/
3. Configuration file: flume-env.sh
export JAVA_HOME=/opt/modules/jdk1.8.0_151
4. Test success
bin/flume-ng version
//Result:
Flume 1.6.0-cdh5. ...
Posted by zahidraf on Tue, 10 Dec 2019 04:09:34 +0100
Firewall basic use
I. system environment
Centos7
Two, installation
$ yum install -y firewalld
III. basic startup command
$ systemctl status firewalld # View state
$ systemctl start firewalld # start-up
$ systemctl stop firewalld #Close
$ systemctl enable firewalld ...
Posted by FrancoPaddy on Mon, 09 Dec 2019 18:58:41 +0100