Push mode integrates Flume and Spark Streaming
1. architecture
2.Flume configuration
Create a new configuration file under $flume \ home / conf: flume \ push \ streaming.conf
The configuration idea is as follows:
source select netcat and configure the host name and port
Select avro for sink, and configure the host name and port
channel s ...
Posted by phithe on Fri, 06 Mar 2020 12:11:34 +0100
The initial experience of building Django project with cookie cutter
Article directory
INFO
Install cookie cutter
Run the specified project template and create the project as prompted
Execution process
Project structure
Complete project structure and configuration
Cookie cutter option reference
INFO
Cookiecutter is a command-line tool for creating projects throu ...
Posted by codebuilder on Fri, 06 Mar 2020 06:15:37 +0100
docx4j in depth learning
I. Preface
In my work, I often encounter the processing and operation of word, the most commonly used is the export of word documents, and I often encounter a variety of complex formats of word. At the beginning, I used poi, but I struggled for a period of time, modfa, instead of using docx4j, which is very powerful. Well ...
Posted by bogdan on Fri, 06 Mar 2020 05:31:58 +0100
The end of nginx configuration reverse agent and load balancing
Refer to previous articles for specific installation configuration https://blog.csdn.net/weixin_44001965/article/details/102723855
Article directory
1, Common commands for nginx operations
nginx profile
2, nginx configure reverse agent (1)
3, nginx configure reverse agent (2)
Find the nginx configura ...
Posted by johnseito on Mon, 02 Mar 2020 09:28:25 +0100
Crawler combat record: establishment and use of IP pool in requests and scrape (and detailed explanation of the scrape agent middleware)
Get free proxy IP
In this part, I hope to get some free IP of mainstream proxy websites for my personal use. Because the free IP availability is relatively poor compared with the private agent, I hope to verify the availability after obtaining the agent and save the available IP locally. At the same t ...
Posted by developer on Mon, 02 Mar 2020 08:14:57 +0100
Notes on SSM framework
Interaction between front end and back end and database operation
1. Query operation
In mapper, select tag is used to complete the query operation. The sql statement used is select *from data table name. Or change * to the specific field value to be accepted, such as id, username and password. Then ...
Posted by phpnewbie1979 on Sun, 01 Mar 2020 15:07:57 +0100
Implementation principle of Android DeepLink
Preface
Before that, we looked at the source code and studied animation. Today, we share a relatively simple technical point: DeepLink.
DeepLink, deep link technology, the main application scenario is to call Android native app directly through Web page, and pass the required parameters to app dire ...
Posted by capbiker on Sun, 01 Mar 2020 09:30:20 +0100
Installing Hadoop pseudo distributed experimental environment on mac
Configuration environment: Mac OS 10.14.5
hadoop version: 3.2.1
Time: February 29, 2020
Install Homebrew
Homebrew is commonly used on mac, with few descriptions and installation methods
/usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)"
SSH login loca ...
Posted by CorfuVBProgrammer on Sun, 01 Mar 2020 07:23:11 +0100
SM ﹣ webgl 3D development note
1, webGL 3D development
... \Super map-iserver-10.0.1-win64-zip \ iclient \ for3d \ webgl \ zh directory
\examples -- sample program (source code is convenient for developers to quickly build applications)
\Build\Cesium -- development Script Library
\index.html -- home page, integrating demonstration ...
Posted by tigger on Fri, 28 Feb 2020 04:51:57 +0100
The way of Spring learning -- Annotation development
The way of Spring learning -- Annotation development
1, Introduce related packages and constraints
After spring 4, to use annotation form, you must introduce aop package
Here we can find the related packages in maven warehouse.
In the configuration file, you also need to introduce a context constrai ...
Posted by watsonowen on Tue, 25 Feb 2020 13:59:13 +0100