Push mode integrates Flume and Spark Streaming

1. architecture 2.Flume configuration Create a new configuration file under $flume \ home / conf: flume \ push \ streaming.conf The configuration idea is as follows: source select netcat and configure the host name and port Select avro for sink, and configure the host name and port channel s ...

Posted by phithe on Fri, 06 Mar 2020 12:11:34 +0100

The initial experience of building Django project with cookie cutter

Article directory INFO Install cookie cutter Run the specified project template and create the project as prompted Execution process Project structure Complete project structure and configuration Cookie cutter option reference INFO Cookiecutter is a command-line tool for creating projects throu ...

Posted by codebuilder on Fri, 06 Mar 2020 06:15:37 +0100

docx4j in depth learning

I. Preface       In my work, I often encounter the processing and operation of word, the most commonly used is the export of word documents, and I often encounter a variety of complex formats of word. At the beginning, I used poi, but I struggled for a period of time, modfa, instead of using docx4j, which is very powerful. Well ...

Posted by bogdan on Fri, 06 Mar 2020 05:31:58 +0100

The end of nginx configuration reverse agent and load balancing

Refer to previous articles for specific installation configuration https://blog.csdn.net/weixin_44001965/article/details/102723855 Article directory 1, Common commands for nginx operations nginx profile 2, nginx configure reverse agent (1) 3, nginx configure reverse agent (2) Find the nginx configura ...

Posted by johnseito on Mon, 02 Mar 2020 09:28:25 +0100

Crawler combat record: establishment and use of IP pool in requests and scrape (and detailed explanation of the scrape agent middleware)

Get free proxy IP In this part, I hope to get some free IP of mainstream proxy websites for my personal use. Because the free IP availability is relatively poor compared with the private agent, I hope to verify the availability after obtaining the agent and save the available IP locally. At the same t ...

Posted by developer on Mon, 02 Mar 2020 08:14:57 +0100

Notes on SSM framework

Interaction between front end and back end and database operation 1. Query operation In mapper, select tag is used to complete the query operation. The sql statement used is select *from data table name. Or change * to the specific field value to be accepted, such as id, username and password. Then ...

Posted by phpnewbie1979 on Sun, 01 Mar 2020 15:07:57 +0100

Implementation principle of Android DeepLink

Preface Before that, we looked at the source code and studied animation. Today, we share a relatively simple technical point: DeepLink. DeepLink, deep link technology, the main application scenario is to call Android native app directly through Web page, and pass the required parameters to app dire ...

Posted by capbiker on Sun, 01 Mar 2020 09:30:20 +0100

Installing Hadoop pseudo distributed experimental environment on mac

Configuration environment: Mac OS 10.14.5 hadoop version: 3.2.1 Time: February 29, 2020 Install Homebrew Homebrew is commonly used on mac, with few descriptions and installation methods /usr/bin/ruby -e "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/master/install)" SSH login loca ...

Posted by CorfuVBProgrammer on Sun, 01 Mar 2020 07:23:11 +0100

SM ﹣ webgl 3D development note

1, webGL 3D development ... \Super map-iserver-10.0.1-win64-zip \ iclient \ for3d \ webgl \ zh directory \examples -- sample program (source code is convenient for developers to quickly build applications) \Build\Cesium -- development Script Library \index.html -- home page, integrating demonstration ...

Posted by tigger on Fri, 28 Feb 2020 04:51:57 +0100

The way of Spring learning -- Annotation development

The way of Spring learning -- Annotation development 1, Introduce related packages and constraints After spring 4, to use annotation form, you must introduce aop package Here we can find the related packages in maven warehouse. In the configuration file, you also need to introduce a context constrai ...

Posted by watsonowen on Tue, 25 Feb 2020 13:59:13 +0100