Programmer Think

Shiro is a powerful and easy-to-use Java security framework on the official website: https://shiro.apache.org/. The main functions are authentication, authorization, encryption, and session management.Other features include Web support, caching, test support, allowing one user to access as another user, and remembering me. Shiro has three c ...

There are many different opinions on the Internet. Most of them are copied back and forth. There is no practice. Recently, in the project, we frequently encountered the problem of boot+jackson processing date, so we opened this post. The first is POM. <?xml version="1.0" encoding="UTF-8"?> <project xmlns="http://maven.apache.org/PO ...

The implementation and principle of wordcount word statistics using mapreduce are shared before. This blogger will continue to share a classic case of mobile traffic analysis to help understand and use hadoop platform in practical work. I. requirements The following is a mobile traffic log. We need to analyze the upstream traffic, downstream ...

Not updated for a long timeTen thousand words are omitted here. Hu Hansan is back again!!!! get down to business... This time, the main function is to achieve: according to the incoming path, compress files and folders, for example, compress files from path A to directory B, including empty folders. Not much nonsense, directly on the code: (th ...

Distributed applications have a variety of problems.To solve these problems, besides applying some monitoring buried points by yourself, there should be some peripheral systems for active detection and discovery. That's what APM tools do. SkyWalking is an excellent APM application from open source and has become a top-level project for apache. ...

Curator It is an open-source Zookeeper client of Netflix. Compared with the native client provided by Zookeeper, the cursor has a higher level of abstraction and simplifies the programming of Zookeeper client. Maven dependence   <dependency>     <groupId>org.apache.zookeeper</groupId>     <artifactId>zookeeper</arti ...

Copyright notice: This is the original article of the blogger. It can't be reproduced without the permission of the blogger. https://blog.csdn.net/u010046908/article/details/50581867 Recently, the project has encountered the initialization of reading Excel data to the ...

(1) case of ashes -- UDTF seeking wordcount Data format:Each line is a string and separated by spaces.Code implementation: object SparkSqlTest { def main(args: Array[String]): Unit = { //Block redundant logs Logger.getLogger("org.apache.hadoop").setLevel(Level.WARN) Logger.getLogger("org.apache.spark").setLevel(Leve ...

Download Spark on Spark official website Spark Download The version is free. After downloading, extract it and put it under bigdata (the directory can be changed) Download the file winutils.exe required by Hadoop under Windows Let's find it on the Internet. It won't be uploaded here. In fact, this file is optional, and error reporting doesn' ...

Introduction case: object SparkSqlTest { def main(args: Array[String]): Unit = { //Block redundant logs Logger.getLogger("org.apache.hadoop").setLevel(Level.WARN) Logger.getLogger("org.apache.spark").setLevel(Level.WARN) Logger.getLogger("org.project-spark").setLevel(Level.WARN) //Building programmin ...