Getting started with Elasticsearch: document data format, simple es restful api

1. Doument data format 1.1 Document Oriented Search and Analysis Engine 1.1.1 Object data stored in database The data structure of the application system is object-oriented and complexObject data is stored in a database and can only be disassembled to become flat multiple tables. It is cumbersome to restore the object format each time yo ...

Posted by wiseass on Fri, 22 Oct 2021 19:39:37 +0200

ELK Stack(Elasticsearch, Kibana, Beats and Logstash) sets up a log collection system

Elasticsearch is used to search for and analyze data. Kibana is used to present data. Beats are used to collect data. Logstash is used to centralize, transform, and store data. The main flow of processing the log is the following (forgot where to find the graph): Build ELK with Docker New Profile Under the elastic/config directory, cre ...

Posted by budz on Tue, 12 Oct 2021 18:36:50 +0200

Big data ELK in 2021: using VSCode to operate job search case of liepin.com

The most detailed big data ELK article series in the whole network. It is strongly recommended to collect and pay attention!   The new articles have listed the historical article directory to help you review the previous knowledge focus. catalogue Job search case of liepin.com 1, Demand Data set introduction 2, Create index 1. Cr ...

Posted by stunna671 on Sat, 02 Oct 2021 02:56:13 +0200

Analysis of Lucene from entry to normal use

Lucene (Chinese interpretation web search engine; full text search; search technology; vertical search engine;) About Lucene Lucene is a sub project of 4 jakarta project group of Apache Software Foundation, which is an open-source full-text search engine toolkit, but it is not a complete full-text sea ...

Posted by ckjian on Mon, 29 Jun 2020 03:36:01 +0200

ELK log system theory and several schemes

Log system scene In general, we need to do log analysis scenarios: directly in the log file, grep and awk can get the information they want. However, in large-scale scenarios, this method is inefficient, facing problems such as how to archive too much logs, how to do too slow text search, and how t ...

Posted by mschrank on Sat, 13 Jun 2020 13:10:05 +0200

This problem Maven relies on, you dare say you haven't met

If Maven's dependency is not handled properly, it often leads to some problems, which is very annoying. Today I'd like to share with you a dependency related problem that you may have encountered before. Problem background There is an ES search project, which is still in good condition at the beginning. After a while, it is found that the start ...

Posted by foxy69 on Sat, 30 May 2020 11:57:00 +0200

rpm package deployment elk7.3

ELK-7.3 Local Deployment 1. Introduction 1,logstash Logstash is a data analysis software designed to analyze log logs.The whole set of software can be thought of as an MVC model, with logstash as the controller layer, Elasticsearch as the model layer, and kibana as the view layer.First, the data is passed to logstash, which filters and formats ...

Posted by Willburt on Thu, 21 May 2020 18:51:35 +0200

configmap of k8s ~ fluent sets es index prefix

For the component fluent D, you are responsible for grabbing logs. You can grab logs from the docker console or from the specified folder. For the log files stored in the folder, we need to configure the logback first, and then configure the configmap of fluent D, so as to grab the persistent logs and push them to the elastic storage medium Ins ...

Posted by Iokina on Wed, 20 May 2020 18:16:58 +0200

Elastic search 7.1 in depth learning

1. elatic engineer certification examination If you have the strength, you can take the exam. It will be helpful for the appreciation and salary increase 2. es architecture Ecosphere install jvm configuration Install plug-ins Use elasticsearch plugin in elasticsearch-7.1.0/bin to install the plug-in. es will download a ...

Posted by oskom on Mon, 04 May 2020 14:05:17 +0200

ElasticSearch close restart command

ElasticSearch close restart command From: http://www.cnblogs.com/ae6623/p/5110927.html Many people learn elasticSearch by self-study. There is no answer to Baidu's question of how to restart es. I'm trying to figure it out. I hope I can help you. 1. How to close ES and elasticsearch 1. Use the head plug-in Find the node you wan ...

Posted by codered27 on Sun, 03 May 2020 14:54:12 +0200