Getting started with Elasticsearch: document data format, simple es restful api
1. Doument data format
1.1 Document Oriented Search and Analysis Engine
1.1.1 Object data stored in database
The data structure of the application system is object-oriented and complexObject data is stored in a database and can only be disassembled to become flat multiple tables. It is cumbersome to restore the object format each time yo ...
Posted by wiseass on Fri, 22 Oct 2021 19:39:37 +0200
ELK Stack(Elasticsearch, Kibana, Beats and Logstash) sets up a log collection system
Elasticsearch is used to search for and analyze data.
Kibana is used to present data.
Beats are used to collect data.
Logstash is used to centralize, transform, and store data.
The main flow of processing the log is the following (forgot where to find the graph):
Build ELK with Docker
New Profile
Under the elastic/config directory, cre ...
Posted by budz on Tue, 12 Oct 2021 18:36:50 +0200
Big data ELK in 2021: using VSCode to operate job search case of liepin.com
The most detailed big data ELK article series in the whole network. It is strongly recommended to collect and pay attention!
The new articles have listed the historical article directory to help you review the previous knowledge focus.
catalogue
Job search case of liepin.com
1, Demand
Data set introduction
2, Create index
1. Cr ...
Posted by stunna671 on Sat, 02 Oct 2021 02:56:13 +0200
Analysis of Lucene from entry to normal use
Lucene (Chinese interpretation web search engine; full text search; search technology; vertical search engine;)
About Lucene
Lucene is a sub project of 4 jakarta project group of Apache Software Foundation, which is an open-source full-text search engine toolkit, but it is not a complete full-text sea ...
Posted by ckjian on Mon, 29 Jun 2020 03:36:01 +0200
ELK log system theory and several schemes
Log system
scene
In general, we need to do log analysis scenarios: directly in the log file, grep and awk can get the information they want. However, in large-scale scenarios, this method is inefficient, facing problems such as how to archive too much logs, how to do too slow text search, and how t ...
Posted by mschrank on Sat, 13 Jun 2020 13:10:05 +0200
This problem Maven relies on, you dare say you haven't met
If Maven's dependency is not handled properly, it often leads to some problems, which is very annoying. Today I'd like to share with you a dependency related problem that you may have encountered before.
Problem background
There is an ES search project, which is still in good condition at the beginning. After a while, it is found that the start ...
Posted by foxy69 on Sat, 30 May 2020 11:57:00 +0200
rpm package deployment elk7.3
ELK-7.3 Local Deployment
1. Introduction
1,logstash
Logstash is a data analysis software designed to analyze log logs.The whole set of software can be thought of as an MVC model, with logstash as the controller layer, Elasticsearch as the model layer, and kibana as the view layer.First, the data is passed to logstash, which filters and formats ...
Posted by Willburt on Thu, 21 May 2020 18:51:35 +0200
configmap of k8s ~ fluent sets es index prefix
For the component fluent D, you are responsible for grabbing logs. You can grab logs from the docker console or from the specified folder. For the log files stored in the folder, we need to configure the logback first, and then configure the configmap of fluent D, so as to grab the persistent logs and push them to the elastic storage medium Ins ...
Posted by Iokina on Wed, 20 May 2020 18:16:58 +0200
Elastic search 7.1 in depth learning
1. elatic engineer certification examination
If you have the strength, you can take the exam. It will be helpful for the appreciation and salary increase
2. es architecture
Ecosphere
install
jvm configuration
Install plug-ins
Use elasticsearch plugin in elasticsearch-7.1.0/bin to install the plug-in. es will download a ...
Posted by oskom on Mon, 04 May 2020 14:05:17 +0200
ElasticSearch close restart command
ElasticSearch close restart command
From: http://www.cnblogs.com/ae6623/p/5110927.html
Many people learn elasticSearch by self-study. There is no answer to Baidu's question of how to restart es. I'm trying to figure it out. I hope I can help you.
1. How to close ES and elasticsearch
1. Use the head plug-in
Find the node you wan ...
Posted by codered27 on Sun, 03 May 2020 14:54:12 +0200