Hadoop 07: introduction to SecondaryNameNode and DataNode
1, Introduction to SecondaryNameNode
When analyzing the edits log files just now, we have introduced the SecondaryNameNode. Here is a summary to show our attention.
The secondary namenode is mainly responsible for regularly merging the contents of the edits file into the fsimage
This merge operation is called checkpoint. When merging, the co ...
Posted by abselect on Wed, 02 Mar 2022 01:47:02 +0100
Mr. Cappuccino's 18th cup of coffee -- design mode of gold, silver and four-sided test questions
1. Why do you need to use design patterns?
Using design patterns to reconstruct the whole code can improve the reusability and scalability of the code and reduce code redundancy.
2. Talk about the six principles of design mode?
Open Close Principle: the Open Close Principle is open to extensions and closed to modifications. When the prog ...
Posted by nitediver on Sat, 26 Feb 2022 11:18:56 +0100
[pit filling trip hadoop-05] Hadoop 2.10.1 Mr custom sorting grouping FlowSumArea/SortMR Partitioner/ WritableComparable inverted index
job submission process - supplemental
map task returns the processing result to MRAPPmaster reduce task combines the map processing results, processes the operations, and then outputs them
1. Steps to realize Zoning:
1.1 First analyze the specific business logic to determine how many partitions there are
1.2 First write a class that inher ...
Posted by zhabala on Mon, 01 Nov 2021 01:05:59 +0100