Hadoop 07: introduction to SecondaryNameNode and DataNode

1, Introduction to SecondaryNameNode When analyzing the edits log files just now, we have introduced the SecondaryNameNode. Here is a summary to show our attention. The secondary namenode is mainly responsible for regularly merging the contents of the edits file into the fsimage This merge operation is called checkpoint. When merging, the co ...

Posted by abselect on Wed, 02 Mar 2022 01:47:02 +0100

Mr. Cappuccino's 18th cup of coffee -- design mode of gold, silver and four-sided test questions

1. Why do you need to use design patterns? Using design patterns to reconstruct the whole code can improve the reusability and scalability of the code and reduce code redundancy. 2. Talk about the six principles of design mode? Open Close Principle: the Open Close Principle is open to extensions and closed to modifications. When the prog ...

Posted by nitediver on Sat, 26 Feb 2022 11:18:56 +0100

[pit filling trip hadoop-05] Hadoop 2.10.1 Mr custom sorting grouping FlowSumArea/SortMR Partitioner/ WritableComparable inverted index

job submission process - supplemental map task returns the processing result to MRAPPmaster reduce task combines the map processing results, processes the operations, and then outputs them 1. Steps to realize Zoning: 1.1 First analyze the specific business logic to determine how many partitions there are 1.2 First write a class that inher ...

Posted by zhabala on Mon, 01 Nov 2021 01:05:59 +0100