Simple application of DataX
1. DataX template
Method 1: DataX configuration file template
python bin/datax.py -r mysqlreader -w hdfswriter
Method 2: Official Documents https://github.com/alibaba/DataX/blob/master/README.md
2. Synchronize Mysql data to HDFS cases
2.1 TableMode of mysqlreader
Use attributes such as table, column, and where to declare the data t ...
Posted by LonelyPixel on Tue, 11 Jan 2022 14:51:47 +0100
datax source code analysis - detailed explanation of task splitting mechanism
datax source code analysis - detailed explanation of task splitting mechanism
Write in front
The version of the source code analysis is 3.0. Because plug-ins are an important part of datax, the source code of plug-ins will be involved in the process of source code analysis. In order to maintain consistency, plug-ins have been illustrated by m ...
Posted by phpcip28 on Thu, 16 Dec 2021 02:50:49 +0100