Underlying implementation principle of Spark SQL
1. Spark SQL architecture design
The development of big data is realized by using SQL directly. It supports both DSL and SQL syntax style. At present, in the whole architecture design of spark, all spark modules, such as SQL, SparkML, sparkGrahpx and structured streaming, run on the catalyst optimization & tungsten execution module, The fo ...
Posted by Rochtus on Sat, 29 Jan 2022 23:46:11 +0100