Spark SQL: API for structured data operation based on spark
Introduction to Spark SQL
Spark SQL is one of the most complex components in spark technology. It provides the function of operating structured data in Spark Program, that is, SQL query. Specifically, spark SQL has the following three important features:
1.Spark SQL supports reading of multiple structured data formats, such as JSON,Parquet ...
Posted by Xurion on Thu, 23 Sep 2021 06:12:04 +0200
ClickHouse Advanced Optimize Explain View Execution Plan
This article is about Learning Guide for Big Data Specialists from Zero (Full Upgrade) ClickHouse: Partial supplement.
0 Explain View Execution Plan
To view the execution plan of an sql statement before Clickhouse version 20.6, you need to set the log level to trace to be visible and can only actually execute sql and view it in the executio ...
Posted by Doug G on Wed, 22 Sep 2021 19:44:28 +0200
Chapter III to be sorted out
1 View
The difference between a view and a table: "Is the actual data saved?""Views are not tables. Views are virtual tables. Views depend on tables."
1.1 Create View
CREATE VIEW <View Name>(<Column Name 1>,<Column Name 2>,...) AS <SELECT Sentence>
-- Create views based on multiple tables wit ...
Posted by optikalefx on Mon, 20 Sep 2021 17:36:37 +0200
Multiplexing IO epol poll select pool zero copy read / write context switching mmap
High performance server, network theoretical knowledge and operating system
High performance server
Improve server performance
1. I/O model
Blocking IO (not appropriate)
Program blocking and read / write function when there is no data to read, the program blocks until the data is read successfully
Blocking process: the time period whe ...
Posted by mattpointblank on Mon, 20 Sep 2021 15:30:51 +0200
SQL programming task02 job - basic query and sorting
1 operator
1.1 arithmetic operators
meaningoperatoraddition+subtraction-multiplication*division/
1.2 comparison operators
operatormeaning=Equal to<>And ~ are not equal>=Greater than or equal to>greater than<=Less than or equal to<less than
2 exercise part 1 - query
2.1 writing the product table
The SQL code is as foll ...
Posted by jzimmerlin on Mon, 20 Sep 2021 03:45:43 +0200
Online Exercise for True Question of Interview in Shilala sql Internet Factory
1. sql Title Brushing
There are two main purposes to do this topic, preparing for the interview and understanding the business logic and thinking style of the data analyst in practice. Most of the data analysts are biased toward the business side, with the indicators increasing or decreasing, how to analyze, from which angles to analyze, c ...
Posted by kabucek on Mon, 20 Sep 2021 00:09:34 +0200
MySQL table creation, addition, deletion, modification and query
Build table
1. Table building syntax
Table creation belongs to DDL statements, including create, drop and alter
create table Table name (field name 1 data type, field name 2 data type, field name 3 data type,)
2. Data type
varchar: variable length string, which is slow and saves space
char: fixed length string. Regardless of the actual d ...
Posted by ravi_aptech on Sun, 19 Sep 2021 20:32:53 +0200
Basic use of MySQL (addition, deletion, modification and query)
catalogue
1, Advantages
2, Create databases and tables
3, Basic usage syntax (addition, deletion, modification and query)
1. Increase
2. Delete
3. Change
4. Check
1, Advantages
Simple: compared with other large databases, MySQL is a relatively simple database system, which is easier to use than XiaobaiEconomy: compared with s ...
Posted by izlik on Sat, 18 Sep 2021 05:57:06 +0200
Database foundation ②
❣💞❣ Database foundation ②
1, 92 syntax join table query
1. Cross connect: corss join
-- Cross connect
select * from emp cross join dept;
2. natural join
Note: if there are multiple fields with the same name, they will be connected equally
-- Inner connection
select * from emp natural join dept;
3. Using connection: Join using ( ...
Posted by sheraz on Fri, 17 Sep 2021 01:28:24 +0200
Force buckle simple database
Indexes
Unique index: a unique index does not allow two rows to have the same index valuePrimary key index: defining a primary key for a table will automatically create a primary key index, which is a special type of unique index. The primary key index requires that each value in the primary key is unique and cannot be emptyClustered index ...
Posted by mduran on Wed, 15 Sep 2021 22:29:13 +0200