需要背记的内容

hive建表语句

  1. create table 表名(
  2. )
  3. partitioned by (etldata string)
  4. row format delimited fields terminated by ',';

alter table customer add partition(etldata=’2022-04-10’); 添加静态分区

连接数据库

  1. val url="jdbc:mysql://master:3306/test?useUnicode=true&characterEncoding=utf-8"
  2. val prop=new Properties()
  3. prop.put("user", "root")
  4. prop.put("password", "123456")
  5. prop.put("driver", "com.mysql.jdbc.Driver")
  1. /user/local/src/spark-standalone/bin/spark-submit \
  2. -- class Test_MySQL_To_Hive.part \
  3. -- master spark://master:7077 \
  4. /user/local/src/data/spark.jar 10

/user/local/src/spark-standalone/bin/spark-submit
—class Test_MySQL_To_Hive.part
—master spark://master:7077
/user/local/src/data/spark.jar 10