tHiveConnection
tJava:自己寫代碼
tHiveInput
tRowGenerator
tHDFSOutput
tHiveRow
- 查看文件列表
!sh hdfs dfs -ls -h /apps/hive/warehouse/cn_ods_businessplan.db/o_syn_bdg_hyper_bulk_i
hv 連接hive
查看表具體信息
desc formatted cn_ods_businessplan.o_syn_bdg_heper_bulk_i;
- hive動態分區
"set hive.exec.dynamic.partition.mode=nostrict"
"set hive.compute.query.using.stats=false"
- syn表寫入bas表
"insert overwrite table cn_ods_businessplan.o_bas_bdg_sams_total_d partition (day)
select t1.*,cast(end_date as string) as day from cn_ods_businessplan.o_syn_bdg_sams_total_i t1
"
- 取當前時間的年
Integer.parseInt(TalendDate.formatDate("yyyy",TalendDate.getCurrentDate()))
- 取當前時間的月
Integer.parseInt(TalendDate.formatDate("MM",TalendDate.getCurrentDate()))
- 轉換int
Integer.parseInt(StringHandling.RIGHT(cat.cat_nbr,2))+""
*拼接年月成 yyyy-mm-dd
Var.strYear + "-" + StringHandling.RIGHT("0"+Var.strMonth,2) + "-" + StringHandling.RIGHT("0"+da.Days,2)
*換取當前月的天數
Integer.parseInt(TalendDate.formatDate("dd", TalendDate.getLastDayOfMonth(TalendDate.getCurrentDate())))
- ODS層 syn又存成bas層 文件格式由text...到了orc...，orc對hive速度快
連接essbase
main
day D01
month Per01
