ETL Process

image.png

1. Extracting

Extracting the data from different sources – the data sources can be files (like CSV, JSON, XML) or RDBMS etc.

2. Transforming

Transforming the data – this may involve cleaning, filtering, validating and applying business rules.

Cleaning (e.g. “Male” to “M” and “Female” to “F” etc.)
Filtering (e.g. selecting only certain columns to load)
Enriching (e.g. Full name to First Name , Middle Name , Last Name)
Splitting a column into multiple columns and vice versa
Joining together data from multiple sources

3. Loading

Loading – data is loaded into a data warehouse or any other database or application that houses data.

References:

http://blog.appliedinformaticsinc.com/etl-extract-transform-and-load-process-concept/

最后編輯于
?著作權(quán)歸作者所有,轉(zhuǎn)載或內(nèi)容合作請(qǐng)聯(lián)系作者
平臺(tái)聲明:文章內(nèi)容(如有圖片或視頻亦包括在內(nèi))由作者上傳并發(fā)布,文章內(nèi)容僅代表作者本人觀點(diǎn),簡(jiǎn)書系信息發(fā)布平臺(tái),僅提供信息存儲(chǔ)服務(wù)。

推薦閱讀更多精彩內(nèi)容

  • (一)90°的“早上好” 一早送兒子去幼兒園,走到教室門口,孩子突然彎腰90度,對(duì)著正在忙碌的老師深深鞠了一躬,同...
    何青1919閱讀 774評(píng)論 0 50
  • 鄉(xiāng)村魔術(shù)師。主角與被主角,壞人是被壞人,真真假假 一個(gè)魔術(shù)師從街邊盜竊了一個(gè)人的外表去到一個(gè)鄉(xiāng)村表演魔術(shù),然后詐騙...
    若是無鏑閱讀 271評(píng)論 0 0