Job Description
Job description:
Overview:
We are looking for Data Engineer to be part of our IT Business Insight and Analytics Team.
Job Description:
- Mining data from primary and secondary sources, then reorganizing said data in a format that can be used by next process such as data analytics, data science or any AI/ML processes
- Manage day-to-day operation in collecting, storing, processing and analyzing huge sets of data including construct data storages and data-access tools (Data Lake approach)
- Monitor overal performance and stability of the system, warehouse cleansing and ensure track pipeline stability
Job Requirements:
- Have at least 3 years of experience in Data Lake implementation
- Experience on design & setup Data Lake architecture, topology, and infrastructure
- Experience with ETL and ELT data pipeline hands-on & implementation
- Proficient with Data Lake related skills, such as : Object Storage, Hadoop, Cloudera, Spark, Kafka, Airflow,Dremio, Python, R, Docker, Kubernetes, Iceberg/HUDI, etc
- Good & have passion on data processing
- Working location: Serpong