- Execute request for ingestion, creation and preparation of data sources
- Integrate data from multiple internal and external sources to the Analytics environment, to be used for Analytics models and solutions
- Deliver data sourcing approach and datasets for analysis, with activities including data staging, ETL, data quality and archiving
- Create logical and physical data model structures to enhance performance of the application by creating aggregation and summarization structures
- Implement data quality standard and metrics
- Improve processes and methodologies to ensure all data-driven use cases can be delivered, can create value, and is sustainable according to the highest level of quality
- Collaborate with analytics analyst to understand, communicate, and implement Analytics and process best practices
Data Engineer
Deskripsi Pekerjaan
Syarat Pekerjaan
- Bachelor Degree in Statistics, Mathematics, Computer Science or equivalent
- Having at least 3-5 years experience as Data Engineer
- Hands on experience developing and managing cloud data infrastructure (GCP preferred)
- Familiarity in Pyspark / Scala data lake & data warehouse development
- Experience in Advanced SQL DB design
- Good understanding in developing data pipelines & scheduler (Airflow / Beam, etc)
- Familiar with Hadoop & Hive Table cluster
Tentang
Companies
Teams
- Tech Data
Levels
- Mid-Senior Level