Data Platform Engineer (Cat1)

Posted 24 August 2022
Salary 110-120K
Job type Permanent
DisciplineTechnology
Reference40270
ContactKaydash Cheung

Job description

To build and maintain data pipeline for data analytics objectives in an agile environment. To test and optimise the data pipeline to ingest clean and consolidate the various source data to deliver quality data in a timely manner using the available tools To classify and report on the ingested data to support the data governance objectives

Top 3 MUST have skills:

  1. ETL/ ELT (IBM Data Stage, SQL, Informatica, Talend or NiFi)
  2. Data Pipeline (Spark, Kafka or Python)
  3. Data modelling
  4. Orchestration – Airflow
  5. ELK Stacks

Good to have skills (Optional)

  1. DevOps
  2. Containerization (OpenShift, Docker)
  3. Agile
  4. Data Security (Encryption at rest, tokenisation, entitlement etc)