DataEngineer,GDT(ESG)

GovTech is the lead agency driving Singapore’s Smart Nation initiatives and public sector digital transformation. As the Centre of Excellence for Infocomm Technology and Smart Systems (ICT diagnose issues and deploy measures to prevent recurrence; ensure maximum database uptime. Construction, testing, and maintenance of reusable data models and data structures to support downstream analytics and data science workloads. Design and build secure mechanisms for end users and systems to access data in data warehouse. Research, propose and develop new technologies and processes to improve agency data infrastructure. Collaborate with data stewards to establish and enforce data governance policies, best practices and procedures. Maintain data catalogue to document data pipelines, datasets, metadata, and dependencies. Execution of data quality checks, validation processes, and basic reconciliation to ensure data accuracy and consistency. Implement and enforce data security best practices, including access control, encryption, and data masking, to safeguard sensitive data. Monitoring and troubleshooting of data pipeline performance, reliability, and operational issues. Strong attention to data accuracy, reliability, maintainability, and operational robustness. What we are looking for Deep understanding of system design, data structure and algorithms, data modelling, data access, and data storage. Demonstrated ability in using cloud technologies such as AWS, Azure, and Google Cloud. Experience in architecting data and IT systems. Experience with distributed data technologies such as Spark, Hadoop. Proficiency in programming languages such as Python, Java, or Scala. Proficiency in writing SQL for databases. Familiarity with building and using CI/CD pipelines. Familiarity with DevOps tools such as Docker, Git, Terraform. Sound understanding of ETL and ELT concepts, data modeling principles, and data warehousing practices. Ability to collaborate effectively with analysts, data sc