Search Results

Data Engineer (Information Processing & Analytics)

Apply now Agency: Centre for Strategic Infocomm Technologies
Job no.: 492889
Work type: Permanent
Location: Singapore
Categories: InfoComm, Technology, New Media Communications, Engineering

CSIT develops products to advance the national security interests of Singapore. Our products are used in a wide range of operations, including but not limited to, Counter-terrorism and Computer Network Defense. We are looking for talented data engineers to empower teams working on mission-critical products that identify, analyse and disrupt threats by fulfilling their data requirements.

Role

As a data engineer, you will play a key part in advancing the national security of interests of Singapore by delivering timely and complete data to product teams. You will have the opportunity to design innovative data solutions and solve challenging problems on petabyte-scale datasets. You will have the freedom to determine the best way to deliver value, be it developing from scratch or building upon the best solutions from the developer community.

Responsibilities

  • Design, develop and support data warehouses, dashboards, and reporting tools
  • Work with other data engineers and stakeholders to design and spec ETL pipelines that are accurate, timely and suitable for downstream use cases
  • Build scalable and reliable ETL pipelines and processes to handle data from a large number and variety of data sources
  • Identify and recommend different ways to constantly improve data reliability and quality.
  • Implement data access and security to allow data scientists and analysts to access data easily

Requirements

Minimum requirements

  • 3+ years of coding experience in Java and Python
  • Experience in handling large data sets (minimum 100GB per day) and working with structured and unstructured data using traditional and distributed systems
  • Experience in designing data models and data warehouse
  • Experience in SQL and NoSQL database management systems
  • Experience in Apache Nifi, Apache Spark and Apache Kafka

Nice-to-haves

  • Deep understanding of databases and engineering best practices - include handling and logging errors, monitoring the system, building human-fault-tolerant pipelines, understanding how to scale up, addressing continuous integration, knowledge of database administration, maintaining data cleaning and ensuring a deterministic pipeline
  • Experience in statistical modeling and machine learning

As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.

Advertised:
Applications close:

Back to search results Apply now

Share this:

| More
Back To TopTOP