Platform Engineer - Data Exploration Platform Management

Job description

CSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of operations, including but not limited to Counter-terrorism and Computer Network Defence. Join the awesome CSIT family and use cutting-edge technologies to protect the nation. We are looking for talented engineer to manage the Data Exploration Platform. This platform helps our users to understand and derive insights from their data. It allows users to explore, visualize, and interact with data in a flexible and intuitive way. ### Role - We are seeking an experienced engineer to join our team, responsible for managing and optimizing our Data Exploration Platform. The successful candidate will be responsible for ensuring the resiliency, stability, security and performance of our platform, as well as providing technical expertise to support the development of data analytics and visualizations solutions. ### Responsibilities - Develop and deploy reliable, scalable and secure Data Exploration Platform solutions - Manage the platform, including upgrades, patches, configuration changes, system resource allocation and utilization - Optimize the performance of our platform, including troubleshooting and resolving issues related to data processing and query performance - Identify opportunities for process improvements and implement changes to optimize the use of our platform. - Ensure the security and compliance of our platform, including implementing and enforcing data access controls, authentication and authorization. - Provide technical expertise and support to our stakeholders, including training and guidance on the use of our platform. - Identify technology and system pitfalls and bring industry standards and best practices to the team ### Requirements (Minimum Qualifications) - Background in Computer Engineering, Computer Science or equivalent experience - Good Knowledge of data science and machine learning concepts and tools, such as Python, R, or SQL. - Good understanding of data modelling, data architecture, and data quality principles. - Experience with agile development methodologies, such as Scrum or Kanban. - Competent in programming languages such as Scala, Python, Java - Competent in using DevOps tools and CI/CD pipelines effectively ### Nice to Have - Good technical skills in areas such as data warehousing, ETL, data governance, and data visualization. - Experience with cluster management and DevOps tools (e.g. Ansible, Kubernetes) - Experience working in an agile and innovative environment - Experience in distributed systems - Experience with cloud-based analytics platforms, such as AWS or Azure. - Experience with Tableau Server, including design, implementation, and maintenance. ### Why join us? - The work is purposeful and meaningful - You will work with the best engineers - We work with modern technologies and tech stacks - We have excellent engineering culture and work-life balance - We aspire to engineering and operational excellence - We empower to innovate - We grow together as a family