Senior Assoc, Application Developer (Data Engineering), Middle Office Technology - Finance Platform, Group Technology

Business Function

Group Technology enables and empowers the bank with an efficient, nimble and resilient infrastructure through a strategic focus on productivity, quality & control, technology, people capability and innovation. In Group Technology, we manage the majority of the Bank's operational processes and inspire to delight our business partners through our multiple banking delivery channels.

Responsibilities

• Design, develop, and maintain scalable data pipelines and applications within the Hadoop ecosystem.
• Perform performance tuning of SQL and Spark ETL processing to optimize system efficiency and reduce latency.
• Implement batch automation using Shell scripts and REST APIs, including job triggering and result parsing.
• Manage data storage, ingestion, and retrieval processes using HDFS and Parquet
• Develop robust scripts using Shell, Python, and Scala to automate operational workflows and system integrations.
• Utilize AWS products, such as S3 Storage, for cloud-based data management and integration.
• Troubleshoot, debug, and resolve complex technical issues within Linux/Unix environments.

Requirements

• Proven experience in application development within a large-scale enterprise technology environment.
• Strong technical expertise in Hadoop, HDFS, Hive, and Impala.
• Proficiency in Spark (Scala/Java) and SQL.
• Hands-on experience with data serialization and storage formats including Parquet
• Demonstrated ability in the performance tuning of SQL and Spark ETL processing.
• Strong command of Linux/Unix systems and command-line tools.
• Expertise in scripting using Shell, Python, and Scala.
• Experience in batch automation using Shell scripts and REST APIs, including triggering and result parsing.
• Familiarity with cloud technologies, specifically AWS products such as S3 Storage.
• Strong problem-solving skills and a can-do attitude, with the ability to develop solutions.

Location:

DBS Asia Hub

Job:

Technology

Schedule:

Regular

Employee Status:

Full time