Loading...

Senior Data Engineer

Kuala Lumpur, Kuala Lumpur, Malaysia

Senior Data Engineer

Kuala Lumpur, Kuala Lumpur, Malaysia

Job Responsibilities:

  • Design, develop, test, install and support programs/systems. Support projects proposals on the basis of cost/benefit justification interfacing with stakeholders across functional and geographical lines.
  • Meet with customers to understand needs and requirements and make recommendations on best practice systems solutions for small to medium size/complexity/risk projects.
  • Analyze detail systems factors: input/output requirements, information flow, hardware and software requirements, alternative approaches, etc.
  • Validate alternative problem management proposals and make decisions on solutions.
  • Provide technical assistance to other  colleagues and assist in resolving problems reported by less senior team members.
  • Provide technical guidance to customers and act as mentor to less senior team members. May give presentations to management and customers.
  • May prepare and complete systems documentation and operating procedures.
  • May lead design review meetings for small to medium size/complexity/risk projects.
  • May coordinate and monitor the activities, such as schedules and costs, of a small project team.
  • Evaluate and recommend technical feasibility and estimates of the proposed systems solutions.
     

 

Job Responsibilities:

  • Design, develop, test, install and support programs/systems. Support projects proposals on the basis of cost/benefit justification interfacing with stakeholders across functional and geographical lines.
  • Meet with customers to understand needs and requirements and make recommendations on best practice systems solutions for small to medium size/complexity/risk projects.
  • Analyze detail systems factors: input/output requirements, information flow, hardware and software requirements, alternative approaches, etc.
  • Validate alternative problem management proposals and make decisions on solutions.
  • Provide technical assistance to other SWIFT colleagues and assist in resolving problems reported by less senior team members.
  • Provide technical guidance to customers and act as mentor to less senior team members. May give presentations to management and customers.
  • May prepare and complete systems documentation and operating procedures.
  • May lead design review meetings for small to medium size/complexity/risk projects.
  • May coordinate and monitor the activities, such as schedules and costs, of a small project team.
  • Evaluate and recommend technical feasibility and estimates of the proposed systems solutions.
     

 

Job Description:

  • At least 5 to 10 + years of relevant experience in software development in an international setting. 
  • Proven experience in Data engineering and Software development practices.

 

Must Have:

  • Education and experience in programming languages and their design patterns (mainly Java, Python, Unix Shell scripting)
  • Understanding of containerization technologies like Openshift and Kubernetes
  • Experience with massive object storage services (Amazon S3 storage or equivalent) is a plus
  • Solid understanding of Data Engineering, data hub, data lake and data warehousing concepts
  • Experience in continuous integration/delivery build environment: GIT, Jenkins, Maven, Coverage and Static/Dynamic Code Analysis tools.
  • Experience with Agile Tools (JIRA, Confluence, BitBucket, Github)

 

Good To Have:

  • Apache Data management tools (Spark, Kafka, NiFi, Airflow)
  • Red Hat Linux
  • Elasticsearch/Kibana and Oracle databases.
  • Helm Charts / Infrastructure-as-code / Terraform
  • Experience in handling PKI / TLS

 

Professional Skills Requirement:

  • Creativity and innovation
  • Adaptability and responsiveness to change
  • Take accountability for delivering results
  • Strong communication skills, both written and oral
  • Time management, planning and organizing
  • Ability to work well in both a team and individual environment
  • Quality oriented
  • Engaged and team oriented
  • Open communication
  • Has experience doing on-call support