Manager, Data Engineering (up to 80K)
Robert Walters
Hong Kong, HK

A Canadian multinational financial services provider

Individual Accountabilities :

  • Create standardised data engineering frameworks for data integration ELT / ETL programmes, design, plan and handle platform upgrade activities for our Enterprise Data Lake platform for Asia Data Office
  • Builds, codes, tests, maintain high quality software by working closely with QA team and country stakeholders
  • Perform POCs and generate valuable results together with new big data technologies based on team's strategies.
  • Participates in Agile sprints and ceremonies; supports rapid iteration and development
  • Translates user requirements into software requirements
  • Develops, maintains, and tests data pipelines, application framework, infrastructure for data generation; works closely with information architects and Data Scientists
  • Experience initialising and managing cloud platforms : AWS, Azure
  • Builds code to specifications and standards
  • Builds and codes moderately complex software
  • Minimal time coaching teammates
  • Contributes code across BUs
  • Has positive impact to specific organisational entities & has some understanding of the nature of the impact
  • Usually a top contributor to team's success
  • Designs and implements data architectures in production environments
  • Implements data orchestration pipelines, data sourcing, cleansing, augmentation and quality control processes
  • Translates business needs into data architecture solutions
  • Contributes to overall solution, integration and enterprise architectures
  • Develops data landscape modernisation architectures and roadmaps
  • Deploys machine learning models in production
  • Job Requirements :

  • Hands on Big data engineering skills i.e. Apache Nifi, Hive, Hbase, Hdfs and data streaming tools including kafka, Spark
  • Familiarity with agile and DevOps principles, test-driven development, continuous integration, and other approaches to accelerate the delivery of new features
  • Familiar with platform technologies i.e. HDP, HDF or any big data platform equivalent
  • Understanding of software development lifecycle
  • Understanding of how technology supports the firm’s business strategy
  • Familiar with modern software architectures and API-driven development
  • Familiar with traditional database technologies such as : Oracle, MySQL, Postgres, Hadoop, Spark
  • Familiar with technologies such as : Cloudera, Nifi, Hbase, Hive
  • Demonstrates all core skills, and good interpersonal skills for the role
  • Good working and background knowledge of area of practice
  • Use and combine knowledge of the discipline and the market to formulate the right approach
  • Participates in functional demos utilising new tech; designs own control structures
  • Fit for purpose, though may lack refinement
  • Sees actions partly in terms of longer-term goals
  • Understands the corporate climate & culture
  • Strong knowledge of the business
  • Understanding of relational and warehousing database technology working with at least one of the major databases platforms (e.
  • g., Oracle, SQLServer, Teradata, MySQL, or Postgres)

  • Practical experience with big data processing frameworks and techniques such as HDFS, MapReduce, Storage formats (Avro, Parquet), Stream processing
  • Solid working knowledge of data processing tools using SQL, Spark, Python or similar open source and commercial technologies
  • Knowledge of Spark, Java / Scala especially in relation to big data open source software preferred; knowledge of NiFi
  • Knowledge of NoSQL (HBase, MongoDB) databases preferred
  • Experience with integrating to back-end / legacy environments
  • Knowledge and familiarity with machine learning models application and production pipelines
  • BSc in Computer Science, Statistics, Informatics, Information System, Mathematics or equivalent quantitative field preferred
  • Collaborative attitude, willingness to work with team members; able to coach, participate in code reviews, share skills and methods
  • Constantly learns from both success and failure
  • Good organisational and problem-solving abilities that enable you to manage through creative abrasion
  • Good verbal and written communication; able to effectively articulate technical vision, possibilities, and outcomes
  • Experiments with emerging technologies and understanding how they will impact what comes next
  • Decision Authorities :

  • Able to achieve most tasks using own judgement
  • Can lead smaller groups where required
  • Drives 50% of the time in paired programming
  • Good analytical skills, copes with complex situations through deliberate analysis and planning
  • If you would like to apply for this role or find out more, please apply online or contact Mia Chan at Robert Walters on +852 2161 9403 or Mia.

    Chan quoting the Job Reference XCH / 859820

    通過點擊“持續”,我允許neuvoo同意處理我的數據並向我發送電子郵件提醒,詳見neuvoo的 隱私政策 。我可以隨時撤回我的同意或退訂。