about the company.One of the largest retail organizations in South East Asia with different brands.about the team.the whole department under the CIO is about 800 people across 8 different countries.
Wihtin HK this is a team which will be about 5-8 people. currently looking for 3 / 4 new head account ranging from Data Engineer to Senior Manager.
about the job.The Data Engineer, is responsible for supporting day to day incident, change and problem management on a strategic enterprise data lake platform, which collects, store and provides access to Asia divisional data.
This platform also supports and enables analytics, digital transformation and operational improvements. This involves researching, recommending and choosing optimal problem solving solutions to manage and maintain the modern data architecture as well as maintaining and monitoring the success of these solutions.
The incumbent must have a passion for how data can be leveraged and used to drive deeper, meaningful insights that enhance the customer experience, grow our businesses, minimize risk and engage our employees globally.
skills & experiences required.Principal Duties and Responsibilities : The Data Engineer has primary responsibility for : Sustain the Modern Data Architecture : Setting the strategic rollout, selection and delivery of proven as well as emerging tooling to ensure that data pipelines are scalable, repeatable and secure serving multiple users within the organization.
Ensure the timely delivery and incident resolution to meet SLA by investigating issue and design and implement the resolution.
contribute and provide guidance around data quality, metadata management, data stewardship and security, and access controls.
Extensive expertise in data technologies and the use of data to support software development, advanced analytics and reporting.
Particular focus on Cloud (Azure) and Hadoop-based technologies and programming or scripting languages like Java, Scala, Linux, C++, PHP, Ruby, Python, R and SAS.
Working experience with modern data streaming process with Kafka, Apache Spark, Flink and data ingestion framework NiFi, Hive, Pig, etc.
Experience with security / data protection solutions, Kerberos, Active Directory, HDFS Access Control, OAuth2, OpenID, LDAPExperience with network layer security design in VPN, firewall, LoadbalancerExperience and capability in translating non-
technical user requests into complex technical specifications and solutions that meet these requirements;Excellent organizational and time management skills, with ability to multi-
task. Ability to work with minimal or no supervision while performing duties; has the ability and initiative to organize various functions necessary to accomplish department activities or goals and be a strong team player.