data engineer in Kuala Lumpur

posted
contact
jonathan sia, randstad
job type
permanent
salary
RM 5,000 - RM 10,000 per month

job details

posted
location
kuala lumpur, wilayah persekutuan
specialism
information technology
job type
permanent
working hours
Full-Time
salary
RM 5,000 - RM 10,000 per month
experience
5 years
reference number
91M0153910_1615268913
contact
jonathan sia, randstad
add to saved jobs print

job description

about the company

We are looking for a passionate Data Engineer specialised in managing, designing, developing and deliver data warehousing and pipelining the environment for one of the fastest growing e-commerce company in Malaysia.

  • Reporting to:Chief Data Scientist
  • Company Size: 50
  • Regions covered: Malaysia
  • Excellent remuneration package


about the job

  • Working with Chief Data Scientist to manage design and deliver data warehouse and pipeline for the organisation.
  • Develop ETL jobs, workflows and deployment of data solutions.
  • Monitor, recommend, develop and implement ways to improve data quality which include relaibility, efficiency and cleanliness to optimize and fine tune processes.
  • Prepare test datam create and execute test plans, test cases and test scripts.
  • Collaborate with different stakeholders to understand data needs, gather requirements and implement data solutions to deliver business goals.

skill/experience

  • Bachelors in IT, Computer Science or Engineering
  • Applicants with experience using AWS are highly favoured.
  • Ideally 3 to 5 years of experience in data warehouse, operational data store and large scale data architecture implementations in Unix/ Windows.
  • Good knowledge in SQL, Python, Javascript, Data Lake/AWS Lake Formation (S3), AWS lambda and AWS Glue
  • Strong hands-on development experience with ETL/ELT processes to transform complex data structures in a multi-data source environment.
  • Experience in big data technologies such as Hadoop, Hive, Spark, Sqoop, Kafka or Spark Streaming is an advantage.
  • Experienced in handling and processing different types of data (structured, semi-structured and unstructured).
  • Strong knowledge in handling different database technologies (e.g. RDBMS, NoSQL, DynamoDB, MPP-columnar-database and geodatabase).
  • Experience working with data visualization (e.g. Tableau, PowerBI, Qlikview) will be a plus
  • Proven track record of solving challenging problems by applying advanced analytics.
  • Good analytical ability, conceptual thinking, planning and organisational skills.
  • Good working knowledge of productivity tools such as G Suite, Git, Jira, Confluence.
  • Experience in the e-commerce industry is beneficial.

To apply online, please click on the appropriate link. Alternatively, please send your resume to jonathan.s@randstad.com.my (with subject title: Data Engineer or call Jonathan at 0138168988 if you are interested with the job)

Jonathan
Manager- Technology

skills

ETL, Python, SQL, Spark, Hive, Hadoop, Kafka

qualification

3 to 5 years of experience in data warehouse, operational data store and large scale data architecture implementations in Unix/ Windows
Good knowledge in SQL, Python.

responsibilities

● Design, develop, document and implement end-to-end data pipelines and data integration processes, both batch and real time on AWS ​EC2, EMR, RDS, Redshift
● Perform data analysis, data profiling, data cleansing, data lineage, data mapping and data transformation.
● Develop ETL / ELT jobs and workflows, and deployment of data solutions.
● Monitor, recommend, develop and implement ways to improve data quality including reliability, efficiency and cleanliness to optimize and fine tune process.

educational requirements

Bachelor Degree