data engineer/scientist (senior/lead) in Kuala Lumpur

posted
contact
winnie tan, randstad
job type
permanent
salary
RM 7,000 - RM 18,000 per month

job details

posted
location
kuala lumpur, wilayah persekutuan
specialism
information technology
job type
permanent
working hours
Full-Time
salary
RM 7,000 - RM 18,000 per month
experience
3 years
reference number
91M0153211_1619167897
contact
winnie tan, randstad
add to saved jobs print

job description

  • Competitive Salary Package and Benefits
  • Exciting Work Culture
  • Work Life Balance

about the company

Your future employer is a well established eCommerce landscape through a cutting-edge platform and financial reporting agency with presence around the globe. Your future employer is a great organization that supports and encourages career growth and excellence.


about the job

  • Design, develop, document & implement end-to-end data pipelines and data integration processes, both batch and real time on AWS EC2, EMR, RDS, Redshift
  • Perform data analysis, data profiling, data cleansing, data lineage, data mapping & data transformation.
  • Develop ETL / ELT jobs and workflows, & deployment of data solutions.
  • Recommend, execute & deliver best practices in data management and data lifecycle processes, including modular development of data processes, coding and configuration standards, error handling and notification standards, auditing standards, and data archival standards.
  • Prepare test data, create & execute test plans, test cases and test scripts.
  • Collaborate with different stakeholders to understand data needs, gather requirements & implement data solutions to deliver business goals.
  • Provide technical support for any data issues and change requests, document all investigations, findings, recommendations and resolutions.
  • Collaborate & work across functional and multidisciplinary teams in a dynamic environment to develop an understanding of evolving/agile business needs.

requirements

  • Bachelors in IT, Computer Science or Engineering
  • Applicants with experience using AWS are highly favoured.
  • Ideally 3 to 5 years of experience in data warehouse, operational data store & large scale data architecture implementations in Unix/ Windows
  • Good knowledge in SQL, Python, Javascript, Data Lake/AWS Lake Formation (S3), AWS lambda and AWS Glue
  • Strong hands-on development experience with ETL/ELT processes to transform complex data structures in a multi-data source environment.
  • Experience in big data technologies such as Hadoop, Hive, Spark, Sqoop, Kafka or Spark Streaming is an advantage
  • Experienced in handling & processing different types of data (structured, semi-structured and unstructured).
  • Strong knowledge in handling different database technologies (e.g. RDBMS, NoSQL, DynamoDB, MPP-columnar-database and geodatabase).
  • Experience working with data visualization (e.g. Tableau, PowerBI, Qlikview) will be a plus
  • Good analytical ability, conceptual thinking, planning and organisational skills.
  • Good working knowledge of productivity tools such as G Suite, Git, Jira, Confluence.
  • Experience in the e-commerce industry is beneficial.

If you share the same passion, fun, energetic and would like to work in a progressive and forward thinking environment, kindly send your updated CV to us by applying. I will reach out to you as soon as I can!

Winnie Tan | Randstad | winnie.tan@randstad.com.my

skills

ETL

qualification

Diploma/Degree

educational requirements

Associate Degree/Diploma