Data Engineer

Roles and Responsibilities

• Design, develop and support data platform with large dataset for ad-hoc access, recurring reports
• Implement ELT/ETL processes from a wide variety of data sources using best practices while working with other technology teams
• Work with business teams and support their business analyst to understand their data needs, gather requirements and delivering dataset
• Work on automating/improving existing data sets, ETL/ELF pipelines

Basic Qualifications

• A Bachelor’s degree in Computer Science, or related technical discipline from premier institute
• 3-7 years of strong hands-on development experience
• 2+ years’ experience of hands-on big data experience
• Computer Science fundamentals in object-oriented design, design patterns, data structures, algorithm design and complexity analysis, operating system
• Should be excellent in problem solving skills
• Should be able to write high quality code - preferably in Java/Python/Ruby/C++
• Should have excellent written and verbal communication skills  Data modelling, SQL and Databases knowledge
• Deep understanding of HDFS, Hive, Spark, Kafka, Tez

Good to have

• Exposure to Amazon Web Services
• Exposure of BI tools like Tableau/Qliksense
• Experience of building applications with streams and complex event processing
• Should be able to prioritize in fast-moving complex environment and produce solutions despite complex requirements