Data Engineer II
TLDR
Lead development of scalable, high-performance data pipelines and real-time processing, shaping architecture, improving reliability, and mentoring junior engineers.
-
Architect and build scalable, high-performance ETL/ELT pipelines for large datasets.
-
Design and implement real-time data processing solutions.
-
Ensure data integrity, governance, and compliance with industry regulations.
-
Optimize data storage and query performance in cloud-based environments.
-
Automate data engineering workflows using Apache Airflow and CI/CD pipelines.
-
Collaborate with cross-functional teams to enhance data accessibility and reliability.
-
Bachelor’s degree in Computer Science, Engineering, or equivalent and 2-4 years of relevant experience is required. Alternatively, an equivalent combination of education and experience is required.
-
Experience with e-commerce and with specific experience of Shopify a plus!
-
Expertise in SQL and one programming language (Python, Java, or Scala).
-
Strong experience with relational (MySQL, PostgreSQL) and NoSQL databases (MongoDB, DynamoDB).
-
Hands-on experience in designing, developing big data solutions using Apache Spark (PySpark/Scala) and real-time streaming technologies like Kafka or Kinesis
-
Experience with AWS cloud services (EMR, Glue, S3, Redshift) and Databricks for scalable data processing
-
Hands-on experience in designing, orchestrating, and optimizing ETL/ELT pipelines using Apache Airflow
-
Strong understanding of CI/CD for deploy workflows
-
Experience working in Agile environments
-
Strong problem-solving skills and ability to lead data initiatives.
- Fluent in English (Written and Verbal)
Benefits
Health and wellness benefits
Generali Health Care, annual check-up.
Learning and development resources
Technical and general workshops, online resources.
International exposure and skill development
Enhance expertise and English communication skills.
Paid time off
20 days/year, in addition to Vietnam holidays.
Remote-Friendly
Work from anywhere that brings you happiness.
Wellness allowance
Support for classes promoting physical and mental health.
Clearer.io enhances eCommerce through innovative apps that improve search, discovery, and customer engagement. We empower our partners with tools designed to streamline operations, foster trust, and drive sustainable growth, helping businesses thrive in a competitive online landscape.