CREATEQ
Senior Data Engineer
TLDR
Build and optimize real-time data pipelines and in-house streaming databases, delivering scalable data services in collaboration with stakeholders.
- Working with stakeholders to grow the amount and kinds of customer-defined targetings we can calculate in real-time
- Develop new features for our in-house streaming key/value DBs
- Improve resource utilization across all stages of our data pipelines, from validation and ingestion to storage to dynamic queries
- Collaborate with developers and stakeholders to design services in order to meet product and business requirements
Requirements
- Strong experience designing, building, implementing, and maintaining large real-time data pipelines with Kafka and Kafka Streams
- Significant expertise with data consistency, throughput, and event-driven system concepts
- Fluent in Python and/or Java
- Familiar with designing and deploying data jobs
- Experience with managing and monitoring service infrastructure and deployments
- Worked with Kafka, Kafka Streams, Trino (or any distributed SQL engine), Airflow, Kubernetes, Docker, Helm, Jenkins, Prometheus, Grafana, Elasticsearch
- Nice to have: Basic knowledge of AWS services such as S3 and RDS, and Terraform
Benefits
- Challenging projects in a highly professional, but also a collaborative and supportive environment
- Working in small and excellently skilled teams
- Opportunity for long-term professional growth within our development center
- Competitive compensation depending on experience and skills
- Respect and support for your professional, family and personal goals
CREATEQ delivers advanced AI solutions tailored for modern software development challenges. Serving businesses in high-stakes industries like aviation and banking, we provide comprehensive services that include custom software engineering, cybersecurity, and AI-driven modernization. Our unique candidate matching system ensures that clients get the right talent quickly, enabling seamless scaling and optimal resource management for their tech needs.
Senior Data Engineer