(Senior) Data Engineer - Data Platform (m/f/d)
TLDR
Own end-to-end data pipelines across a multi-repo data platform, spanning orchestration, ingestion, and warehousing.
- Own data pipelines end to end: design, build, run, monitor, and troubleshoot across orchestration, transformation, lake ingestion, and cloud infrastructure.
- Build and maintain Apache Airflow workflows to schedule transformation jobs, ingestion tasks, and containerized workloads.
- Develop dbt models in Redshift (or a similar warehouse), including incremental strategies, data quality tests, and CI validation, and coordinate model selection and run parameters with orchestration.
- Design and build lake-layer pipelines (bronze, silver, gold, or your platform's equivalent), including replication, ETL/ELT jobs, and operational workloads for event-driven and near real-time use cases.
- Implement workloads as containerized services or serverless functions depending on what fits best, and manage batch jobs, platform monitoring workflows, and container image lifecycle.
- Manage cloud infrastructure and configuration: compute clusters, object storage, IAM, the data warehouse, networking, parameter stores, secrets, and access and grant management.
- Maintain CI/CD pipelines (for example, GitHub Actions) with secure cloud authentication, and own the flow from test to production.
- Investigate and resolve production incidents, including orchestration failures, transformation run issues, serverless errors, replication lag, performance bottlenecks, and data quality problems, using monitoring and alerting effectively.
- Follow the typical new source flow end to end: configure replication or ingestion, land the data in object storage, build the consumer or transformation layer, wire up the compute, orchestrate it, model it in the warehouse, and grant access.
- Infrastructure as Code (Terraform, CloudFormation).
- Event-driven architecture (Kafka or similar).
- Additional languages used in ingestion or operational repos, such as Go.
- Financial services or payments data pipelines experience.
- Search or indexing experience, Avro, or schema registries.
Benefits
Flexible Work Hours
Flexible working hours – helping you balance work and life
Free Meals & Snacks
Enjoy some fun moments with your coworkers – we throw a company party once a year and host several team events!
Home Office Stipend
Mobility support, whether you choose Swapfiets, Jobrad, or a Deutschlandticket - we've got you covered.
Learning Budget
Learning budget of 1000 euros per year – you can develop your passions with us.
Paid Parental Leave
Pension scheme, we want to give back and help you secure your future.
Remote-Friendly
15 days a year to work from your desired destination within the EU.
Wellness Stipend
Explore counseling assistance, be it for professional or personal matters, through our associated platform.
Unzer is a European fintech that simplifies international payments for e-commerce and retail businesses through a unified commerce platform. By merging the strengths of 13 companies, we build a comprehensive payment solution designed to enhance the shopping experience across borders. Our diverse team of over 700 experts is committed to enabling businesses to provide seamless payment experiences for their customers.