Sparkcentral is hiring a

Sr. Data Engineer

San Francisco, United States


Why Join Us?

We all know that excellent customer service keeps customers coming back for more. At Sparkcentral, we really get that, and our small company works with some of the most amazing brands out there, (Uber, Dropbox, Delta Air Lines, Netflix, Jetblue, Discover, Nordstrom, etc.) to help deliver quick and efficient customer engagement.

Sparkcentral has quickly become an industry thought-leader that is changing the way enterprises help and engage customers. Our goal is to inspire and enable amazing customer experiences, and we’re doing this by completely re-imagining what enterprise customer service software should look like.

You would be joining a group of extraordinarily talented people who are dedicated, hardworking, and passionate about customer care.  We work at an incredible pace, but also have fun while doing it. We need you to bring your skills and insight to the table and work with us to help make our product better.  In other words, we hire people who have tremendous drive, organization, and, above all, passion.  Sound like you? Let’s talk.


What you will do

You will be responsible for the implementation and ongoing administration of the Data Infrastructure/pipelines. You need to be up for the challenge and ready to develop data pipelines for our data platform using a variety of tools such as Kafka, Hadoop and Cassandra, Storm and Spark. There are many Big Data tools on the market, and it’s important that the choice of using a particular tool can be defended (not used just because it's trendy). We need you to be an engineer who has experience learning new technologies, can work with a variety of approaches, and who also has worked with data in a variety of contexts. You will imagine, implement, test, and iterate on our architecture and new features while also constantly looking for ways to improve parts of the infrastructure.

You also need to be passionate about mentoring and ready to drive the entire engineering team on the best practices of data management. You’ll be a part of many projects and will be enabling the team to think about everything in terms of data. You'll be solving high volume, low latency problems using various statistical/mathematical models and scaling a web application that is used by some of the world’s largest brands. You’ll be working in a diverse, dynamic environment that leverages multiple tools and languages while constantly trying to find ways to remove obstacles, and weaknesses that slow you down. You’ll be getting your hands dirty. Seriously.


Other Responsibilities and requirements

  • You must understand how your work ties back to the customer at all times
  • 5+ years of experience with building out data-driven projects at a large scale where you’ve owned the end-to-end data pipeline
  • Significant experience with at least one of: MySQL, Postgres, Kafka, Cassandra, Hadoop, or HBase
  • Extremely methodical - you’ll want to ensure data quality and consistency is priority number one at all times
  • You must code, really. Preferably in Java (Spring) or Scala (Play)
  • Familiarity of ETL and Data Warehousing concepts (Kimball Methodology)
  • Strong intra-team communication and ability to express ideas
  • Dedication to unit testing, code review and other quality-oriented practices


Nice to haves

  • Experience with scaling Kafka and Cassandra
  • Previous environment with mentoring experience
  • Experience with distributed microservices


Our Environment

  • JIRA // Confluence // Bitbucket Server
  • AWS (EC2, EBS, ELB, S3)
  • MySQL (Galera) // Redis // Kafka
  • Linux // nginx
  • Java // Spring // Scala // PHP
  • Node.js // Backbone.js // Marionette
  • Elasticsearch // Cassandra
  • Vagrant // Ansible



  • Competitive salary + equity + medical/dental/vision benefits
  • Unlimited vacation time
  • Tons of drinks and snacks in the office
  • Our fancy espresso machine (aka Optimus Grind) that makes everything from lattes to cappuccinos to irish coffees at the click of a button
  • Catered lunch Monday - Thursday
  • Powerful Apple products + automatic adjustable desks
  • Convenient office within a 10 minute walk from BART/Muni Underground
  • Option to work remotely when necessary
  • Google apps, Dropbox, Drive, Slack, Mac everything
  • Mini-Mercedes ride
  • Halo, Super Mario Brothers Smash, and Mario Kart tournaments


Other jobs at Sparkcentral