Cloudera
Cloudera

Senior Software Engineer - Storage

TLDR

Design and implement core features of Apache Ozone and RAFT-based storage, contributing to a brand new distributed storage system with wide impact on big data.

Business Area:

Engineering

Seniority Level:

Mid-Senior level

Job Description: 

At Cloudera, we empower people to transform complex data into clear and actionable insights. With as much data under management as the hyperscalers, we're the preferred data partner for the top companies in almost every industry.  Powered by the relentless innovation of the open source community, Cloudera advances digital transformation for the world’s largest enterprises.

Cloudera is looking for an exceptional and passionate software engineer with a distributed systems background to join the Storage Engineering team focused on building Apache Ozone. The Storage team is responsible for the primary storage and storage access layers which are core to the Cloudera Data Platform. Apache Ozone (https://ozone.apache.org) is an open source project purposed to build a massively scalable distributed object store. Ozone is designed to scale to thousands of nodes, tens of billions of objects and overcome the limitations of the Hadoop Distributed File System (HDFS).

As the Senior Software Engineer you will:

  • You will be directly involved in the design and implementation of the core feature set of Apache Ozone and Apache Ratis (open-source RAFT implementation).

  • You will also contribute to HDFS; the development of HDFS which is one of the most widely deployed distributed storage systems in the world with over a thousand Cloudera customers.

  • This is a unique opportunity to be a part of building a brand new distributed storage system and have a huge impact on the big data and cloud computing industry.


 

We’re excited about you if you have:

  • BS, MS, or Ph.D. in Computer Science

  • Masters or Bachelors +4 years of relevant industry experience

  • Strong backend engineering skill set with expertise in Java.

  • Hands-on programmer with a good knowledge of data-structures and CS algorithms.

  • Experience with large-scale, distributed systems design and development with a strong understanding of scaling, replication, consistency, and high availability

  • Experience with system software design and development with an understanding of computer architecture, storage, network, and IO subsystems

  • Clean coding habits, attention to detail, and focus on quality

  • Good oral, written and communication skills.

 

You may also have:

  • Background in a distributed storage system including file systems, database storage internals, no-sql storage or distributed hash tables

  • Background in performance tuning, identifying performance bottlenecks, and implementing performance optimizations

  • Good understanding of Apache Hadoop

  • Recognized contributions to open source projects

  • Experience using projects in the Apache Hadoop ecosystem such as MapReduce, HBase, Hive, Spark etc. is a big plus

  • Understanding of Paxos, RAFT, or equivalent distributed consensus protocols.

What you can expect from us:

  • Generous PTO Policy 

  • Support work life balance with Unplugged Days

  • Flexible WFH Policy 

  • Mental & Physical Wellness programs 

  • Phone and Internet Reimbursement program 

  • Access to Continued Career Development 

  • Comprehensive Benefits and Competitive Packages 

  • Paid Volunteer Time

  • Employee Resource Groups

EEO/VEVRAA

#LI-NK1

Benefits

Health Insurance

Comprehensive Benefits and Competitive Packages

Home Office Stipend

Phone and Internet Reimbursement program

Learning Budget

Access to Continued Career Development

employee resource groups

Paid Time Off

Paid Volunteer Time

Remote-Friendly

Flexible WFH Policy

Wellness Stipend

Mental & Physical Wellness programs

Cloudera builds powerful data management and analytics solutions that help organizations make sense of complex data. Targeting enterprises across various industries, Cloudera leverages open source innovation to drive digital transformation and allows companies to turn their data into actionable insights.

View company profile

This job is no longer available

Pro members saw this job first

New jobs unlock for everyone after 24 hours. Startup Jobs Pro shows them right away, with instant alerts and salary filters. From $7/month.

Get Pro