Big Data Engineer
TLDR
Integral member of a threat intelligence service tasked with architecture, design and development of scalable data processing and ingestion pipelines.
* As a Big Data Engineer, you will be an integral member of our threat intelligence service, i.e. auto focus, team responsible for architecture, design and development.
* Having the dynamic ability to adapt to conventional big-data frameworks and tools with the use-cases required by the project
* Ability to communicate with research teams and data scientists, finding bottlenecks and resolving them
* Design and implement different architectural models for our scalable data processing, as well as scalable data storage
* Build tools for proper data ingestion from multiple heterogeneous sources
Requirements:
* 2+ years of experience in design and implementation in an environment with hundreds of terabytes of data
* 2+ years of experience with large data processing tools such as: Hadoop, HBase, Elastic Search, etc.
* 2+ years experience with Java
* Passion for doing research on large data sets containing ill-formatted data
* Can-do attitude on problem solving, quality and ability to execute
* Excellent inter-personal and teamwork skills
* BS in Computer Science/Engineering, or equivalent experience
Hadoop, HBase, Elastic Search
Multiple Openings