Data Engineer
TLDR
Design and implement scalable data infrastructure and real-time analytics transformations for large-scale data platforms, driving robust data processing and tooling.
RadiumOne is seeking a Data Engineer to join our Data Technology team with the responsibility of designing and implementing scalable data infrastructure, as well as implementing data transformations developed by data scientists as scalable and robust processes. In this role, the successful candidate will be responsible for the following:
Responsibilities Include:
You will take ownership of the data processing portal for the companies two real-time analytics platforms.
You will be responsible with the migration from the current AWS to our in-house servers (Kafka – Spark) allowing for the portal to become real-time.
You will load, script, and analyze the data, as well as query databases to develop and provide use cases.
Responsible with optimizing, maintenance, and production support of the portal.
5+ years working in a data intensive environment like a data warehouse or an analytics system.
2+ Years Experience working in distributed data platforms like Hadoop, Hive, Kafka etc. and with distributed data sets. Apache Spark is a nice to have.
Expert in SQL - MySQL preferred and experience in NoSQL is a bonus.
4+ years Experience in Java or Python - Scala is a plus.
Experience building RESTful APIs
Scripting languages like Perl, Shell etc
Experience in agile software development practices (code versioning, Test Driven Development, Unit testing, continuous integration.)
Any domain is fine, but Digital Marketing preferred.
Local candidates preferred as onsite interviews are a must.
All your information will be kept confidential according to EEO guidelines.
Stepping Up Solutions focuses on pioneering carbon-negative innovations by converting agricultural waste into activated carbon, which is crucial for air and water purification and industrial applications. Our target market includes businesses and industries seeking sustainable solutions that tackle climate change and pollution. What sets us apart is our commitment to leveraging advanced clean technology to create a greener future and minimize resource waste.