Senior Data Engineer
TLDR
Design, develop, and optimize Snowflake data structures on Azure and orchestrate robust ETL/ELT pipelines with ADF.
While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.
If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!
Role: Senior Data Engineer - Snowflake
Experience Level: 4+ Years
Work location: Mumbai, Bangalore & Trivandrum
Notice Period: Looking for 0-15 days joiners
Role & Responsibilities:
Snowflake Development: Design, develop, and optimize data structures within Snowflake on Azure, utilizing Snowpipe, Snowpark, Stored Procedures, UDFs, and Streams & Tasks.
Pipeline Orchestration: Build and manage complex ETL/ELT data pipelines using Azure Data Factory (ADF), incorporating robust error handling, alerting, and CDC methods.
Data Platform Management: Work proficiently within the Azure data ecosystem, utilizing Azure Data Lake Storage (ADLS) and integrating Azure Key Vault for secure credential management.
Advanced Querying: Develop complex SQL logic and perform query optimization and data manipulation across data warehouse and staging environments.
Data Security & Governance: Implement Snowflake security configurations, including Role-Based Access Control (RBAC) and Data-Masking features.
DevOps & Integration: Manage CI/CD pipelines using Azure DevOps (Git and branching strategies) and integrate data streams via SFTP and REST APIs.
Quality Assurance: Assist in developing automated testing frameworks for data pipeline validation and data quality monitoring.
Data Modeling: Apply dimensional modeling concepts (Star and Snowflake schemas) to build efficient data structures for financial reporting.
Financial Alignment & Collaboration: Support the integration of financial data from platforms like Sage Intacct GL, SkyGen, and ClearWater; collaborate with stakeholders to gather technical requirements.
Team Mentorship: Lead, mentor, and conduct code reviews for Junior Data Engineers to ensure alignment with engineering standards.
Skills expectation:
Snowflake Expertise (Advanced): Strong hands-on experience with Snowflake on Azure, including performance tuning, virtual warehouses, data loading, RBAC, Data-Masking, and Snowpark.
Azure Data Services: Extensive experience with Azure Data Factory (ADF) for complex pipeline orchestration, alongside proficiency in ADLS and Azure Key Vault.
SQL & Programming: Expert-level SQL skills for data manipulation and query optimization, combined with intermediate Python skills for scripting and data processing.
Data Warehousing & Modeling: Solid understanding of core data warehousing concepts, ETL/ELT patterns, and dimensional modeling.
DevOps & Testing: Experience implementing CI/CD pipelines using Azure DevOps, version control (Git), and automated pipeline testing.
Domain Awareness: Good to have knowledge of financial processes and familiarity with data structures from Sage Intacct GL, SkyGen, or ClearWater.
Collaborative Execution: Strong problem-solving skills with the ability to translate business needs into technical pipelines and guide junior team members.
If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!
Quantiphi, Inc. is an AI-first digital engineering company that specializes in transforming bold ideas into tangible business results for Fortune 1000 organizations. By combining award-winning design and engineering expertise with advanced AI capabilities, we deliver innovative digital products, including websites and mobile applications, that drive growth and digital transformation for some of the world's leading brands.
- Founded
- Founded 2013
- Employees
- 500+ employees
- Industry
- Construction & Engineering
- Total raised
- $23M raised