Sr. Data Engineer
TLDR
Lead AI-first data pipelines and Lakehouse on Azure with Databricks, powering analytics, AI initiatives, and cross-team collaboration.
As our Senior Data Engineer, you'll lead the design and development of scalable data pipelines and data products on our Azure-based platform, with Databricks at the core.
You'll build trusted, production-grade data that powers analytics, operational intelligence, and AI initiatives across the business.
What You'll Do
· Lead the design and development of scalable data pipelines in Databricks
· Build and optimize Lakehouse architecture using Medallion (Bronze/Silver/Gold) design
· Develop data solutions using Python, Pyspark, Spark SQL, and Delta Lake
· Integrate APIs, enterprise systems, SaaS platforms, and external data sources
· Establish data quality, testing, monitoring, and performance standards
· Mentor engineers and promote engineering best practices
· Drive CI/CD, automation, and AI-first development practices
· Partner with analytics engineers, data scientists, and application teams
· Evaluate new technologies through proof-of-concept projects
What You Bring
Required
· AI-first development mindset
· 5+ years of data engineering experience, including senior or lead responsibilities
· Expert Python and SQL skills
· Deep experience with Databricks, Apache Spark, and Pyspark
· Experience building production data pipelines
· Lakehouse architecture and Medallion modeling experience
· Data quality, testing, and monitoring expertise
· CI/CD and Git experience
· Experience with Azure Data Factory, Airflow, or similar orchestration tools
· REST API and enterprise system integrations
· Bachelor’s degree in computer science, Engineering, Information Systems, or equivalent experience
· Strong communication and collaboration skills
Preferred
· Azure Databricks
· Azure Data Factory
· Azure Data Lake Storage
· Delta Lake
· Apache Airflow
· Databricks Asset Bundles
· Databricks Apps
· MLflow, Mosaic AI, Unity Catalog
· Experience supporting AI/ML workloads
· Databricks Data Engineer Certification
Why You'll Love Working Here
You'll join a high-performing team that's investing heavily in cloud, data, and AI. We empower our engineers with modern tools, continuous learning, and opportunities to influence technology strategy while solving meaningful business challenges.
Work environment/physical demands summary:
This job operates in an office environment and uses a computer, telephone and other office equipment as needed to perform duties. The noise level in the work environment is typical of that of an office with an open seating floor plan. The employee may encounter frequent interruptions throughout the work day. The employee is regularly required to sit, talk, or hear.
All qualified applicants will receive consideration for employment without regard to age, race, color, religion, sex, sexual orientation, gender identity, national origin, status as a qualified individual with a disability, or Vietnam era or other protected veteran.
#LI-SG1
#Remote
Benefits
For more information about our benefit offerings, please visit our careers page at https://www.echo.com/company/careers.
This role is eligible for a bonus that is based on a combination of personal and business performance.Benefits
Remote-Friendly
Fully remote role
Echo Global Logistics is a technology-driven third-party logistics provider that simplifies transportation management for businesses. We connect clients with carriers across all major transportation modes, ensuring efficient and secure shipping of products nationwide. Our innovative solutions streamline logistics, allowing our customers to focus on their core operations.