Senior Data Engineer

Overview

The Senior Data Engineer plays a pivotal role within our expanding Data and AI team. This person helps build and scale our next-generation data platform, starting with our modernization initiative; transitioning from legacy ingestion processes embedded in C# .NET code to a scalable, cloud-native architecture on AWS and expanding into our Databricks analytical data platform for advanced processing and analytics. This is a highly impactful, hands-on role responsible for designing and implementing AI-assisted data pipelines and distributed systems that power data product, analytics, data science, and operational use cases.

Starting base pay for this role is between $117,000 and $146,000. The actual base pay is dependent upon many factors, such as transferable skills, work experience, business needs, training, location, and market demands. The base pay range is subject to change and may be modified in the future. This role will be eligible for a bonus as well as competitive medical, dental, and vision benefits, wellness reimbursement, life insurance, and a 401(k) with company match. We offer vacation and sick leave benefits (under a flexible time off policy in most states). Responsibilities: * Designs and implements scalable data-ingestion pipelines using AWS services (e.g., S3, Lambda, API Gateway, Glue, Step Functions, Amazon Bedrock, Amazon Agent Core) and Azure DevOps * Builds APIs and file upload mechanisms for client data ingestion * Develops data mapping and transformation workflows for loading into SQL Server client databases * Contributes to the design and implementation of a data Lakehouse architecture leveraging Databricks * Enables seamless data flow from the SaaS platform to the analytical platform * Optimizes ETL/ELT processes for performance and reliability * Collaborates with analytics teams to ensure data availability and quality for reporting and machine learning use cases * Provides operational support for existing ingestion pro...