Senior Data Engineer

Senior Data Engineer, Archer Daniels Midland Company, Decatur, IL.

Lead a delivery team to develop data pipelines, transform raw data into useful data systems, and optimize data delivery architecture. Design, build, refactor, and maintain data pipelinesusing Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark to meet business requirements for reporting, analysis, and data science. Teach, adhereto, and contribute to DataOps and MLOps standards and best practices to continuously improve data system performance. Design and integrate fault tolerance and enhancements intodata pipelines to improve quality and performance. Lead and conduct root cause analysis to solve problems, optimize data delivery, and reduce costs. Develop and maintain pricing modelsand tools to support business decisions. Collaborate with sales, marketing, and finance teams to align pricing strategies with business goals. Create solutions for Prospect-to-Cash,including Order Management and Sales Management. Create solutions for GBS to provide end-to-end solutions.

40 hrs/week, Mon-Fri, 8:30 a.m. - 5:30 p.m. Salary: $111,592 – $121,592/yr. Standard company benefits.

MINIMUM REQUIREMENTS

:

Master’s degree or foreign equivalent degree in Computer Science, Data Science and Business Analytics, Software Engineering, Information Technology or a related field, and three (3) years of related work experience.

Must have three (3) years of experience with/in

• At least three (3) of the following cloud-based data systems, such as Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, PySpark, SAP Datasphere, and/or Power BI;
• Azure DevOps, GitHub, and CI/CD;
• Database storage systems such as cloud, relational, mainframe, data lake, and data warehouse;
• Building cloud ETL pipelines using code;
• Building ETL platforms utilizing database connections, APIs, or file-based;
• Data warehousing