Senior data engineer

Job Details:

Job Location: Allied Benefit Systems - CHICAGO, IL

Position Type: Full Time

Salary Range: $155000.00 - $170000.00

Job Category: Operations

POSITION SUMMARY

The Senior Data Engineer will design, build, and own the data infrastructure that powers analytics, machine learning, and AI applications across the enterprise. The role will serve as the technical owner of data ingestion, storage, transformation, and reporting infrastructure for the AI team.

ESSENTIAL FUNCTIONS

• Design and implement scalable data pipelines and ETL/ELT processes.
• Develop integrations with internal and external data sources, APIs, databases, and enterprise systems.
• Build and maintain data ingestion frameworks for structured and unstructured data.
• Own data movement and orchestration across platforms such as Azure Storage, Microsoft Fabric, Snowflake, or future enterprise data solutions.
• Develop and maintain data models supporting analytics, reporting, and machine learning workloads.
• Manage AI-team data storage patterns, including data lake, warehouse, and reporting architectures.
• Establish and maintain dataset versioning, lineage, and reproducibility practices.
• Create and enforce data quality standards and monitoring procedures.
• Design scalable approaches for handling growing data volumes and data sources.
• Own the technical infrastructure supporting Power BI and future reporting platforms that the AI team uses for internal reporting or to produce derivative data products for the enterprise.
• Create semantic models, curated datasets, and reporting-ready data products.
• Partner with analytics stakeholders to ensure high-quality, trusted reporting assets.
• Partner with Machine Learning Engineers and Data Scientists to provide high-quality datasets for model development.
• Collaborate with business and IT teams to understand evolving data requirements.
• Assist in establishing data governance, security, and compliance practices appropriate for healthcare data environments.
• Advise business teams during 3rd party data source negotiations.
• Other duties as assigned.

EDUCATION

Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent combination of education and work experience required.

EXPERIENCE AND SKILLS

• 5+ years of experience in data engineering, software engineering, or related disciplines.
• Strong Python development skills.
• Advanced SQL expertise.
• Experience developing API integrations and data ingestion solutions.
• Experience designing and operating production ETL/ELT pipelines.
• Experience with cloud-based data platforms (Azure preferred).
• Strong understanding of data modeling and warehousing concepts.
• Experience with Microsoft Fabric, Azure Data Lake, Power BI, Snowflake, Databricks, or similar technologies.
• Experience working with healthcare, claims, provider, or member data.
• Familiarity with machine learning workflows and MLOps concepts.
• Experience implementing monitoring, observability, and data quality frameworks.
• Experience with Git, CI/CD, Infrastructure-as-Code, and modern software delivery practices.
• Experience with coding assistants, e.g., Claude Code, for feature-oriented development.

POSITION COMPETENCIES:

• Accountability
• Analytical Problem Solving
• Collaboration
• Quality and Risk Management
• Systems Thinking
• Technical/Functional Expertise

PHYSICAL DEMANDS:

This is a standard desk role requiring extended sitting and computer work.

WORK ENVIRONMENT:

Remote Here at Allied, we believe that great talent can thrive from anywhere. Our remote friendly culture offers flexibility and the comfort of working from home, while also ensuring you are set up for success. To support a smooth and efficient remote work experience, the internet connection must be obtained through a cable broadband or fiber optic internet service provider with speeds of at least 100Mbps download/25Mbps upload. Reliable internet service is essential for staying connected and productive.

The company has reviewed this job description to ensure that essential functions and basic duties have been included. It is not intended to be construed as an exhaustive list of all functions, responsibilities, skills, and abilities. Additional functions and requirements may be assigned by supervisors as deemed appropriate.

Compensation is not limited to base salary. Allied values our Total Rewards, and offers a competitive Benefit Package including, but not limited to, Medical, Dental, Vision, Life and Disability Insurance, Generous Paid Time Off, Tuition Reimbursement, EAP, and a Technology Stipend. Allied reserves the right to amend, change, alter, and revise, pay ranges and benefits offerings at any time. All applicants acknowledge that by applying to the position you understand that the specific pay range is contingent upon meeting the qualification and requirements of the role, and for the successful completion of the interview selection and process. It is at the Company's discretion to determine what pay is provided to a candidate within the range associated with the role.