Job Description – ETL Modernization Developer

Location: Across USA any Location – Remote

Only Independent Visa Holders

Role Overview

We are seeking an experienced ETL Modernization Developer to join our Data Management team supporting customer’s Enterprise AI & Data initiatives. The role involves modernizing legacy ETL/ELT pipelines, migrating large-scale data workloads, and ensuring operational readiness in a cloud-native environment. The developer will work closely with business, application, and technical teams to deliver high-quality, governed, and production-ready data solutions.

Key Responsibilities

Assessment & Planning

• Analyze existing ETL/ELT jobs, databases, and data warehouses for migration readiness.
• Document requirements and migration artifacts for approval.

Design & Development

• Redesign and re-engineer legacy IBM DataStage jobs into modern frameworks (Databricks Spark on AWS preferred).
• Develop, test, and deploy ETL pipelines using Python, Unix scripting, and cloud-native tools.
• Implement CI/CD pipelines for automated build, test, and deployment.

Testing & Validation

• Conduct parity checks, unit testing, functional testing, UAT, and performance testing.
• Ensure schema validation, data quality, regression, and performance test coverage.

Execution & Cutover

• Support migration cutover, go-live, and post-migration stabilization (hypercare).
• Coordinate with application teams for redeployment and complete testing.

Decommissioning

• Plan and execute decommissioning of legacy DataStage jobs and artifacts.

Knowledge Transfer & Training

• Deliver operational readiness documentation and conduct KT sessions with Customer engineers.
• Provide training support for application and business teams.

Required Skills & Experience

Technical Skills

• Strong experience in IBM DataStage development.
• Experience in Databricks, Delta Lake, Unity Catalog, Photon.
• Proficiency in PySpark, SQL, Shell Scripting and Python.
• Hands-on experience with Databricks Spark (DBX) on AWS for job verification and pipeline development.
• Familiarity with AWS services such as Glue, Lambda, Redshift.
• Knowledge of CI/CD tools (GitLab, ADO, JIRA) and automated testing frameworks.
• Automated ETL Testing tools, PyTest and XML/JSON parsing.

Domain Knowledge

• Expertise in ETL/ELT migration and modernization.
• Understanding of large-scale DB/DWH workloads and complex pipelines.
• Experience in hypercare support and KT with application teams.

Soft Skills

• Strong communication and collaboration skills to work with cross-functional teams.
• Ability to document requirements, test plans, and operational readiness artifacts.
• Problem-solving mindset with focus on quality and continuous improvement.

This is a remote position.