Senior DevOps Engineer
We're looking for a Senior DevOps Engineer. This role is Office Based, Hyderabad Office.
Job Summary
We are looking for a Senior DevOps / Cloud Platform Engineer with strong experience in AWS, Kubernetes, CI/CD, infrastructure automation, and ML/AI infrastructure to design, deploy, manage, and optimize cloud infrastructure supporting our machine learning and AI services.
The ideal candidate will have hands-on experience with AWS EKS, SageMaker, Bedrock, Docker, Kubernetes, Terraform, Helm, GitHub Actions, Databricks, Elasticsearch, and self-hosted LLM deployments. This role will work closely with Data Engineering, Machine Learning, and Software Engineering teams to build reliable, scalable, secure, and cost-efficient platforms for ML services across development and production environments.
Key Responsibilities
- AWS & Kubernetes Infrastructure: Design, deploy, and administer AWS infrastructure supporting ML and AI workloads. Manage Amazon EKS clusters, including cluster provisioning, upgrades, scaling, networking, and troubleshooting.
- CI/CD & Azure-to-AWS Migration: Build and maintain CI/CD pipelines for ML and AI services. Develop and manage GitHub Actions and Azure DevOps pipelines using YAML.
- ML Service Deployment: Deploy and manage ML services across AWS EKS/ECS and SageMaker. Build and maintain Docker containers and Kubernetes deployments.
- App Runner to EKS Migration: Lead migration of existing services from AWS App Runner to Amazon EKS.
- Self-Hosted LLM & AI Infrastructure: Deploy and manage self-hosted Large Language Models and inference services.
- Databricks Administration: Administer Databricks workspaces, clusters, permissions, and access controls.
- Elasticsearch Infrastructure: Design, deploy, and manage Elasticsearch clusters.
- Monitoring, Reliability & Auto-Scaling: Implement monitoring and observability for Kubernetes, AWS, and ML services.
- Infrastructure as Code & Automation: Build and maintain infrastructure using Terraform.
- Cross-Team Collaboration: Partner closely with Data Engineering, ML Engineering, Data Science, and Software Engineering teams.
You've got what it takes if you have...
Required Skills & Experience
- 5+ years of experience in DevOps, Cloud Infrastructure, SRE, or Platform Engineering.
- Strong hands-on experience with AWS.
- Strong experience administering Amazon EKS and Kubernetes in production.
Preferred / Nice-to-Have Skills
- Experience supporting Generative AI / LLM platforms.
- Experience with GPU infrastructure and NVIDIA/CUDA environments.
What You'll Own
- AWS ML/AI infrastructure
- EKS cluster administration and upgrades
- ML service deployment and production operations
Ideal Candidate
The ideal candidate is a hands-on infrastructure engineer who can independently take an ML/AI service from containerization → CI/CD → AWS infrastructure → EKS deployment → monitoring → scaling → production support.
Our Culture:
Spark Greatness. Shatter Boundaries. Share Success. Are you ready? Because here, right now – is where the future of work is happening.
Who We Are:
At Cornerstone, we believe in AI that works in the service of people, amplifying their judgment to drive high-performing, future-ready organizations forward.