Mid/senior network test automation engineer (sd-wan)

Get to know us better

CodiLime is a software and network engineering industry expert and the first-choice service partner for top global networking hardware providers, software providers and telecoms. We create proofs-of-concept, help our clients build new products, nurture existing ones and provide services in production environments. Our clients include both tech startups and big players in various industries and geographic locations (US, Japan, Israel, Europe).

While no longer a startup - we have 250+ people on board and have been operating since 2011 we’ve kept our people-oriented culture. Our values are simple:

• Act to deliver.
• Disrupt to grow.
• Team up to win.

The project and the team

You will join a newly formed team working for a globally recognized networking leader on their flagship SD-WAN product. The team’s mission is to keep the Routing SD-WAN area healthy through pre-commit testing: every pull request automatically triggers test suites on a large-scale CI/CD test orchestration platform, so bugs are caught before they ever reach the codebase.

Your work will revolve around developing and maintaining automated test suites for the Routing area, owning weekly regression runs, and triaging failures - from reading device and test logs, through distinguishing genuine product bugs from test-suite or environment issues, to raising well-documented defects. You will work hand in hand with the development teams to understand upcoming features and translate their use cases into test coverage.

The scale is significant: the platform executes hundreds of test suites and roughly a thousand test runs a day across pre-commit, nightly, and weekly pipelines. To keep triage fast at this scale, the workflow is supported by modern AI tooling - an AI-powered root cause analysis agent that turns hours of log digging into minutes, and collaboration bots that automatically pull the right people into dedicated spaces when a suite fails.

Technology stack:

• Python as the main automation language (pyATS and the client’s internal test framework)
• pytest
• Networking: routing protocols (BGP, OSPF), routing tables, VRFs, SD-WAN overlay (policies, IPsec tunnels)
• CI/CD: Jenkins, GitHub pull request workflows
• AI tooling: AI-assisted root cause analysis, LLM coding assistants (Codex/Copilot-class tools)
• FastAPI (REST), async, subprocessing, JSON streams, caching
• Docker, Kubernetes
• Linux

What else you should know:

• The team is being formed right now - you will help shape how it works from day one
• Support is also available from the DevOps team, as CodiLime engineers are responsible for developing and maintaining the CI/CD test orchestration platform
• You will cooperate directly with the development and test engineers in a distributed, international environment (Europe, India, US)
• AI tools are part of the daily workflow, not an afterthought
• We work on multiple interesting projects at a time, so it may happen that we’ll invite you to an interview for another project if we see that your competencies and profile are well suited for it.

Your role

As a part of the project team, you will be responsible for:

• Developing and maintaining automated test suites for the Routing SD-WAN area, executed on the CI/CD test orchestration platform (pre-commit PR testing and weekly runs)
• Owning weekly regression runs: monitoring results, triaging failures, and driving them to resolution
• Debugging failed runs - analyzing device, system, and test logs, distinguishing product bugs from test-suite or environment issues, and raising well-documented defects
• Collaborating closely with development teams to understand the features they deliver and designing test coverage for those use cases
• Extending test automation as new features are delivered in the Routing area
• Leveraging AI tools (AI-assisted RCA, LLM coding assistants) to speed up scripting, log analysis, and root cause identification
• Coordinating issue resolution with suite owners and dev/test engineers through dedicated collaboration channels

Do we have a match?

For success in this role, expertise in test automation, networking, and debugging is essential:

• Strong hands-on experience with Python-based test automation using pytest or similar frameworks (experience with pyATS/Genie is highly desirable)
• Experience in network test automation
• Solid networking knowledge with a focus on routing: BGP, OSPF, routing tables, VRFs, and general Layer 3 networking concepts
• Understanding of SD-WAN concepts - overlay architecture, policies, IPsec tunnels (hands-on SD-WAN experience is strongly preferred)
• Proven debugging and troubleshooting skills: reading logs, CLI-level investigation, isolating root causes across product, test, and environment layers
• Experience working closely with software development teams and translating delivered features into test scenarios
• Hands-on use of AI tools (LLM coding assistants such as Copilot or Codex) in everyday engineering work
• Experience with REST APIs or/and WebSockets
• Experience with Docker
• Good Linux command-line skills (shell scripting, command-line tools)
• Good knowledge of English (B2+ level)

Beyond the criteria above, we would appreciate the following nice-to-haves:

• Hands-on experience with SD-WAN solutions
• Familiarity with Jenkins and GitHub-based CI/CD pipelines
• Experience with physical or virtual network testbeds and virtual routers (e.g., CSR1000v / Catalyst 8000v)
• Experience working with formal defect tracking systems
• Experience with traffic generators

More reasons to join us

• Flexible working hours and approach to work: fully remotely, in the office, or hybrid
• Professional growth supported by internal training sessions and a training budget
• Solid onboarding with a hands-on approach to give you an easy start
• A great atmosphere among professionals who are passionate about their work
• The ability to change the project you work on