Tech lead data engineer

Apply now

Location

hybrid, Kraków, Poland

Salary

$50k – $76k/yr

Commitment

Full Time

Level

Senior (5+ years)

Required skills

PythonPySparkAzureData EngineeringETLUnixShell ScriptingDatabricksGitLabCI/CDOracleAutosysData IntegrationRisk ManagementAgileCloud Platforms

Job Description

Type of contract: Employment contract

Salary range: 17400 - 26700 PLN gross

What will you do?

You will join a team responsible for building a cloud-based strategic data platform supporting risk management processes within investment banking. The project focuses on data integration, process automation, digital transformation, and modernization of large-scale financial services platforms, enabling more effective risk management and data processing capabilities.

Your tasks

  • Design and develop ETL and data processing solutions using Python and PySpark
  • Build and maintain cloud-based data platforms and pipelines
  • Analyze business requirements and translate them into technical solutions and implementation plans
  • Develop data ingestion, cleansing, transformation, loading, and reporting processes
  • Work with Azure services including ADLS, Azure Key Vault, and Databricks
  • Create and maintain CI/CD pipelines using GitLab
  • Develop and maintain Shell scripts and scheduling solutions
  • Collaborate with stakeholders in an Agile delivery environment
  • Support data analysis and troubleshooting on Unix platforms
  • Ensure high quality, scalability, and reliability of data solutions

Your skills

  • 10+ years of professional software engineering experience
  • Recent hands-on experience with Python and PySpark used continuously over the last 2-3 years
  • Experience with Java or C#
  • Strong experience working on Unix platforms including file operations, permissions, environments, and data analysis
  • Hands-on experience designing and developing ETL and data solutions using Python
  • Experience with data ingestion, transformation, cleansing, loading, and reporting processes
  • Experience with Shell scripting
  • Experience with Autosys
  • Experience working with Oracle databases
  • Ability to gather business requirements and break them down into implementable technical tasks
  • Experience with CI/CD pipelines and GitLab
  • Good understanding of software development lifecycle within Agile environments
  • Strong knowledge of Azure platform
  • Experience with ADLS
  • Experience with Azure Key Vault
  • Experience with Databricks

Nice to have

  • Experience with AI-powered development tools such as GitHub Copilot
  • Experience creating automation agents and AI-based productivity solutions

We offer

  • Hybrid work in our client's office (Kraków) 3 days a week
  • Working in a highly experienced and dedicated team
  • Benefit package tailored to your needs (medical, sport, lunch subsidy, life insurance, etc.)
  • Online training and certifications
  • Access to e-learning platform
  • Social events

Ready to join the team?

Apply now