NorthBay Solutions

NorthBay Solutions

·last month

Principal software engineer (data platform)

Apply now

Location

hybrid, Lahore, Pakistan

Commitment

Full Time

Level

Senior (5+ years)

Required skills

Azure Data FactoryAzure DatabricksAzure Synapse AnalyticsAzure Event HubAzure Data Lake Storage Gen2Azure Logic AppsAzure Function AppsAzure SQL DatabaseAzure Key VaultMicrosoft SharePointPySparkSpark SQLDelta LakeDelta TablesData Lakehouse ArchitectureETL/ELT Pipelines

Job Description

Job Summary

We are looking for a Senior Azure Data Engineer with 5+ years of hands-on experience in designing and developing scalable data solutions on Microsoft Azure.

Key Skills

  • Azure Data Factory
  • Azure Databricks
  • Azure Synapse Analytics
  • Azure Event Hub
  • Azure Data Lake Storage Gen2
  • Azure Logic Apps & Function Apps
  • Azure SQL Database
  • Azure Key Vault
  • Microsoft SharePoint Integration
  • PySpark & Spark SQL
  • Delta Lake & Delta Tables
  • Data Lakehouse Architecture

Responsibilities

  • Design and develop scalable ETL/ELT pipelines using ADF and Azure Databricks.
  • Develop data transformation solutions using PySpark, Spark SQL, and Delta Lake.
  • Build and maintain Data Lakehouse solutions using ADLS Gen2.
  • Work with Synapse, Event Hub, Logic Apps, Function Apps, and Azure SQL for data integration and processing.
  • Implement secure integrations using Azure Key Vault and SharePoint.
  • Troubleshoot and optimize data pipelines and Spark workloads.

Note: Candidate must be comfortable working in UAE business hours and following the UAE public holiday calendar.

Ready to join the team?

Apply now