Virtusa
Virtusa·3 months ago

Data engineer

Apply now

Location

onsite, Pune, India

Commitment

Full Time

Level

Senior (5+ years)

Required skills

ServerlessCloud ComputingWorkflow ManagementSaaSContinuous Integration & DeliveryAnalyticsData WarehousesData Science ToolsETL / Data TransformationSoftwareInfrastructureSQLOSSStreaming & MessagingHosted PlatformComputeOrchestration & PipelinesEnterprise SoftwareDatabaseCDNStat Tools & LanguagesQueuesITIaaSApp Definition and DevelopmentBig Data ToolsDatastoresPaaSFrameworksApplication HostingMPP DatabasesProgramming LanguagesETLStorage

Job Description

Experience: 6-10 yrs

Experience in AWS services must like S3, Lambda, Pyspark, Airflow, Glue, Athena, Lake formation, Step functions, Kinesis, Streaming Pipeline etc.

Experience in programming in Python, Functional Testing (FT) & Unit Testing (UT).

Experience in programming in CI/CD concepts - Jenkins, SQL DB Script.

Experience performing 2-3 data Migration projects (NOT DATA SCIENCE) on AWS platforms.

Nice to have: Experience in a Big Data technologies (Terradata, Snowflake, Spark, Redshift, Kafka, etc.)

Experience with data management process on AWS is a huge Plus.

Experience in implementing complex ETL transformations on AWS using Glue.

Familiarity with relational database environment (Oracle, Teradata, etc.) leveraging databases, tables/views, stored procedures, agent jobs, etc.

Ready to join the team?

Apply now