Rootshell Enterprise Technologies

Rootshell Enterprise Technologies

·3 days ago

Lead data engineer - remote must be in usa

Apply now

Location

remote, United States

Commitment

Full Time

Level

Lead / Manager

Required skills

LibrariesProgramming LanguagesVersion ControlIaaSApplications - IndustryBig Data ToolsDevOpsApp Definition and DevelopmentOSSData Science ToolsGovernment & IntelligenceOSSQLComputeStat Tools & LanguagesCode CollaborationContinuous Integration & DeliveryPaaS

Job Description

Lead Data Engineer - Remote

Must be in USA

Skill Set:

  • Pyspark
  • Python
  • AWS
  • GIS
  • Palantir Foundry

Need a SME in Python coding (Data structures and algorithms)

Responsibilities

  • Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
  • Collaborate with product and technology teams to design and validate the capabilities of the data platform.
  • Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability.
  • Provide technical support and usage guidance to the users of our platform's services.
  • Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.

Qualifications

  • Experience building and optimizing data pipelines in a distributed environment.
  • Experience supporting and working with cross-functional teams.
  • Proficiency working in Linux environment.
  • 5+ years of advanced working knowledge of SQL, Python, and PySpark.
  • Knowledge on Palantir.
  • Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline.
  • Experience with platform monitoring and alerts tools.

Ready to join the team?

Apply now

Similar Jobs: