Azure Data Engineer/Architect
Location: Frisco, Texas/Atlanta, GA (Remote)
Duration: Long term
Must Have Skills
- Skill 1 – 8 Yrs. of Exp – Data Engineering
- Skill 2 – 8 Yrs. of Exp – SQL, Databricks, Snowflake, ADF
- Skill 3 – 4 Yrs. of Exp – Azure Services
UST is looking for a Sr. Data Engineer/Data Architect who is self-driven, can lead a team of Data engineers working on an Onshore-Offshore model collaborating with customer IT SMEs, Business partners.
Job Responsibilities
- Gather requirements working closely with IT SMEs, Business stakeholders
- Prepare technical design document, coordinate with offshore team on development activities
- Design, build and deploy efficient & reliable data pipelines to move and transform data
- Optimize existing pipelines and maintenance of all source-related data pipelines
- Support on-call shift as needed to support the team
- Build and Deploy extensive data quality checks to ensure high quality of data
- Build high-performance scalable data warehouses and data products
- Partner with leadership, engineers, product managers and data scientists to understand data needs
- Improve existing data movement frameworks and add more features
- Extreme focus on automation
- Expert level SQL skills
- Data Modeling
- CI/CD Pipeline and DevOps practices
- Agile fundamentals
- Prior use of Jira and GitLab
Skills Needed
- Azure Services
- Azure DataBricks
- Python
- Azure Data Factory
- GitLab
- Data Modeling
- Data Analysis
- Test Automation
- SQL
- Snowflake