Data engineer

Data Engineer Must Have Technical/Functional Skills

5+ years of data engineering experience. Demonstrated experience processing unstructured and multimodal data, including video, images, LiDAR, GNSS, IMU, and telemetry. Experience building pipelines that create curated AI training datasets through ingestion, synchronization, transformation, validation, and publishing. Strong Python and SQL skills with experience in distributed data processing frameworks. Experience with cloud data platforms, object storage, data lake or lakehouse patterns, workflow orchestration, and version control. Knowledge of data quality, metadata, lineage, schema management, and reproducible dataset pipelines.

Roles & Responsibilities

• Design, develop, and maintain scalable pipelines for camera, LiDAR, GNSS, IMU, and telemetry data.
• Normalize, synchronize, enrich, and package multimodal data for annotation and AI training.
• Implement automated checks for completeness, integrity, calibration, timestamps, formats, and dataset consistency.
• Create reusable data models, metadata standards, lineage, and dataset-versioning practices.
• Optimize pipeline performance, reliability, observability, and cost.
• Troubleshoot data defects and collaborate with AI, annotation, quality, and platform teams.
• Document technical designs, operating procedures, and handoffs.

Generic Managerial Skills, If Any Strong ownership, analytical problem solving, communication, and ability to work independently within an agile delivery team.