TSP

TSP

·2 days ago

Data engineer 4

Apply now

Location

remote, United States

Salary

$120k – $150k/yr

Commitment

Full Time

Level

Lead / Manager

Required skills

DevOpsFrameworksData Science ToolsProgramming LanguagesIaaSOSSDatastoresStat Tools & LanguagesData WarehousesContinuous Delivery/Deployment (CD)Cloud ComputingSoftwareCode CollaborationSQLInfrastructureContinuous Integration (CI)Container ManagementEnterprise SoftwareApplication HostingSaaSContainer OrchestrationBig Data ToolsVersion Control

Job Description

TSPi is seeking a Data Engineer 4 to support the federal government. This position will provide technical leadership for the data pipelines, interfaces, and cloud services that collect, transform, validate, and deliver vessel and enforcement-related information to operational applications and reporting tools. The successful candidate will serve as a senior member of an established Agile delivery team and work with federal product owners, architects, application developers, data engineers, testers, and regional stakeholders. The role requires deep hands-on experience with Google Cloud Platform, BigQuery, SQL, APIs, pipeline architecture, and production operations.

Responsibilities

Data Architecture and Integration Leadership

  • Contribute to the design, modernization, and support of production data pipelines that ingest, transform, validate, and publish vessel, permit, trip, declaration, landing, and enforcement-related data.
  • Define scalable integration patterns for batch, scheduled, event-driven, streaming, and API-based workloads based on operational and mission requirements.
  • Translate business and technical needs into source-to-target mappings, canonical models, schema strategies, transformation logic, reference-data rules, and data-quality controls.
  • Design and optimize complex SQL and data-processing logic for ingestion, reconciliation, analytics, reporting, and application support.
  • Establish approaches for data lineage, versioning, backward compatibility, and controlled schema evolution across interconnected systems.
  • Lead technical reviews, set engineering standards, and guide source-code, configuration, testing, and release practices through Git or GitHub workflows.

Google Cloud Platform Engineering

  • Architect and implement secure, resilient data workloads using BigQuery and other Google Cloud Platform services.
  • Guide the design of cloud storage, orchestration, service identities, secrets, configuration, networking, and environment-specific deployment settings.
  • Improve continuous integration and delivery pipelines and establish consistent, automated deployments across development, test, staging, and production environments.
  • Evaluate architectural tradeoffs and improve performance, scalability, cost efficiency, recoverability, and operational visibility.
  • Apply federal security requirements, least-privilege access, encryption, auditability, and secure service-to-service communication practices.

Operations Technical Leadership and Collaboration

  • Define monitoring and service-level indicators for pipeline health, processing volume, latency, failures, data quality, and downstream impact.
  • Lead the diagnosis and resolution of complex issues involving source data, database connections, APIs, credentials, transformation logic, schedules, dependencies, and cloud services.
  • Establish standards for alerting, structured logging, retry handling, failure recovery, reprocessing, reconciliation, and operational readiness.
  • Coordinate releases, production validation, incident response, root-cause analysis, corrective actions, and communication with technical and program stakeholders.
  • Own and review architecture diagrams, interface documentation, data dictionaries, decision records, runbooks, deployment procedures, and known-issue records.
  • Mentor engineers, facilitate technical design discussions, estimate complex work, identify delivery risks, and contribute to backlog refinement, sprint planning, demonstrations, and retrospectives.

Required Skills and Experience

  • Minimum 9 years of professional experience in data engineering, systems integration, software engineering, or a related role, including responsibility for complex production systems.
  • Advanced experience designing, building, and supporting data pipelines in Google Cloud Platform or a comparable cloud environment.
  • Advanced SQL skills and demonstrated experience designing solutions with BigQuery, relational databases, or cloud data warehouses.
  • Strong proficiency with Python, Java, or another language used for production data-processing and integration services.
  • Demonstrated experience designing REST API integrations, data contracts, schema-evolution strategies, mappings, transformations, and reconciliation processes.
  • Experience leading production troubleshooting, incident response, root-cause analysis, and resolution of complex data-quality or integration issues.
  • Experience establishing Git or GitHub workflows, code-review standards, automated testing, continuous integration, and deployment pipelines.
  • Ability to assess an existing architecture and codebase, identify technical risk, and assume ownership of mission-critical services with limited oversight.
  • Strong technical leadership, documentation, communication, mentoring, and cross-functional collaboration skills in an Agile environment.
  • Bachelor's degree in computer science, information systems, data engineering, or a related field, or equivalent practical experience.

Preferred Skills and Experience

  • Deep experience with BigQuery, Cloud Run, Cloud Functions, Pub Sub, Cloud Storage, Dataflow, Composer, or related Google Cloud services.
  • Experience developing enterprise data architecture, reusable integration frameworks, data governance practices, or platform modernization roadmaps.
  • Experience with fisheries, vessel monitoring, maritime, geospatial, regulatory, or enforcement data, including permit, trip, logbook, declaration, landing, or reference-data sources.
  • Experience with Docker, infrastructure as code, automated data-quality testing, orchestration, and cloud observability tools.
  • Experience defining operational metrics, service-level objectives, health dashboards, and alerts for business-critical data pipelines.
  • Experience supporting federal information systems and leading technical work within federal security, accessibility, change-control, and release-management requirements.

Additional Information

Successful candidates must be able to pass a government background investigation and satisfy public trust requirements. US Citizenship or US Green Card is required.

Ready to join the team?

Apply now

Similar Jobs: