View all jobs

SENIOR AWS DATA-INTEGRATION AND DATA-QUALITY ENGINEER

  • Midlothian, VA
<meta />

<meta />

Axyde Analytics seeks a senior AWS data engineer to design and implement managed-service data-ingestion, transformation, quality, cataloging, and monitoring capabilities for a federal enterprise analytics platform.

Responsibilities

  • Establish and maintain secure connections to heterogeneous Government and public data sources.

  • Ingest structured, semi-structured, and unstructured information.

  • Configure Amazon S3, AWS Glue Data Catalog, Glue Crawlers, Athena, Step Functions, EventBridge, and approved managed data-preparation services.

  • Design reusable patterns for JDBC, Oracle, Red Hat/Linux, APIs, files, PDFs, scheduled feeds, and unscheduled uploads.

  • Incorporate Government-furnished Spark-compatible transformation logic into the approved architecture.

  • Implement schema inference, standardization, validation, lineage, quality controls, and exception handling.

  • Detect connection failures, schema changes, stale data, duplicates, prohibited data, and other quality issues.

  • Support daily refresh requirements and scalable onboarding of new data sources.

  • Produce technical documentation, runbooks, data dictionaries, and source-to-interface mappings.

  • Support the live technical demonstration and subsequent production transition.

Required Experience

  • Five or more years of senior AWS data-engineering experience.

  • Strong hands-on experience with S3, Glue, Athena, Step Functions, EventBridge, and AWS-native monitoring.

  • Experience integrating relational databases, APIs, documents, and mixed-format enterprise data.

  • Demonstrated experience with data quality, metadata management, schema evolution, lineage, and operational monitoring.

  • Familiarity with Spark, PySpark, JavaSpark, or Spark transformation patterns.

  • Experience in federal, regulated, or sensitive-data environments strongly preferred.

Architecture Constraint

Implementation must remain within Axyde’s approved AWS managed-service baseline. Candidates must not assume that custom Python, Lambda, containers, EC2, third-party libraries, or external integration platforms may be used.

Engagement

U.S. citizenship required. Remote within the United States with occasional travel. Immediate proposal and demonstration support may be available; longer-term work is contingent upon award.