Apply to SENIOR AWS DATA-INTEGRATION AND DATA-QUALITY ENGINEER
<meta />
Axyde Analytics seeks a senior AWS data engineer to design and implement managed-service data-ingestion, transformation, quality, cataloging, and monitoring capabilities for a federal enterprise analytics platform.
Responsibilities
-
Establish and maintain secure connections to heterogeneous Government and public data sources.
-
Ingest structured, semi-structured, and unstructured information.
-
Configure Amazon S3, AWS Glue Data Catalog, Glue Crawlers, Athena, Step Functions, EventBridge, and approved managed data-preparation services.
-
Design reusable patterns for JDBC, Oracle, Red Hat/Linux, APIs, files, PDFs, scheduled feeds, and unscheduled uploads.
-
Incorporate Government-furnished Spark-compatible transformation logic into the approved architecture.
-
Implement schema inference, standardization, validation, lineage, quality controls, and exception handling.
-
Detect connection failures, schema changes, stale data, duplicates, prohibited data, and other quality issues.
-
Support daily refresh requirements and scalable onboarding of new data sources.
-
Produce technical documentation, runbooks, data dictionaries, and source-to-interface mappings.
-
Support the live technical demonstration and subsequent production transition.
Required Experience
-
Five or more years of senior AWS data-engineering experience.
-
Strong hands-on experience with S3, Glue, Athena, Step Functions, EventBridge, and AWS-native monitoring.
-
Experience integrating relational databases, APIs, documents, and mixed-format enterprise data.
-
Demonstrated experience with data quality, metadata management, schema evolution, lineage, and operational monitoring.
-
Familiarity with Spark, PySpark, JavaSpark, or Spark transformation patterns.
-
Experience in federal, regulated, or sensitive-data environments strongly preferred.
Architecture Constraint
Implementation must remain within Axyde’s approved AWS managed-service baseline. Candidates must not assume that custom Python, Lambda, containers, EC2, third-party libraries, or external integration platforms may be used.
Engagement
U.S. citizenship required. Remote within the United States with occasional travel. Immediate proposal and demonstration support may be available; longer-term work is contingent upon award.
