Senior Data Engineer (TS/SCI CI Poly)
Zachary Piper Solutions is seeking a Senior Data Engineer to support this mission-critical initiative is modernizing NGA's enterprise GEOINT data ecosystem and transforming how analysts, operators, and decision-makers across the Intelligence Community discover, access, integrate, process, manage, and distribute geospatial intelligence data. The Senior Data Engineer will serve as a technical leader responsible for designing and implementing scalable cloud-based data platforms, enterprise data services, and mission-focused data solutions supporting national security objectives.
Responsibilities of the Senior Data Engineer Include:
Lead the architecture, design, development, and operation of scalable data pipelines and ETL/ELT workflows.
Design and implement enterprise data ingestion frameworks and integration solutions.
Develop secure API integrations that ingest, process, and manage data from internal and external systems.
Evaluate and recommend data storage, processing, analytics, and cloud-native architecture solutions.
Establish engineering standards and best practices supporting enterprise data lifecycle management.
Optimize data platform performance, scalability, reliability, and availability.
Build and enhance enterprise data quality, validation, monitoring, and governance capabilities.
Develop solutions supporting structured, semi-structured, and unstructured datasets.
Implement data lineage, metadata management, cataloging, and operational monitoring capabilities.
Support production environments and lead troubleshooting efforts involving complex operational and data integration issues.
Coordinate with Information Assurance and cybersecurity teams to ensure compliance with security requirements.
Mentor junior and mid-level engineers while providing technical leadership across the program.
Conduct code reviews, design reviews, and architecture assessments.
Guide engineering teams through technology evaluations, architecture decisions, and platform modernization efforts.
Communicate technical risks, tradeoffs, and recommendations to program stakeholders and leadership.
Support Agile development activities, sprint planning, roadmap development, and engineering initiatives.
Collaborate with mission stakeholders, analysts, architects, product owners, and engineering teams to deliver enterprise GEOINT capabilities.
Translate mission requirements into secure, scalable, and maintainable technical solutions.
Qualifications of the Senior Data Engineer Include:
Active TS/SCI Security Clearance.
Active CI Polygraph.
Bachelor's degree in Computer Science, Information Systems, Engineering, Mathematics, or related technical field plus 5-8 years of relevant experience; OR Master's degree plus 3+ years of relevant experience.
Professional software development experience utilizing Python, Scala, Java, or similar programming languages.
Strong experience designing, developing, and supporting enterprise-scale ETL/ELT architectures.
Experience building, deploying, and maintaining large-scale production data pipelines.
Strong understanding of data modeling and enterprise data architecture design.
Experience integrating APIs, external data services, and distributed data sources.
Experience troubleshooting authentication, integration, and data exchange issues.
Experience working with cloud-based data platforms and cloud-native architectures.
Strong understanding of software development best practices including Git, automated testing, CI/CD pipelines, code reviews, and configuration management.
Experience supporting structured, semi-structured, and unstructured datasets.
Proven ability to lead technical initiatives from requirements gathering through production deployment.
Strong communication skills and ability to work across highly technical and mission-focused teams.
Preferred Qualifications Include:
Experience supporting Intelligence Community, NGA, DoD, or national security missions.
Experience with AWS cloud environments and cloud-native data platforms.
Hands-on experience with Apache Spark, Hadoop, Hive, and distributed data processing frameworks.
Experience with Elasticsearch and enterprise search technologies.
Experience building and integrating REST APIs.
Familiarity with enterprise metadata management and data catalog technologies.
Experience supporting large-scale GEOINT, analytics, or intelligence data environments.
Knowledge of modern data governance, lineage, and metadata management practices.
Experience operating within Agile software development environments.
Compensation for the Senior Data Engineer Includes:
Competitive Salary Based on Experience and Clearance Level
Comprehensive Benefits Package Including Medical, Dental, Vision, and 401(k)
Paid Time Off and Paid Holidays
Long-Term Program Stability Supporting Critical National Security Missions
Career Growth Opportunities Within Enterprise Data Engineering and Intelligence Programs
Keywords:
Senior Data Engineer, Data Engineer, ETL, ELT, Data Architecture, Data Pipelines, Cloud Data Engineering, AWS, Apache Spark, Hadoop, Hive, Elasticsearch, REST API, Data Integration, Metadata Management, Data Governance, Data Lineage, GEOINT, Geospatial Intelligence, NGA, National Geospatial-Intelligence Agency, GEODS, Intelligence Community, IC, TS/SCI, CI Polygraph, Python, Java, Scala, Big Data, Enterprise Data Services, Cloud-Native Data Platforms, Distributed Data Processing, Analytics Platforms, Data Modernization, National Security, Software Engineering, Agile Development, Enterprise Architecture.
#LI-JL1