CrawlJobs Logo

Data Engineer SME

anavationllc.com Logo

AnaVation

Location Icon

Location:
United States, Chantilly

Category Icon
Category:
IT - Software Development

Job Type Icon

Contract Type:
Not provided

Salary Icon

Salary:

Not provided
Save Job
Save Icon
Apply Position

Job Description:

AnaVation is seeking a highly skilled Senior-level Data Engineer to join our team deliver engineering tasks to advanced analytic applications across classified environments. You will develop sophisticated data pipelines and ETL processes for desktop and web-based analytic software, facilitate the bulk analysis of relational information, and enable applications that deliver data from diverse data sources.

Job Responsibility:

  • Design and implement complex data pipelines and ETL processes to support cyber investigative capabilities across multi-classification domains
  • Architect and develop ETL workflows for highly sensitive data in classified environments
  • Support IC Data Services requirements by integrating various intelligence data sources and systems
  • Develop and maintain data analytics solutions for desktop and web-based visual analytic applications
  • Establish applications that produce manageable, actionable intelligence from streams of structured and semi-structured data
  • Design strategies for enterprise database systems and set standards for operations, programming, and security
  • Construct and optimize large relational databases across multi-enclave environments (Unclassified, Secret, and Top Secret)
  • Tune performance of large-scale data workflows, ensuring cost efficiency, low latency, and high availability
  • Design and manage Elasticsearch/Opensearch clusters for fast search, indexing, and retrieval of large-scale datasets
  • Integrate new systems with existing warehouse structures and refine system performance and functionality
  • Implement CI/CD pipelines for data systems, automate monitoring/alerting, and enforce infrastructure-as-code practices
  • Provide technical leadership and mentorship to other team members
  • Participate in Program Increments (PIs) and Agile Release Train (ART) activities

Requirements:

  • Bachelor's degree in Computer Science, Data Science, Engineering, or related field
  • Minimum of 10 years of experience in data engineering or related field
  • Active Top Secret (TS) clearance with eligibility for Sensitive Compartmented Information (SCI)
  • Experience with SAFe Agile framework
  • Strong understanding of forensic and investigative data requirements
  • Demonstrated experience designing and implementing data solutions in secure government environments
  • Advanced proficiency with Python for data processing, automation and ETL workflow orchestration
  • SQL (MySQL, PostgreSQL, Microsoft SQL) and query optimization
  • Elasticsearch or Opensearch (design, scaling, query optimization, cluster management)
  • Data pipeline technologies (Apache Nifi, Cribl)
  • Cross-domain ETL solutions for secure data transfer between classification levels
  • Containerization and orchestration technologies (Docker, Kubernetes)
  • Cloud platforms (AWS GovCloud, SC2S, C2S)
  • Experience handling data in accordance with IC security protocols and classification guidelines
  • IC Data Services frameworks and integration protocols
  • GraphQL: schema design, API development, query optimization, and integrations
  • DevSecOps practices and tools in classified environments
  • RabbitMQ and Redis
  • Must be a U.S. citizen and able to pass a background check and polygraph examination

Nice to have:

  • Experience with Intelligence Community Data Services and standards
  • Prior work with cross-domain solutions for ETL processes
  • Knowledge of IC specific data formats, schemas and transfer protocols
  • Experience with specialized IC analytics platforms and data repositories
  • Prior work integrating intelligence data across multiple enclaves
  • Cloud certification
What we offer:
  • Generous cost sharing for medical insurance for the employee and dependents
  • 100% company paid dental insurance for employees and dependents
  • 100% company paid long-term and short term disability insurance
  • 100% company paid vision insurance for employees and dependents
  • 401k plan with generous match and 100% immediate vesting
  • Competitive Pay
  • Generous paid leave and holiday package
  • Tuition and training reimbursement
  • Life and AD&D Insurance

Additional Information:

Job Posted:
December 06, 2025

Employment Type:
Fulltime
Work Type:
On-site work
Icon
View All Jobs In This Company
Job Link Share:
Copy Link Icon
Facebook Icon Twitter Icon LinkedIn Icon

Looking for more opportunities? Search for other job offers that match your skills and interests.

Briefcase Icon

Similar Jobs for Data Engineer SME

Data Lake SME

We are looking for an experienced Data Lake / ETL Engineer with 7+ years of expe...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 7+ years of experience in data engineering, ETL/ELT development, or data lake management
  • Strong expertise in ETL tools (Informatica, Talend, dbt, SSIS, or similar)
  • Hands-on experience with big data ecosystems: Hadoop, Spark, Hive, Presto, Delta Lake, or Iceberg
  • Proficiency with SQL, Python, or Scala for data processing and transformation
  • Experience with cloud data platforms (AWS Glue, Redshift, Azure Synapse, GCP BigQuery)
  • Familiarity with workflow orchestration tools (Airflow, Temporal, Oozie)
Job Responsibility
Job Responsibility
  • Design and implement data ingestion pipelines for structured, semi-structured, and unstructured data
  • Develop and manage ETL/ELT processes for large-scale data processing
  • Optimize storage and retrieval strategies across on-prem and cloud-based data lakes
  • Integrate data from multiple sources (databases, APIs, streaming platforms)
  • Implement real-time and batch processing using Apache Spark, Kafka, or Flink
  • Support metadata management, data lineage, and cataloging
  • Tune queries and pipelines for high performance and cost efficiency
  • Implement partitioning, indexing, and caching strategies for large datasets
  • Automate routine ETL/ELT workflows for reliability and speed
  • Ensure compliance with data governance, privacy, and regulatory standards (GDPR, HIPAA, etc.)
What we offer
What we offer
  • Health & Wellbeing
  • Personal & Professional Development
  • Unconditional Inclusion
  • Fulltime
Read More
Arrow Right

Big Data Engineer

The Applications Development Intermediate Programmer Analyst is an intermediate ...
Location
Location
India , Pune
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably)
  • Experience working with Hive, Impala, Kudu, HBase, Spark for data curation/conformance related work
  • proficiency in Spark for development work related to curation/conformance
  • Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event-based messaging
  • Strong data analysis skills and the ability to slice and dice the data as needed for business reporting
  • Experience working in an agile environment with a fast-paced changing requirement
  • Excellent planning and organizational skills and Strong Communication skills
  • Relational SQL and NoSQL database integration and data distribution principles experience
  • Experience with API development and use of JSON/XML/Hypermedia data formats
  • Align to Engineering Excellence Development principles and standards
Job Responsibility
Job Responsibility
  • Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
  • Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
  • Apply fundamental knowledge of programming languages for design specifications
  • Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
  • Serve as advisor or coach to new or lower level analysts
  • Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
  • Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Big Data Engineering Developer

The Applications Development Senior Programmer/Lead Analyst is an senior level p...
Location
Location
India , Pune; Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Strong solid understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably)
  • 9+ years of experience working with Hive, Impala and Hbase, Kudu Spark for data curation/conformance related work
  • Strong proficiency in Spark for development work related to curation/conformance. Strong Scala developer (with previous Java background) preferred.
  • Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging
  • Strong data analysis skills and the ability to slice and dice the data as needed for business reporting
  • Experience working in an agile environment with a fast paced changing requirements.
  • Excellent planning and organizational skills
  • Strong Communication skills
Job Responsibility
Job Responsibility
  • Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
  • Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
  • Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
  • Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
  • Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
  • Ensure essential procedures are followed and help define operating standards and processes
  • Serve as advisor or coach to new or lower level analysts
  • Has the ability to operate with a limited level of direct supervision
  • Can exercise independence of judgement and autonomy
  • Acts as SME to senior stakeholders and /or other team members
  • Fulltime
Read More
Arrow Right

Sr Application Data Engineer

The Applications Development Senior Programmer Analyst will contribute to applic...
Location
Location
India , Pune; Chennai
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 5-8 years of relevant experience
  • experience in systems analysis and programming of software applications
  • experience in managing and implementing successful projects
  • working knowledge of consulting/project management techniques/methods
  • ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
  • 10+ years of application/software development/maintenance
  • banking domain experience
  • 8+ years of experience on Big Data Technologies like Apache Spark, Hive, Hadoop
  • proficiency in ETL technologies like Abinitio, Data stage, Informatica
  • strong technical knowledge of Apache Spark, Hive, SQL, Hadoop ecosystem, UNIX/Python Scripting, Oracle/DB2
Job Responsibility
Job Responsibility
  • conduct feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and system implementation
  • monitor and control all phases of the development process, including analysis, design, construction, testing, and implementation
  • provide user and operational support on applications to business users
  • analyze complex problems and make evaluative judgments
  • recommend and develop security measures post-implementation
  • consult with users/clients on issues and recommend advanced programming solutions
  • install and assist customer exposure systems
  • define operating standards and processes
  • serve as advisor or coach to new or lower-level analysts
  • exercise judgment and autonomy
  • Fulltime
Read More
Arrow Right

Data Security Engineer

The data security engineer is responsible for designing, implementing, and maint...
Location
Location
United States , Spring
Salary
Salary:
106000.00 - 243000.00 USD / Year
https://www.hpe.com/ Logo
Hewlett Packard Enterprise
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor's degree in Cybersecurity, Information Technology, Computer Science, or a related field. Or equivalent experience
  • 8 years of experience in cybersecurity, with at least 5 years focused on DLP
  • Hands-on experience with tools like Zscaler DLP, Microsoft IPG, or equivalent
  • Strong understanding of data protection regulations (HIPPA, PCI, SOX) and enterprise compliance frameworks
  • Certified Information Systems Security Professional (CISSP), Certified Information Security Manager (CISM), or equivalent
  • Knowledge of the NIST 800-53, ISO 27001, and Zero Trust
  • Strong analytical and problem-solving skills
  • Excellent communication and leadership skills
  • Ability to manage multiple high-impact projects simultaneously
Job Responsibility
Job Responsibility
  • Lead the design and deployment of enterprise data protection capabilities like DLP, encryption, SSPM, and CASB
  • Lead the evaluation and adoption of new security tools and technologies
  • Manage and fine tune data security policies with the changing requirements
  • Contribute to security policies, standards, and procedures to ensure compliance with industry best practices and regulatory requirements
  • Collaborate with IT and DevOps teams to integrate security into the software development lifecycle (SDLC), infrastructure as code (IaC), and cloud environments
  • Collaborate with data warehouse team to feed data into SIEM and long term storage solutions
  • SME for the technical response of high-severity security incidents
  • Contribute to playbooks and procedures
  • Collaborate with key stakeholders, including IT, DevOps, legal, and compliance teams
  • Provide expert guidance on emerging threats, technologies, and regulatory requirements
What we offer
What we offer
  • Health & Wellbeing benefits
  • Personal & Professional Development programs
  • Unconditional Inclusion environment
  • Comprehensive suite of benefits supporting physical, financial and emotional wellbeing
  • Fulltime
Read More
Arrow Right

SME - Performance Engineering

A highly skilled Subject Matter Expert (SME) in Performance Engineering to lead ...
Location
Location
India , Bangalore
Salary
Salary:
Not provided
https://www.ikea.com Logo
IKEA
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 8-12 years of experience working across large and complex projects in Performance Test Engineering preferable with SAP products
  • Good Hand on experience on performance testing lifecycle for SAP and integrated applications – from requirement gathering, planning, and scripting to execution and analysis
  • Able to Design and develop performance test strategies and test plans aligned with business and technical objectives
  • Hands on experience in Developing and maintaining integrated performance test scripts for SAP modules and supporting systems using LoadRunner Cloud and open-source tools
  • Set up and configure test environments (on-prem or cloud) including load generators, monitoring tools, and data preparation
  • Execute load, stress, endurance, and scalability tests and analyze results to identify bottlenecks and performance issues
  • Collaborate closely with SAP Basis, infrastructure, and application teams to fine-tune systems and resolve performance bottlenecks
  • Provide performance tuning recommendations across application code, database, and infrastructure layers
  • Prepare and present detailed performance reports with actionable insights to technical and business stakeholders
  • Contribute to performance engineering best practices, automation frameworks, and continuous improvement initiatives
Job Responsibility
Job Responsibility
  • Lead performance engineering initiatives across multiple systems—covering application and infrastructure layers—to ensure our SAP platforms perform optimally under forecasted peak loads
  • Collaborate with technology architects, business stakeholders, and application providers to identify, assess, and mitigate performance risks proactively
  • Design, plan, and execute performance testing strategies, including developing test scripts, configuring on-premises and cloud-based load generators, and analyzing performance results
  • Drive root-cause analysis for performance bottlenecks, propose preventive actions, and ensure long-term system resilience
  • Act as a bridge between internal and external stakeholders through clear communication, effective documentation, and precise performance reporting
  • Define performance scope and align expectations across delivery teams, ensuring results are clearly communicated and risks are managed
  • Contribute to strategic roadmap development by analyzing release strategies, identifying improvement opportunities, and introducing innovative approaches to performance engineering
  • Work closely with cross-functional teams—including development, product management, and process teams—to ensure performance best practices are embedded throughout the lifecycle
  • Mentor junior engineers, share best practices, and promote a culture of continuous improvement within the quality engineering domain
  • Fulltime
Read More
Arrow Right

Senior Data Engineer ETL Lead

The Sr Data Engineer ETL Lead is a senior level position responsible for establi...
Location
Location
United States , Irving
Salary
Salary:
Not provided
https://www.citi.com/ Logo
Citi
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • 6+ years of relevant experience in Apps Development or systems analysis role
  • Extensive experience system analysis and in programming of software applications
  • Experience in managing and implementing successful projects
  • Subject Matter Expert (SME) in at least one area of Applications Development
  • Ability to adjust priorities quickly as circumstances dictate
  • Demonstrated leadership and project management skills
  • Consistently demonstrates clear and concise written and verbal communication
  • Bachelor’s degree in Computer Science or equivalent /University degree or equivalent experience
  • Data Warehouse/ETL design and development methodologies knowledge and experience required
  • ETL expertise on AbInitio tool (EME, GDE, Co-op) bringing together all components like Unix, Oracle, Storage
Job Responsibility
Job Responsibility
  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
  • Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
  • Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
  • Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
  • Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
  • Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
  • Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
  • Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency
What we offer
What we offer
  • Medical, dental & vision coverage
  • 401(k)
  • life, accident, and disability insurance
  • wellness programs
  • paid time off packages including vacation, sick leave and paid holidays
  • Fulltime
Read More
Arrow Right
New

Pre-Sales Solution Engineer

We are seeking a highly skilled Enterprise focused Pre-Sales Solution Engineer t...
Location
Location
Salary
Salary:
Not provided
lakefs.io Logo
LakeFS
Expiration Date
Until further notice
Flip Icon
Requirements
Requirements
  • Bachelor’s degree in Computer Science, Engineering, or a related technical field
  • 5+ years of experience in a technical pre-sales or solution engineering role, preferably in the software industry
  • Excellent verbal and written communication skills, with the ability to deliver technical presentations to both technical and non-technical audiences
  • Hands-on experience with Kubernetes and containerized environments
  • Experience leading client workshops, sales enablement sessions, and technical training
  • Ability to work independently as well as collaboratively across sales, product, and engineering teams
  • Excellent problem-solving skills and a creative approach to architecting solutions
  • Experience in technical sales of open source products is preferred
  • Strong understanding and hands-on experience in the Data & AI ecosystem, including: Data lake and data warehouse technologies (e.g., S3, Delta Lake, Iceberg, Hive, Glue, Snowflake)
  • Data processing frameworks (e.g., Spark, Databricks, Flink, Trino, Presto)
Job Responsibility
Job Responsibility
  • Own the technical win from discovery through demo, architecture design, pilot/POC, security review, and a clean handoff to Customer Success
  • Design and present tailored demos that showcase branch‑based workflows, reproducible experiments, schema‑safe changes, and instant data rollback
  • Scope and execute pilots with clear success criteria
  • create sample repos, notebooks, and automation (Spark/Databricks jobs, Airflow DAGs, CI pipelines) that prove value quickly
  • Build reference architectures for lakeFS OSS and Cloud across AWS/Azure/GCP
  • document IAM roles, private networking, scaling, GC/performance tuning, and disaster recovery
  • Answer deep technical questions as a lakeFS SME
  • Handle RFPs and security questionnaires
  • map controls to customer requirements and recommend compliant deployment patterns
  • Partner with sales to quantify business impact (risk reduction, developer velocity, storage efficiency) and co‑create the ROI/TCO narrative with champions
Read More
Arrow Right
Welcome to CrawlJobs.com –
Your Global Job Discovery Platform
At CrawlJobs.com, we simplify finding your next career opportunity by bringing job listings directly to you from all corners of the web. Using cutting-edge AI and web-crawling technologies, we gather and curate job offers from various sources across the globe, ensuring you have access to the most up-to-date job listings in one place.
Jobs by Category
Art and Entertainment Jobs Banking Jobs Call Center Jobs Construction Jobs Consulting Jobs Customer Service Jobs Education Jobs Energy Jobs Finance Jobs Gastronomy Jobs Health and Beauty Jobs Hospitality and Tourism Jobs Human Resources Jobs Insurance Jobs IT - Administration Jobs IT - Software Development Jobs Legal Jobs Logistics Jobs Manufacturing Jobs Marketing, Digital Marketing, SEO, SEM Jobs Media Jobs Nursing Jobs Office Administration Jobs Pharmacy Jobs Physical Work Jobs Public Relations Jobs Public Sector Jobs Purchasing Jobs Quality Control Jobs Real Estate Jobs Research and Development Jobs Sales Jobs
Job Positions Jobs by Country
United States Jobs United Kingdom Jobs India Jobs Australia Jobs Canada Jobs Poland Jobs Ireland Jobs Spain Jobs
Company
Blog About Us Contact
Follow Us
Facebook
X (Twitter)
LinkedIn
Instagram
© 2025 CrawlJobs Ltd. All Rights Reserved
Terms & Conditions Privacy Policy