A Data Engineer designs, builds and manages the information or big data infrastructure. Develops the architecture that helps analyze and process data in the way the organization needs it. Makes sure those systems are performing smoothly.
Hanover, MD Job Details $103,000 - $171,800 a year 15 hours ago Qualifications Data model design Commercial use (data warehousing systems) Cloud analytics services Software engineering Data Integration (Data management) Data modeling projects Workflow management (operations management method) Schema design Java SQL Cloud database architecture Bachelor's degree Distributed computing Python Full Job Description SMX is hiring a Data Engineer responsible for designing, building, and maintaining scalable data architecture that powers our AI, analytics and reporting. Collaborate closely with Analysts, AI Engineers, and Software Engineers to transform raw, unstructured data into high-quality, accessible data pipelines. Optimizing data systems, building them from the ground up, and ensuring peak data reliability and performance. This role is essential for making data accessible, reliable, and usable across the enterprise. Essential Duties and Responsibilities Design, construct, install, test, and maintain highly scalable data management systems and robust ELT/ETL pipelines across cloud and on-prem systems. Build infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using cloud technologies. Support API strategy, data modeling, and domain-driven data structures. Implement monitoring systems to ensure data integrity, quality, and security across all storage and processing layers. Implement data quality checks, validation, lineage tracking, and metadata management. Prepare and optimize data for AI/ML models, semantic search, analytics, and mission applications. Identify, design, and implement internal process improvements, such as automating manual processes and optimizing data delivery for greater scalability. Automate ingestion and transformation processes using industry-standard tools and patterns. Troubleshoot pipeline issues and optimize for performance and cost. Work with analytics and business teams to understand their data requirements and deliver production-ready datasets. Collaborate with AI engineers and analysts to ensure datasets meet requirements. Required Skills & Experience Bachelor's degree in Computer Science, Information Technology, Data Engineering 4+ years of progressive professional experience in a data engineering or backend software engineering role Security clearance required (Secret or higher) Strong proficiency in Python, SQL, Java. Experience with cloud data warehouses such as Snowflake and AWS Redshift. Familiarity with distributed computing tools like Spark, Databricks, and Kafka. Experience with Azure Data Factory, AWS Glue, or similar data integration platforms. Experience with workflow management tools like Apache Airflow. Hands-on experience with AWS, GCP, or Azure cloud environments. Familiarity with multi-cloud data ecosystem patterns. Experience integrating structured and unstructured data sources. Knowledge of schema design, data modeling, and cloud-based storage patterns. Desired Skills & Experience Experience supporting AI/ML pipelines, vectorization, or embedding generation Experience with data governance, access controls, or sensitive data protection Exposure to DevOps/CI-CD patterns for data workflows MuleSoft implementation experience Experience with real-time data streaming and event-driven architectures #LI-SA1 At SMX®, we are a team of technical and domain experts dedicated to enabling your mission. From priority national security initiatives for the DoD to highly assured and compliant solutions for healthcare, we understand that digital transformation is key to your future success. We share your vision for the future and strive to accelerate your impact on the world. We bring both cutting edge technology and an expansive view of what's possible to every engagement. Our delivery model and unique approaches harness our deep technical and domain knowledge, providing forward-looking insights and practical solutions to power secure mission acceleration. SMX is an Equal Opportunity employer including disabilities and veterans. Selected applicant may be subject to a background investigation and/or education verification. SMX does not sponsor a new applicant for employment authorization or immigration related support for this position (i.e.
H1B, F-1 OPT, F-1 STEM OPT, F-1
CPT, J-1, TN, E-2, E-3, L-1 and O-1, or any EADs or other forms of work authorization that require immigration support from an employer).
