Principal Data Engineer

Job Summary The Principal Data Engineer is responsible for designing, developing, and enhancing data engineering solutions with a focus on test data management and data pipeline optimization. This role involves working closely with business and technical teams to deliver scalable data solutions, improve data quality, and support modern data ecosystems in a collaborative environment. Key Responsibilities Design, develop, and implement scalable data engineering solutions and data pipelines. Build and maintain automation scripts using Python and Unix shell scripting. Develop APIs to support data access and integration requirements. Collaborate with stakeholders to gather requirements and translate them into technical solutions. Work with orchestration tools to manage and schedule data workflows. Implement and maintain data masking and data security solutions. Ensure data quality through validation, monitoring, and automated testing frameworks. Analyze complex data ecosystems and provide insights for optimization and improvement. Work with relational databases including DB2, Oracle, PostgreSQL, and similar systems. Support cloud-based data solutions, preferably within AWS environments. Mentor team members and provide technical leadership and guidance. Collaborate within Agile teams to deliver high-quality solutions and resolve data challenges. Continuously improve processes and adopt new technologies to enhance data capabilities. Required Qualifications 10+ years of experience in software development with a focus on data engineering or data analysis. Strong proficiency in Python for data pipelines, automation, and transformation logic. Experience with Unix shell scripting (bash, ksh) and orchestration tools. Strong SQL skills and experience with relational databases such as DB2, Oracle, PostgreSQL, or similar. Experience developing APIs for data integration. Experience working with cloud platforms, preferably AWS. Experience with data masking solutions such as Delphix or Optim. Strong data analysis and problem-solving skills. Experience working with data quality frameworks and validation processes. Strong communication, collaboration, and organizational skills. Preferred Qualifications Experience with native stored procedures. Experience with distributed databases such as CockroachDB. Experience with mainframe technologies such as COBOL, CICS, VSAM, or JCL. Experience working in complex enterprise data environments. Experience mentoring and leading data engineering teams.