We are seeking a Lead ETL Engineer to lead the development of large-scale, cloud-based data warehouse solutions and transformation pipelines. The ideal candidate will have strong hands-on experience with ETL, cloud data warehouses, Python, OLAP data modeling, data governance, performance tuning, automated testing, and CI/CD .
Key Responsibilities:
Architect and maintain ODS, EDW, data lakes, data marts, and metadata repositories . Design and develop scalable ETL/data movement pipelines using Informatica, Azure Data Factory, SQL Packages , and batch/real-time data streams. Build reusable frameworks for structured/semi-structured data ingestion, settlement, and reconciliation . Develop logical/physical data models , data architecture, and data flow diagrams. Optimize data warehouse solutions for performance, resiliency, and scalability . Lead data governance capabilities including data lineage, catalog, and data quality . Troubleshoot and resolve data warehouse/ODS production issues and critical incidents . Develop production-grade ETL code and implement automated testing frameworks . Lead test strategy, planning, execution, database validation, integration/E2E testing, and test automation . Integrate automated test suites into CI/CD pipelines using Jenkins/GitHub .
Required Skills & Qualifications:
8+ years of software development experience, primarily in Data Warehouse applications , with 3+ years in technical leadership . 3+ years hands-on experience with cloud data warehouses , preferably AWS Redshift . 3+ years with ETL tools , preferably Informatica Cloud . 3+ years of Python scripting/development . Strong expertise in OLAP data modeling and database design . Strong SQL/database performance tuning experience with large data volumes. Knowledge of data governance, security, and compliance , including SOC 2 and PCI DSS . Experience with CI/CD (Jenkins, GitHub Actions) and Infrastructure as Code . Strong analytical, problem-solving, communication, and cross-functional collaboration skills. Bachelor's/Master's degree in Computer Science, Computer Engineering, or related field preferred.
Preferred:
Fintech/financial services or enterprise data warehouse experience. Experience with partner reporting, compliance analytics, and business intelligence . Experience building scalable QA and automated testing practices . Contributions to open-source QA frameworks or technical publications .