Role summary / purpose We are seeking a Senior Data Engineer to lead critical data infrastructure and migration initiatives for our next-generation application platform. This role is essential for establishing a robust, scalable data foundation as we transition from legacy systems to modern cloud-based architecture. Key responsibilities
Database Architecture & Design :
Design and implement PostgreSQL databases and schemas from the ground up, ensuring optimal performance, scalability, and maintainability
Legacy System Migration :
Lead the migration of large-scale Oracle databases from on-premises infrastructure to AWS RDS PostgreSQL clusters, managing data integrity and minimizing downtime
Real-Time Data Products :
Build and optimize data products leveraging Apache Kafka, Apache Flink, and Apache Hudi to deliver reliable data streams to downstream consumers
Schema Analysis & Optimization :
Evaluate existing database schemas, identify optimization opportunities, recommend structural improvements, and ensure database integrity throughout changes
Change Data Capture & Auditing :
Design and implement comprehensive change auditing solutions that track data modifications, provide audit trails, and support compliance requirements
Data Governance & Documentation :
Develop and maintain a data catalog and comprehensive schema documentation to facilitate seamless integration with application development teams Required skills
Database Expertise :
Deep proficiency in PostgreSQL database design, administration, and optimization; strong understanding of relational database principles and
SQL Data Migration :
Proven experience migrating large enterprise databases (Oracle to PostgreSQL preferred) with strong change management practices
Cloud Infrastructure :
Hands-on experience with AWS services, particularly RDS, EC2, and associated networking and security configurations
Streaming & Real-Time Processing :
Solid experience with Apache Kafka, Apache Flink, and data lakehouse technologies (Hudi, Delta Lake, or similar)
Data Modeling :
Ability to design normalized and denormalized schemas, understand trade-offs, and optimize for both OLTP and analytical workloads Change Data Capture (CDC) : Experience implementing CDC patterns and audit logging systems for tracking data lineage and changes
Communication :
Strong ability to translate complex data concepts for technical and non-technical stakeholders; skilled at documenting architectures and schemas Nice-to-have / preferred skills Experience with AWS Data Pipeline tools (Glue, Lambda, or Step Functions) Knowledge of data quality and validation frameworks Familiarity with infrastructure-as-code tools (Terraform, CloudFormation) Prior experience in application modernization or legacy system replacements Understanding of data security, encryption, and compliance requirements (GDPR, HIPAA, etc.)