Senior Data Scientist

senior data engineer

Job Description:

We are seeking a highly skilled Senior Data Engineer to design, develop, and maintain scalable data platforms and cloud-based data pipelines. The ideal candidate should have strong expertise in big data technologies, ETL/ELT frameworks, cloud platforms, and modern data warehouse solutions. The role involves working closely with Data Scientists, Analysts, and Business teams to support enterprise analytics and AI/ML initiatives.

Responsibilities:

Design, build, and optimize scalable ETL/ELT pipelines for large-scale enterprise data platforms. Develop and maintain data lakes, data warehouses, and lakehouse architectures. Work with structured, semi-structured, and unstructured datasets from multiple data sources. Implement data ingestion, transformation, orchestration, and monitoring frameworks. Build cloud-native data solutions using AWS, Azure, or GCP services. Optimize data processing performance using Spark, Databricks, Hadoop, and distributed computing technologies. Collaborate with Data Scientists and BI teams to support analytics and machine learning workloads. Implement data governance, security, quality checks, and best practices. Develop CI/CD pipelines and automation for data engineering workflows. Troubleshoot and resolve production issues related to data pipelines and platforms. Mentor junior engineers and participate in architecture discussions.

Required Skills:

10+ years of experience in Data Engineering. Strong hands-on experience with Python, SQL, Scala, or Java. Expertise in Spark, Databricks, Hadoop, Kafka, Airflow, and Snowflake.

Experience with cloud platforms:

AWS, Azure, or GCP. Strong experience with ETL/ELT pipeline development and orchestration tools. Experience with Data Warehousing and Data Modeling concepts. Knowledge of real-time and batch data processing. Hands-on experience with Docker, Kubernetes, and CI/CD pipelines. Strong understanding of performance tuning and optimization. Experience with Git, DevOps, and Agile methodologies.

Preferred Skills:

Experience supporting AI/ML pipelines and MLOps environments. Knowledge of Delta Lake, Iceberg, or modern lakehouse architectures. Experience in Banking, Healthcare, Retail, Insurance, or Manufacturing domains. Familiarity with Power BI/Tableau reporting integrations. Exposure to Generative AI or AI-driven analytics platforms.

Pay:

$70.00 - $80.00 per hour

Benefits:

Relocation assistance

Work Location:

In person