Locals Only _ PySpark Developer _ Iselin NJ Position Available In Middlesex, New Jersey

Job Description:

Role:

PySpark Developer Location:

Iselin NJ (3 Days Hybrid fromDay 1) 6 Months In-person interview is must

Responsibilities:

Develop, maintain, and optimize data processing pipelines usingPySpark on Azure Cloud. Collaborate with cross-functional teams tounderstand data requirements and translate business needs intotechnical specifications. Design and implement scalable data modelsand data architecture to support analytical and reporting needs.

Perform data cleansing, transformation, and enrichment processes toenhance data quality and usability. Monitor and troubleshoot dataprocessing jobs, ensuring high availability and performance.

Implement best practices for data governance and security withinAzure Cloud. Stay up-to-date with emerging technologies in bigdata, cloud computing, and the financial services industry.

Requirements:

Minimum of 9 years of experience in PySparkdevelopment. Proven experience working with Azure Cloud services(Azure Data Factory, Azure Databricks, etc.). Prior experience inthe banking, investment banking, or financial services sector ismandatory. Proficient in PySpark for data processing and ETL tasks.

Experience with SQL and NoSQL databases. Familiarity with datawarehousing concepts and tools. Knowledge of Azure services relatedto big data and analytics. Preferred, but not required: Experiencewith containerization technologies (e.g., Docker, Kubernetes).Familiarity with machine learning frameworks (e.g., MLlib,TensorFlow).