Arrowminds inc Apply Now Azure Data Engineer - Greenfield, IN - Fulltime Greenfield, IN, US

• Posted 9 hours ago
• Updated 9 hours ago Full Time No Travel Required On-site Depends on Experience Arrowminds inc Fitment Dice Job Match Score™ To see how well you match this job, please log in or create an account .

Once logged in, be sure to complete your profile to get the most accurate match score. Job Details Skills Azure Databricks ADF | ADLS Gen2 Azure SQL Python | Unity Catalog Delta Lake Azure Cloud Azure DevOps Azure Databricks ADF | ADLS Gen2 Azure SQL Python | Unity Catalog Delta Lake Azure Cloud Azure DevOps Summary Only

FTE & ONSITE

-

Greenfield, IN Salary:

$150

K PA Job Title:

Azure Data Engineer Location:

Onsite:

Greenfield, IN Duration:

FTE Experience Range:

12+ years Tech Stack Snapshot - Azure Databricks | PySpark | ADF | ADLS Gen2 | Azure SQL | Python | Unity Catalog | Delta Lake | Azure Cloud | CI/CD | Git | Azure DevOps Role Summary We are looking for an experienced Data Engineering Tech Lead with strong expertise in Azure Databricks, PySpark, Azure Data Factory (ADF), ADLS Gen2, Azure SQL, Python, and Azure Cloud. The role will lead the design, development, optimization, and maintenance of scalable enterprise data engineering and Lakehouse solutions, including batch and near-real-time data processing. Primary Skills

• 4+ years of experience in Azure Databricks with PySpark.
• 2+ years of experience in Databricks workflow & Unity catalog.
• 3+ years of experience in ADF (Azure Data Factory).
• 3+ years of experience in ADLS Gen 2.
• 3+ years of experience in Azure SQL.
• 5+ years of experience in Azure Cloud platform.
• 2+ years of experience in Python programming & package builds.

Job Description Key technical skills:

• Data management experience handling Analytics workload covering design, development, and maintenance of lakehouse solutions sourcing data from platforms such as ERP sources, API sources, Relational stores, NoSQL and on-prem sources using Databricks/PySpark as distributed /big data management service, supporting batch and near-real-time ingestion, transformation, and processing.
• Ability to optimize Spark jobs and manage large-scale data processing using RDD/DataFrame APIs. Demonstrated expertise in partitioning strategies, file format optimization (Parquet/Delta), and Spark SQL tuning. Familiarity with Databricks runtime versions, cluster policies, libraries, and workspace management.
• Skilled in governing and manage data access for Azure Data lakehouse with Unity Catalog. Experience in configuring data permissions, object lineage, and access policies with Unity Catalog .Understanding of integrating Unity Catalog with Azure AD, external meta stores, and audit trails.
• Experience in building efficient orchestration solutions using Azure data factory, Databricks Workflows. Ability to design modular, reusable workflows using tasks, triggers, and dependencies. Skilled in using dynamic expressions, parameterized pipelines, custom activities, and triggers.
• Familiarity with integration runtime configurations, pipeline performance tuning, and error handling strategies.
• Strong experience in implementing secure, hierarchical namespace-based data lake storage for structured/semi-structured data, aligned to bronze-silver-gold layers with ADLS Gen2. Hands-on experience with lifecycle policies, access control (RBAC/ACLs), and folder-level security. Understanding of best practices in file partitioning, retention management, and storage performance optimization.
• Capable of developing T-SQL queries, stored procedures, and managing metadata layers on Azure SQL.
• Comprehensive experience working across the Azure ecosystem, including networking, security, monitoring, and cost management relevant to data engineering workloads. Understanding of VNets, Private Endpoints, Key Vaults, Managed Identities, and Azure Monitor. Exposure to DevOps tools for deployment automation (e.g., Azure DevOps, ARM/Bicep/Terraform).
• Experience in writing modular, testable Python code used in data transformations, utility functions, and packaging reusable components. Familiarity with Python environments, dependency management (pip/Poetry/Conda), and packaging libraries. Ability to write unit tests using PyTest/unit test and integrate with CI/CD pipelines.
• Lead solution design discussions, mentor junior engineers, and ensure adherence to coding guidelines, design patterns, and peer review processes.

Able to prepare Design documents for development and guiding the team technically. Experience preparing technical design documents, HLD/LLDs, and architecture diagrams. Familiarity with code quality tools (e.g., SonarQube, pylint), and version control workflows (Git).

• Demonstrates strong verbal and written communication, proactive stakeholder engagement, and a collaborative attitude in cross-functional teams. Ability to articulate technical concepts clearly to both technical and business audiences. Experience in working with product owners, QA, and business analysts to translate requirements into deliverables. Secondary Skills
• Good to have Azure Entra/AD skills and GitHub Actions.
• Good to have orchestration experience using Airflow, Dagster, LogicApp.
• Good to have experience working on event-driven architectures using Kafka, Azure Event Hub.
• Good to have exposure on Google Cloud Pub/Sub.
• Good to have experience developing and maintaining Change Data Capture (CDC) solutions preferably using Debezium.
• Good to have hands-on experience on data migration projects specifically involving Azure Synapse and Databricks Lakehouse.
• Good to have experienced in managing cloud storage solutions on Azure Data Regards Rajesh Arrowminds Inc Employers have access to artificial intelligence language tools ("AI") that help generate and enhance job descriptions and AI may have been used to create this description.

The position description has been reviewed for accuracy and Dice believes it to correctly reflect the job opportunity.

Dice Id:

91166603

Position Id:

9106393 Posted 9 hours ago Company Info About Arrowminds inc Arrowminds staffing practice delivers high-quality staffing services built on industry best practices. We work with our clients to recruit and retain the best information technology talent possible. Our team manages the acquisition and deployment of professionals for temporary staffing needs. Our flexible recruiting process provides client with consistent, quick access to skilled professionals. Business managers need a knowledgeable technology partner to help them select the best-fit technology platform & business applications to effectively capture the maximum ROI benefits. Arrowminds can offer objective advice on choosing the right technology solutions for your business needs. We also deliver cost-effective software customizations, infrastructure support using global delivery model. Arrowminds provide onsite/offshore resources for any IT technology, Healthcare, financial and manufacturing industries. Go to company profile Create job alert Never miss an opportunity! Create an alert based on the job you applied for. Create alert Similar Jobs Arrowminds inc Principal Data & AI Solutions Leader - Santa Clara, CA (Onsite) - Fulltime Santa Clara, California

• 4d ago

Job Title:

Principal Data & AI Solutions Leader Location:

Santa Clara, CA Duration:

Fulltime Preference for local candidates who can work onsite as required

Experience Level:

15+ Data & AI Solutions Leader We are seeking a Data, Analytics & AI Solutions Leader to serve as a strategic partner to our customers and delivery teams across key accounts. Based in the Bay Area, this role will provide technical leadership, shape innovative solutions, and help drive growth through data, analytics, and A Easy Apply Full-time Depends on Experience Arrowminds inc Agentic AI Sr Architect with Azure Alameda, California

• 7d ago Required Skills & Experience 610 years of experience in AI/ML/Deep Learning model development.

5+ years of experience with Cloud AI platforms such as AWS SageMaker, Azure ML, or Google Cloud Platform AI.23 years of hands-on experience with LLMs, NLP, or Speech/Voice AI systems, including deploying AI solutions in production environments.35 years of experience designing, training, and fine-tuning LLMs or AI models, including Speech/Voice AI systems and real-time voice pipelines.2+ years of experie Easy Apply Contract, Third Party Depends on Experience Search all similar jobs More jobs at Arrowminds inc in Greenfield, IN