Find Jobs
Find Jobs Near You – Available Work in Your Location
Skip to job details
IG
Insight Global
Azure Big Data Java Developer
Career Insights for Big Data Architect
See where this job fits in the broader career landscape. Knowing your career path helps you see what's possible from here.
Scorecard
Based on Georgia data
Review key factors to help you decide if this role fits your goals. How is this calculated?
What they do
A Big Data Architect develops computer infrastructure and databases needed to process large amounts of data for a company or organization. Identifies big data requirements, supports the implementation of big data platforms and designs, builds and implements database systems. Supports database administration, develops database security policies and works to prevent cyber attacks.
$127,211 / year median in Georgia
-7% projected decline
Job Description
Job Description A client of Insight Global is looking for 2 Azure Big Data Java Developers to join their Data Engineering organization. The candidates should possess strong analytical skills and be talented at solving complex problems with an interest in building unique data solutions related to Big Data technology. The Software Engineer-III contractor position that we have in our mind is for anyone interested in data engineering, graph analytics and data science, with an emphasis on Data Engineering and JAVA experience. The pay rate ranges based on years of experience between $55-65/hour. Your responsibilities will include but not limited to:
To learn more about how we collect, keep, and process your private information, please review
- Design and implement models to transform complex, connected datasets into actionable business intelligence using graph analytics principles and technologies
- Core JAVA development including wrapper classes to support object-oriented features
- Write Java classes, build JARs, perform unit testing, and optimize code for performance
- Create entity models based on raw data sources
- Build data pipelines for ingestion and incremental updates
- Build automated test suites
- Validate data quality and investigate data discrepancies
- Review complex requirements and translate them into software designs and solutions
- Write optimized code to clean, transform, and analyze large datasets
- Knowledge sharing through peer programming, group code reviews
- Adhere to code standardization and team best practices
- Collaborate with team members, technical peers and stakeholders
- Test data solutions, monitoring jobs, and fixing issues
- Document technical specs and processes
- Operate in various development environments (Agile, Kanban, Waterfall) We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day.
To learn more about how we collect, keep, and process your private information, please review
Insight Global's Workforce Privacy Policy:
https://insightglobal.com/workforce-privacy-policy/. Skills and Requirements- 10+ years experience
- Meticulous attention to details and strong problem-solving abilities
- Ability to apply logic and critical thinking to interpret data patterns and connections between different data sources
- Able to work with ambiguity, gaining clarity using independent analysis and thorough investigation
- Ability to work with complex data models and data modeling principles
- Understanding of relational database principles
- High proficiency in core JAVA development language OOP, Collections, Multithreading, Data Structures and Exception Handling
- Proficiency with JUNIT testing framework, Maven build tool, GitHub version control and IntelliJ IDE.
- Proficient in Big Data Frameworks such as Apache Spark (preferred) or Hadoop
- Knowledgeable in Azure Databricks, Delta Lake, Spark Core, Azure Data Factory (ADF) and Unity Catalog
- Knowledgeable in analyzing data, finding data patterns, data visualization
- Ability to ingest and transform data using PySpark in Azure Databricks
- Understanding of key Data Warehousing and ETL/ELT Processes such as data pipelines and database management
- Ability to design, build, and maintain robust Extract, Transform, Load (ETL) or Extract, Load, Transform (ELT) pipelines
- Proficient in SQL and NoSQL databases, MySQL and Azure Cosmos DB are preferred
- Knowledgeable in object-oriented programming (OOP) concepts, design patterns, and general software architecture
- Knowledgeable in Cloud Platforms, such as Microsoft Azure (preferred) or AWS
- Experience in performance optimization, including multi-threading, concurrency, and memory management
- Ability to interpret complex data, visualize results, and explain insights to technical and non-technical stakeholders.
- Ability to collaborate with internal and external technology resources.
- Ability to write and review detailed technical specifications
- Knowledge of software development methodologies (e.