Azure Data Engineer

Job Overview We are seeking a dynamic and innovative Azure Data Engineer to join our data-driven team. In this role, you will be at the forefront of designing, developing, and maintaining robust data pipelines and architectures leveraging Microsoft Azure cloud services. Your expertise will enable seamless integration of large-scale data sources, empowering stakeholders with actionable insights through advanced analytics and reporting. If you thrive in a fast-paced environment and are passionate about transforming complex data into strategic assets, this opportunity is for you! Responsibilities Design, build, and optimize scalable data pipelines using Azure Data Lake, Spark, Hadoop, and other big data technologies to handle vast datasets efficiently. Develop and implement ETL processes utilizing tools like Informatica, Talend, and custom scripting with Python, Bash (Unix shell), or Shell Scripting to ensure accurate data extraction, transformation, and loading. Collaborate with cross-functional teams to understand data requirements and translate them into effective database designs using Microsoft SQL Server, Oracle, and other relational databases. Manage and enhance data warehouses by integrating diverse data sources such as Linked Data, Apache Hive, and other big data frameworks for comprehensive analysis. Utilize SQL expertise to perform complex queries, model training, and analysis that support business intelligence initiatives. Develop RESTful APIs for seamless data access across platforms while ensuring security and performance standards are met. Support agile development practices by participating in sprint planning, code reviews, and continuous improvement efforts to deliver high-quality solutions. Assist in analysis tasks by providing insights through Looker dashboards or similar visualization tools to facilitate strategic decision-making. Qualifications Proven experience as an Azure Data Engineer or similar role with a strong understanding of cloud-based data architecture on Microsoft Azure platform. Proficiency in programming languages such as Java and Python for data processing tasks. Extensive knowledge of big data technologies including Hadoop, Spark, Apache Hive, and related ecosystems. Hands-on experience with ETL tools like Informatica or Talend for efficient data integration workflows. Strong command of SQL for database design, querying, and analysis across platforms like Microsoft SQL Server and Oracle. Familiarity with analytics tools such as Looker or equivalent BI platforms to create insightful dashboards. Experience working with Data Lake architectures such as Azure Data Lake Storage for scalable storage solutions. Knowledge of RESTful API development for secure data access across applications. Ability to perform model training and analysis skills to support predictive analytics initiatives. Excellent problem-solving skills combined with a keen eye for detail in database design and shell scripting environments including Bash (Unix shell). Experience working within Agile teams to deliver iterative solutions aligned with business goals. Join us if you're eager to leverage your expertise in cloud computing, big data processing, and analytics to revolutionize how we harness information!

Pay:

$40.00 - $60.00 per hour

Work Location:

In person