A Data Engineer designs, builds and manages the information or big data infrastructure. Develops the architecture that helps analyze and process data in the way the organization needs it. Makes sure those systems are performing smoothly.
The Data Engineer is responsible for development and support of data products on a modern cloud-based data lake, leveraging expertise and knowledge of multiple technologies & data domains to help build a robust, scalable, and reliable data engineering platform. Additionally, a Data Engineer is responsible for providing data services for enterprise-grade analytical environments, utilizing automated data pipelines at scale, and streamlining efficient data transformations for priority use cases. This role can be involved hands on in development of the codebase and partners with business units and peer technology groups to support analytics execution.
ESSENTIAL DUTIES AND RESPONSIBILITIES
Partner across the organization to architect, implement, deploy, and maintain data-driven systems solutions Build, maintain and simplify enterprise data pipelines with emphasis on security, reusability & data quality. Perform debugging and fixing application issues, root cause analysis, and help in proactive/preventive maintenance. Help in technical debt reduction and follow clean code principles Development experience in one or more languages (e.g. Python, SQL, PySpark) Experience in the use of Infrastructure as Code tools (Databricks Asset Bundled,Terraform) Engagement in data governance council to define, develop, and review standards, guidelines, and data models to promote data quality and best practices Leverage DevOps tools to automate deployment and validation/test automation of data engineering pipelines. Writes and executes complete testing plans, protocols, and documentation for assigned portion of data system or component; identifies defects and creates solutions for issues with code and integration into data system architecture. Effectively plan and collaborate with technical and non-technical teams on business initiatives
QUALIFICATIONS
To perform this job successfully, an individual must be able to perform each essential duty mentioned satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required: Technical knowledge of BI systems design Big data architecture and technology landscape ETL orchestrations Strong communications skills Comfort working in a fast-paced, multi-task environment
EDUCATION AND EXPERIENCE
Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or an equivalent combination of education and relevant experience. Demonstrated understanding of core technology disciplines, including but not limited to software development, database administration, systems architecture, cloud technologies, infrastructure, and related technical domains. 1-2 years of relevant experience in data engineering, data analytics, software development, database administration, or a related technical field. Auto req
ID 222116BR
Store Number/Dept Number 299900061000 - IT - Infrastructure Store Address 200 E Peach St Store Zip 71730
