Data Engineer

Data Engineer vectorsoft - 3.4 Austin, TX Job Details Contract $55 - $65 an hour 18 hours ago Benefits Health savings account Relocation assistance Health insurance 401(k) Flexible spending account Tuition reimbursement Paid time off Employee assistance program Vision insurance 401(k) matching Employee discount Professional development assistance Life insurance Retirement plan Qualifications SQL databases Spark Java SQL Python Full Job Description Data engineer All visas Acceptable W2 Onsite Job Description Join our dynamic team as a Data Engineer and become a vital driver of our data-driven initiatives! In this role, you will design, develop, and maintain robust data pipelines and architectures that empower insightful analysis and strategic decision-making. You'll work with cutting-edge technologies and collaborate across teams to deliver scalable solutions that handle large volumes of complex data. Your expertise will help unlock the full potential of our data assets, fueling innovation and operational excellence. Duties Develop, implement, and optimize ETL (Extract, Transform, Load) processes to ensure seamless data flow from various sources into our data warehouse and data lake environments. Design and build scalable big data solutions using Hadoop, Spark, Apache Hive, and Azure Data Lake to support analytics and reporting needs. Manage cloud-based infrastructure on AWS and Azure, leveraging services such as Azure Data Lake and related tools for efficient data storage and processing. Collaborate with cross-functional teams to understand data requirements, translate them into technical specifications, and deliver high-quality solutions. Create and maintain database schemas using Microsoft SQL Server, Oracle, and other relational databases; ensure optimal database design for performance and scalability. Develop RESTful APIs for data access and integration with external systems; utilize scripting languages like Bash (Unix shell), Shell Scripting, Python, Java, and VBA for automation tasks. Support model training activities by preparing datasets, performing analysis with strong attention to detail, and ensuring data quality standards are met. Participate in Agile development cycles to continuously improve data pipelines, troubleshoot issues promptly, and implement best practices in data management. Utilize analytics tools such as Looker to create dashboards that provide actionable insights for stakeholders. Qualifications Proven experience as a Data Engineer or in a similar role with a strong understanding of database design principles. Proficiency in SQL programming (Microsoft SQL Server, Oracle) along with experience in Big Data technologies like Hadoop, Spark, Apache Hive. Hands-on experience with cloud platforms such as AWS (Amazon Web Services) and Azure (Azure Data Lake). Skilled in ETL tools including Informatica and Talend; familiar with RESTful API development for system integration. Strong programming skills in Python, Java, Bash (Unix shell), Shell Scripting; knowledge of VBA is a plus. Experience working with Data Warehouses and Data Lakes to support large-scale analytics projects. Familiarity with Looker or similar BI tools for creating interactive dashboards; understanding of analytics best practices. Knowledge of Linked Data concepts to facilitate semantic interoperability across datasets is advantageous. Ability to work within Agile methodologies to deliver iterative improvements efficiently. Excellent analysis skills combined with the ability to translate complex requirements into scalable technical solutions. Embark on this exciting journey where your expertise fuels innovation! We're committed to fostering an inclusive environment that supports your growth while making a tangible impact through transformative data solutions.

Pay:

$55.00 - $65.00 per hour

Benefits:

401(k) 401(k) matching Employee assistance program Employee discount Flexible spending account Health insurance Health savings account Life insurance Paid time off Professional development assistance Relocation assistance Retirement plan Tuition reimbursement Vision insurance

Location:

Austin, TX 78789 (Preferred) Shift availability: Day Shift (Preferred) Overnight Shift (Preferred) Night Shift (Preferred) Willingness to travel: 100% (Preferred)

Work Location:

In person