Data Engineer Remote - w2 itheroes inc Raleigh, NC Job Details Contract $50 - $55 an hour 17 hours ago Qualifications AI models Performance dashboard reports Commercial use (data warehousing systems) Systems integration Cloud analytics services Teamwork Data visualization software proficiency Data Integration (Data management) HDFS Predictive modeling analysis Distributed file systems ETL pipeline development Spark Dashboard creation Business intelligence report generation Apache Hive Scalable systems Machine learning projects Schema design Data Architecture Design (Architecture design skills) AWS Azure Data Lake Storage ETL process automation Implementing APIs Scalability Agile software development Model training Data analytics technologies Agile planning
Full Job Description Role :
Data Engineer Visa :
GC ,USC & H4 EAD , OPTS
only Contract W2 only !!! No Corp2Corp !!! Responsibilities Design, develop, and optimize scalable data pipelines using ETL (Extract, Transform, Load) processes to facilitate efficient data flow across systems. Build and maintain data warehouses and data lakes utilizing cloud platforms such as AWS and Azure Data Lake to support analytics and reporting needs. Collaborate with cross-functional teams to gather requirements and translate them into technical solutions using SQL, Python, Java, and Shell Scripting. Implement big data solutions leveraging Hadoop ecosystem components like Apache Hive, Spark, and Hadoop Distributed File System (HDFS) for processing large datasets. Develop RESTful APIs for seamless data integration between various applications and platforms. Conduct model training and analysis to support advanced analytics initiatives, ensuring data quality and integrity throughout the process. Design database schemas and optimize database performance in environments such as Microsoft SQL Server, Oracle, and other relational databases. Utilize tools like Talend, Informatica, or Looker for data integration, visualization, and reporting purposes within an Agile development framework. Maintain comprehensive documentation of data architecture, workflows, and processes to ensure transparency and reproducibility. Requirements Proven experience working with cloud platforms such as AWS or Azure Data Lake for scalable data storage solutions. Strong proficiency in SQL programming along with experience in database design for data warehouses or big data environments. Hands-on knowledge of big data technologies including Hadoop ecosystem components like Apache Hive, Spark, and HDFS. Skilled in programming languages such as Python or Java Experience with ETL tools like Talend or Informatica for efficient data integration workflows. Ability to develop RESTful APIs for system interoperability; experience with API management is advantageous. Familiarity with analytics tools like Looker for creating dashboards and reports that inform strategic decisions. Strong understanding of model training techniques and analysis skills to support predictive analytics initiatives. Knowledge of database management systems including Microsoft SQL Server, Oracle Database, or similar relational databases. Experience working within Agile teams following Scrum or Kanban methodologies to deliver iterative value. Excellent problem-solving skills with a keen eye for detail in database design and analysis tasks. Embark on this exciting journey where your technical expertise transforms raw data into actionable insights! We are committed to fostering an inclusive environment that values innovation, collaboration, and continuous growth—making every day an opportunity to learn and excel in the rapidly evolving world of data engineering. Shilpa DixitBench Sales Recruiter IT Heroes Inc Where Heroes are made