This job was posted by https://illinoisjoblink.illinois.gov : For more information, please see: https://illinoisjoblink.illinois.gov/jobs/13769499 Develop data ingestion processes for structured, semi-structured, and unstructured data in Hadoop environments. Create Hive scripts, Hive UDFs, partitioned tables, and MapReduce programs to process and analyze large datasets in HDFS. Build real-time data pipelines and streaming solutions using Kafka Connect, Spark Streaming, Spark SQL, Data Frames, and Datasets. Configure Flume agents, Sqoop imports/exports, and Oozie workflows to support data integration and workflow automation.

Skills:

Hadoop, Hive, HDFS, Spark, Spark SQL, Kafka, Sqoop, Flume, Oozie, MapReduce, HBase.

Benefits:

Health insurance, retirement plans, paid time off, and sick leave. Requires bachelors degree/any foreign equivalent degree in the Computer Science/Commerce/Data Analytics/ Engineering(any), C.I.S. or equivalent, plus 5 years of progressively responsible experience. The employee\'s relocation is contingent on client needs. The frequency of the relocation as well is unknown, and it purely depends on the client\'s requirements. There is no National or International Travel involved for this position.