Hadoop Developer

**Responsibilities**:Create and optimize data pipelines in OOZIE Framework.Handle structured and unstructured/semi-structured data (flat file, JSON, XML, binary files).Source data from RDBMS (Oracle, DB2, MySQL, etc.) to data lake.Build Artifacts and deploy using CICD pipeline.Work with Spark Architecture including Spark Core, Spark SQL, Data Frames, Spark Streaming.Demonstrate in-depth knowledge of Hadoop Architecture frameworks and various components such as HDFS, Hive, IMPALA, SQL, Sqoop, Python Scripting, Spark, UDF (User Defined Functions) development, and map Reduce concepts.Possess strong communication, interpersonal, and organizational skills.Preferred Skills/Requirements:Ability to analyze large volumes of data, optimize, and perform tuning.Good experience in generating statistics/extracts/reports from Hadoop.Knowledge of Bigdata platforms in the cloud (Azure), ADLS, and distributed computing.Experience in SQL Scikit-learn, Spark, and Hive for Data Analysis and Model building.Strong experience in Core Java is preferred.Knowledge in Kafka/MQ.A good understanding of NoSQL Databases like HBASE is a plus.Familiarity with Agile methodology.Knowledge of ELT tools like Syncsort DMX-h or equivalent.- People in Corporate Functions make DXC a well-run and high-functioning organization. Each team contributes to DXC's success and each individual delivers world-class service and has opportunities to grow and learn._