Knowledge of devising and deploying solution HDFS / Hadoop Common / MapReduce and Hive QL and Hive scripting.
Knowledge of Big Data Hadoop, SQL, HIVE, RDBMS (DB2, Teradata & SQL Server), GCP etc. Build Hadoop Data Lake and analytics applications meeting customer, IT and Business Stakeholder requirements and Apache Spark, spark streaming.
Designs and/or software development; experience working in a large global IT environment strongly preferred.
Knowledge of design and implementation of big data applications using Hadoop (MapReduce, Hive, Pig, Sqoop, NiFi, Spark and Spark Streaming, Kafka, Apache Druid, Oozie) and NoSQL technologies.
Knowledge of UNIX and Shell Scripting.
Knowledge of analyzing text, streams with emerging Hadoop-based big data.
Knowledge of creating technical design documents.
Job Duties
eGift Product Software Engineer work breakdown activity
Devising possible solutions to anticipated problems (20%)
Breaking down program specification into its simplest elements and translating this logic into a programming language (15%).
Establishing detailed program specifications (5%).
Combining all elements of the program design and testing it (10%).
Testing sample datasets to check that output from the program works as intended (5%).
Writing detailed documentation for the operation of the program by users (5%).
Conducting testing and installing the program into production (5%).
Reacting to problems and correcting the program as necessary (10%).
Clarifying which actions the program is intended to perform (5%).
Evaluating and increasing the program's effectiveness (20%).