Role : Hadoop Developer/Architech

Location : St. Louis,MO

Duration : 4 Months

Rate : $75/hr On C2C (Max)

Requirted Skills : 

5+ YEARS HANDS ON  HADOOP DEVELOPMENT. EXCELLENT COMMUNICATION SKILLS REQUIRED.

Job Description : 

Reference Implementation using Spring Batch Framework for following activities:

• Read file based upon a specific format
• Generate file based upon a specific format, type
• Parallel processing of incoming and outgoing files
• Job Scheduling
• Spring Batch clustering and availability (if master goes down, job picked up by slave… this feature is supported by Spring Batch)
• Admin Dashboard that comes with Spring Batch

Reference Implementation using Hadoop infrastructure for following activities:

• Map/Reduce jobs for processing files
• Exporting data from HDFS(NoSQL) that came as files
• Reading data from data sources like RDBMS(Postgres) and then aggregation of that based upon a certain criteria and then pushing data into another source
• Admin Dashboard implementation to view current jobs, configure map/reduce, etc.

Reference Implementation of Messaging using Apache Kafka for following activities:

· Publisher implementation to publish messages to a particular Topic (Kafka Topic)

· Subscriber/Multiple Subscribers implementation to read messages configured for a particular topic

· Guidance on key components like zookeeper and how it internally works and best practices on this

· Troubleshooting techniques to help with Operations

· Message Level Security (Encryption Decryption implementation will be provided by MasterCard)

Reference Implementation of Messaging using Apache Camel for following activities:

• Reading Writing ISO8583 Messages from IBM WebSphere MQ using Container less Apache Camel Framework
• Parsing the messages and then integrating with internal API (REST API implementation will be provided by Customer)
• Reference implementation for writing unit test and BDD (Behavior Driven) for AngularJS code using Jasmin/Karma/Selenium frameworks
• Code developed by CSA will have unit tests written using JUnit, able to execute success and failure cases.
• Knowledge transfer will occur as code is being developed and reviewed as part of the code review process.