| Consultant ID: | C25430 |
| Consultant Name: | Nitesht Pamulapati |
| Consultant Title: | Senior Big Data Developer |
| Total Experience: | 8+ Years |
| Primary Skills: | Hadoop 2.7.x/2.5.x/2.4.x/1.x.y, HDFS, MapReduce, Sqoop 1.4.x, Oozie, Pig 0.15/0.14/0.11, Hive 1.2.1/0.14/0.13/0.10, ZooKeeper, Impala, Hue, Flume, H |
| Education: | Bachelors |
| Domain Exposure: | IT/Software |
| Re-Location: | Open - anywhere USA |
| Availability: | Immediately |
| RDM Name: | Albert Jordan |
Waddell & Reed OCT 2015 - Till Date
Overland Park, KS
Hadoop Developer
Waddell & Reed is one of the most enduring asset management and financial planning firm in
the nation. At Waddell & Reed I was part of the DST(Mainframe) decommission project
involved in moving the data from the mainframes into HDFS. Following are the responsibilities
that I had done at Waddell & Reed.
Responsibilities:
Importing data from SQL server into HDFS using python based Sqoop framework.
Exporting data from HDFS into PostgreSQL using python based Hawq framework.
Developed java applications that parses the mainframe report and put into CSV Files
and another application will compare the data from SQL server and mainframe
report(.dat file) and generates a rip file .
Coordinated in all testing phases and worked closely with Performance testing team to
create a baseline for the new application.
Documented the technical design and also production support document.
Involved in creating workflow for the Tidal (Workflow coordinator for Waddell & Reed).
Created Hive external table with partitions and bucketing to load incremental data
coming from SQL server.
Developed Hive custom Java UDF’s for further transformations on data.
Done performance tuning in the hive at all point of phases.
Involved in modifying existing sqoop and Hawq frameworks
Request Resume