| Consultant ID: | C25431 |
| Consultant Name: | Mahankali suresh |
| Consultant Title: | Hadoop Administration |
| Total Experience: | 9+ Years |
| Primary Skills: | Windows, UNIX, Linux Programming Languages : C, Core Java Scripting Languages : Java Script, Shell script, python Data bases : Oracle, SQL, HQL ET |
| Education: | Bachelors |
| Domain Exposure: | IT/Software |
| Re-Location: | Open - anywhere USA |
| Availability: | Immediately |
| RDM Name: | Albert Jordan |
Work Experience:
Senior Hadoop Admin - Treasury Data Integrator
JPMC, Tampa, FL, USA – June 2012 to till date
Roles and Responsibilities:
Installed and configured Hadoop MapReduce, HDFS, Developed multiple
MapReduce jobs in java for data cleaning and preprocessing.
Worked on Installing and configuring the HDP Horton works 2.x and Cloudera
(CDH 5.5.1) Clusters in Dev and Production Environments
Worked on Capacity planning for the Production Cluster.
Installed HUE Browser.
Involved in loading data from UNIX file system to HDFS.
Involved in creating Hive tables, loading with data and writing hive queries which
will run internally in map reduce way.
Worked on Installation of HORTONWORKS 2.1 in AZURE Linux Servers.
Worked on Configuring Oozie Jobs.
Worked on Configuring High Availability for Name Node in HDP 2.1.
Worked on Configuring Kerberos Authentication in the cluster.
Worked on cluster upgradation in Hadoop from HDP 2.1 to HDP 2.3.
Worked on Configuring queues in capacity scheduler.
Worked on installing and configuring Solr 5.2.1 in Hadoop cluster.
Worked on taking Snapshot backups for Hbase tables.
Worked on fixing the cluster issues.
Involved in Cluster Monitoring backup, restore and troubleshooting activities.
Responsible for implementation and ongoing administration of Hadoop infrastructure
Managed and reviewed Hadoop log files.
Importing and exporting data from different databases like MySQL, RDBMS into HDFS
and HBASE using Sqoop.
Worked on indexing the Hbase tables using Solr and indexing the Json data and Nested
data.
Worked on installation and configuring the Spark and Impala.
Worked on configuring Queues in Capacity scheduler.
Worked on configuring queues in Oozie scheduler.
Worked on Performance Optimization for the Hive queries.
Worked on Performance tuning in the Cluster level.
Worked on adding the Users in the clusters.
Responsible for Cluster maintenance, Monitoring, commissioning and decommissioning
Data nodes, Troubleshooting, Manage and review data backups, Manage & review log
files.
Day to day responsibilities includes solving developer issues, deployments moving code
from one environment to other environment, providing access to new users and
providing instant solutions to reduce the impact and documenting the same and
preventing future issues.
Adding/installation of new components and removal of them through Ambari.
Collaborating with application teams to install operating system and Hadoop updates,
patches, version upgrades.
Monitored workload, job performance and capacity planning
Involved in Analyzing system failures, identifying root causes, and recommended course
of actions.
Creating and deploying a corresponding Solr Cloud collection.
Creating collections and configurations, Register a Lily Hbase Indexer configuration with
the Lily Hbase Indexer Service.
Creating and managing the Cron jobs.
Environment: Hadoop, MapReduce, Yarn, Hive, HDFS, PIG, Sqoop, Solr, Oozie,
Request Resume