Big Data Engineer / Spark Developers needed Fortune 100 client located in Manhattan, New York. This is a multi-year long contract and everyone hired must work on site (zip code is 10020). There are multiple spots open on the team and Corp to Corp candidates are welcome to apply. Due to the fact that there are multiple spots open on the team the client has left the rate open.Must be Spark Certified and strong in SQL, Data Structures and Algorithms along with SPARK.Job Description:Specific responsibilities include: * 1-2 years of SPARK Streaming experience with Scala/ Python and JAVA in real time production exp.

• Develop and maintain our Big Data pipeline that transfers and processes several terabytes of data using Apache Spark, Python, Apache Kafka, Hive & Impala.
• Design and build reports and dashboards using Tableau or other reporting tools
• Perform adhoc data analysis, data processing, data visualization using SQL and other scripts
• Work directly with product stake holders at the company to help them solve their most difficult problems.

Required Skills:* Excellent Programming skills using Python, Scala, Perl, Shell, etc.* Familiarity with SQL and NoSQL technologies. * Experience with Production Hadoop ecosystem.

• Proficiency with relational databases and SQL.
• Experience with Tableau or other reporting tools.
• Well versed in software development principles and processes, including: analysis, design, and continuous delivery.
• Good communication skills that can deal with diverse types of people from Data Science, Marketing, Finance, Product Management and QA groups

. Client is open to candidates who do not live in the immediate area.