Hadoop Developer in San Antonio, TX at Consultis

Date Posted: 1/30/2018

Job Snapshot

Job Description

Sr. Hadoop Developer - (00007885)


Summary Description: This position designs, develops and implements Big Data analytic solutions on a Hadoop–based platform. Creates custom analytic and data mining algorithms to help extract knowledge and meaning from vast stores of data. Refines a data processing pipeline focused on unstructured and semi-structured data refinement. Configures, administers and supports the Big Data/BigInsights environment and longer duration analytic capability implementations.

Responsibilities: 

  • Configures, administers and supports the Hadoop/Big Data/BigInsights environment using Ambari.
  • Maintains security and data privacy in HDFS environment.
  • Manages and deploys HBase.
  • Gathers and processes raw data at scale (including writing scripts, web scraping, calling API’s, write SQL queries, etc.).
  • Processes unstructured data into a form suitable for analysis and then analyze the results against established criteria.
  • Loads from disparate data sets into Hadoop using tools such as Flume and Sqoop.
  • Translates complex functional and technical requirements into detailed design.
  • Performs analysis of vast data stores and uncover insights using components from the Hadoop system.
  • Performs high-speed querying.
  • Collaborates with other teams to design and develop data tools that support business initiatives.
  • Works closely with the engineering team to integrate models and algorithms into the production system.
  • Writes scalable and high performance code/algorithms in Hadoop environment using various tools
  • Assumes additional responsibilities as assigned

Qualifications

Education:

  • Bachelor’s degree or any equivalent combination of education and experience.

Experience:

  • 3 -5 years’ experience in Hadoop development and implementation
  • Advanced experience with Linux/Unix system administration & shell scripting including Cron jobs
  • Experience in pre-processing using R, MapReduce, Hive and Pig
  • Hands-on experience in ETL technologies preferably IBM DataStage
  • Experience in Analytical tools like IBM BigInsights (BigSheets/Text Analytics & BigSQL) and Apache Spark, preferred
  • Experience in Java, python, SPSS, DashDB, Streams, JAQL, AQ, Cognos or Microstartegy, preferred
  • Hands on experience in HiveQL

Knowledge, Skills, and Abilities: 

  • Proficiency in MS Office Word, Excel, Outlook, Power Point and Visio (as applicable)
  • Proficiency in JD Edwards (as applicable)
  • Knowledge in scheduling tools, including but not limited to Active Batch, Control
  • Knowledge of database structures, theories, principles, and practices for different platforms Netezza, SQL server, etc.
  • Intermediate knowledge of database structures, theories, principles, and practices for different platforms such as Netezza, SQL server, etc.
  • Ability to translate complex findings and ideas into plain language
  • Strong interpersonal, oral and written communication and presentation skills
  • Ability to establish and maintain an effective working relationships with management, vendors, and co-workers
  • Ability to work in a team environment
  • Advanced professional or theoretical knowledge and fundamental concepts, practices and procedures of a particular field of specialization in the execution of assigned duties and responsibilities
  • Basic understanding of budgetary concepts and procedures
  • Advanced understanding of departmental structure and policies with intermediate understanding of the cross-functional structure and policies of Whataburger Restaurants LLC
  • Advanced ability to delegate tasks and get work done through others.
  • Ability to prepare and present information to guests, more senior associates, vendors and management with sufficient notice and preparation

Professional Certification:

  • Certification in Hadoop (Big Data) Development is a plus

CHECK OUT OUR SIMILAR JOBS

  1. Software Engineer Jobs
  2. Project Engineer Jobs