Netscientium

Career Opportunities in Big Data

Career Opportunities in Big Data

Career opportunities – Data Scientist

Data Scientist

  • The [big] data scientist needs to be able to program
  • Python, R, Java, Ruby, Clojure, Matlab, Pig or SQL.
  • They need to have an understanding of Hadoop, Hive and/or MapReduce.
  • In addition the need to be familiar with disciplines such as:
  • Natural Language Processing: the interactions between computers and humans;
  • Machine learning: using computers to improve as well as develop algorithms;
  • Conceptual modeling: to be able to share and articulate modelling;
  • Statistical analysis: to understand and work around possible limitations in models;
  • Predictive modeling: most of the big data problems are towards being able to predict future outcomes

Career opportunities– Big Data Engineer

  •     Role – Big Data Engineer / BigData Development / Bigdata Architect

A software Engineer who is expert in Java / C / C++ => HADOOP (APIs, MR Coding, Ecosystem & Admin ) => HIVE/PIG/IMPALA/ML => OOZIE Plus Monitoring.

  •    Architect , Design & Develop Bigdata based software from scratch / Upgrade / Mainitain.

A software Engineer who is expert in ORACLE / PL/SQL/ MS SQL / TERRADATA / DATA WAREHOUSING => HADOOP (APIs, MR Coding, Ecosystem & Admin ) => HIVE/PIG/IMPALA/ML => OOZIE Plus Monitoring tools.

  •      Architect , Design & Develop Bigdata based data ware house

 

Career opportunities – Hadoop DBA

Role – Big Data DBA

  • Design and Development of Data modelling.
  • Hadoop ecsystem installation and configuration.
  • DR / Cluster to Clister – Database backup and recovery.
  • Database connectivity and security.
  • Performance monitoring and tuning ; Configuration based
  • Disk space management.
  • Software patches and upgrades for Unix as well as Hadoop

Career opportunities – Hadoop Administrator

                     Role – Big Data Admin

  • Good Linux and shell Scripting background
  • Good knowledge of Hadoop Ecosystem and technologies.
  • Understanding of Hadoop design principals and factors that affect distributed system performance, including hardware and network considerations.
  • Experience in providing Infrastructure Recommendations, Capacity Planning and develop utilities to monitor cluster better
  • Experience around managing large clusters with huge volumes of data
  • Experience with cluster maintenance tasks such as creation and removal of nodes, cluster monitoring and troubleshooting. Manage and review Hadoop log files.
  • Experience installing and implementing security for Hadoop clusters.
  • Installing Hadoop Updates, patches and version upgrades.

 

Career opportunities – Hadoop Operations

                  Bigdata – Production Support / Operations

  • Good Linux and shell Scripting background
  • Good knowledge of Hadoop Ecosystem and technologies.
  • Cluster maintenance
  • Job Management / Job failures / Investigation / Restart
  • Autosys / Oozie integration
  • Data analysis – Data recovery
  • Cluster to Cluster data movement
  • Escalations
  • Operations management.
August 13, 2015

0 Responses on Career Opportunities in Big Data"

2014 © Netscitus Corporation. All Rights Reserved.