Hadoop SysAdmin

ISM understands that companies face all the complexities associated with the implementation of a Hadoop ecosystem and in most cases may not find and employ the right talent to get the Hadoop cluster installed and configured, let alone manage the operations.

Hadoop’s capabilities are revealed as data volumes increase. Managing data and clusters at scale presents different challenges to those associated with running test data through a couple of machines. Again and again, organizational deployments of Hadoop fail as they simplistically try to replicate processes and procedures tested on one or two machines across more-complex clusters.

ISM’s System administrators are experts in the planning, installation and operations of Hadoop and provide the following services:

• Assess and audit the network, storage and monitoring requirements
• Provide a proposed Hadoop infrastructure architecture
• Install and configure a Hadoop cluster
• Configure the FairScheduler to provide service-level agreements for multiple users
• Deploy configuration management tools such as Puppet or Chef
• Provide the required scripting for maintaining the Hadoop Cluster
• Tune Linux, JVM and MySQL, including internals and core system services
• Monitor the Hadoop cluster with tools like Nagios or Zabbix
• Provide operational metrics