The software tool described is an open source utility for Hadoop.
Hamake is an excellent utility that is both free and open source. It allows users to automate incremental processing of datasets, which are stored on HDFS with the help of Hadoop tasks written in Java or using PigLatin scripts. The datasets could be individual files or directories with groups of files. Whenever new files are added or removed from an arbitrary location, the tool triggers recalculation of data depending on the dataset.
This tool is similar to a Unix utility called 'make.' Initially, users must formulate their processing model in terms of data locations, which could be used as inputs or outputs, as well as tasks. Presently, two types of jobs are supported, that include "map" and "reduce" (but they should not be confused with Hadoop "map" and "reduce").
MAP is a type of job in Hamake that maps a group of files at one location to another location. This task assuming one-to-one file mapping between locations and can process them incrementally by converting only files present at the source location but not at all destinations.
This tool is similar to a Unix utility called 'make.' Initially, users must formulate their processing model in terms of data locations, which could be used as inputs or outputs, as well as tasks. Presently, two types of jobs are supported, that include "map" and "reduce" (but they should not be confused with Hadoop "map" and "reduce").
MAP is a type of job in Hamake that maps a group of files at one location to another location. This task assuming one-to-one file mapping between locations and can process them incrementally by converting only files present at the source location but not at all destinations.
What's New
Version 1.3: N/A