Posts

Showing posts from October, 2016

Word count program using hive query

Image
We have already done the setup of hive in our local machine with the help of my previous article, hive installation and now time to start with the hello world implementation of hadoop in hive, which is also known as word count in hive :) In this post, I am going to show you an example of word count program using hive, although we have already done the same using map reduce program here at word count in map reduce tutorial . Word count program using hive Input sample data: This is my first hive tutorial, which is known as hello world program in big data , big data technologies are now on demand. Expected Output: To achieve the above one, I am going to give you a very short and simple query unlike many lines of code while doing with map reduce :) Instead of directly executing the complete query, I'm breaking them in a step by step, so that it will help easy to read as well as easy understand, of course at the end you will find a complete query to full fill your nee...

Scala Tutorial | Scala Vs Java

Image
Scala is getting much and more popular, and become one of the favourite alternative of Java that's the reason why Scala grown exponentially. Scala syntax is very much similar to Java, and the best is that Scala runs on JVM(Java Virtual Machine), that means Scala is fully compatible with Java syntax, one can easily mix both code Scala and Java on same class.We have already seen an overview of Scala in my previous article . After compiling the Scala code, it will generate the .class file similar to Java, which makes it write once run anywhere compatible, even you will get all the objects/method of java.lang package by default into Scala code. Although Scala is very much similar to Java, but still has some major differences, which caused the invention of Scala, and those are listed below. Differences between Scala and Java 1. Scala is pure object oriented with fully support of functional programming The first and major difference between Scala and Java is that, Scala is pure ...

What is MapReduce in Hadoop

Image
Big data technologies are getting much and more popular and very demanding, we have already seen what is big data in my previous post and the fundamentals to process those big data you need Hadoop and MapReduce, here is a detail description about what is Hadoop and in this post, I am going to explain you what is MapReduce with a very popular word count program example. For complete Hadoop MapReduce tutorial you may follow this Hadoop MapReduce Tutorial What is MapReduce?? MapReduce is a programming model for processing the big data into a distributed fashion(parallel processing) with the help of commodity hardware on large cluster of computer, in a very reliable and fault tolerant manner. MapReduce works on two different phases by breaking the job into map task and reduce task, each task works on a key value pattern and both takes key-value pair as an input and produce the key-value pair as an output. Output of Map task become an input for the Reduce task, although the type ...