In last post we discussed Sqoop concepts and demos on how to move data from RDBMS to HDFS and from HDFS back to RDBMS. Today we will extend the data movement from RDBMS to NoSQL database — HBase and Hadoop Data warehouse Hive. Sqoop import command can be used to…

Today we are going to discuss a very efficient tool — Apache Sqoop. The heading itself tells you the meaning and purpose of tool which is SQL to Hadoop. We will first build some concepts and then have some demos that would help us understand these concepts better. Alright! Let’s…

Today I want to discuss with you all a great feature that is available with SQL Server which is ‘scan for startup procs’. It’s an advanced configuration within SQL server and enables SQL server to scan for any procedures marked as start-up procs and run them. What makes it so great? You all must be…

Few weeks back we had used flume to download tweets from twitter on the topic that we wanted (I had used BigData world keywords). Today, we will level up and analyze the tweets and determine sentiments of tweets. We can do our own analysis on what is trending in the…

In this post, we will integrate Flume and Spark Streaming. We will use Spark Streaming to process data that we will get from Flume. Flume will be our source for streaming data. Flume is considered to be to most suitable to have source from log files. We will get log…

In this blog, we are going to process streaming data but will use popular and efficient Spark Streaming for getting data from source and processing it. Streaming data from HDFS and processing to get word count for files We will look upon a simple example on Streaming Data from an HDFS folder/location on your Hadoop cluster to Spark where we will perform…

Data & BigData – databare.com What is Data? In our digital world, Data is defined as facts or figures, or information that’s stored in or used by a computer. In a digital sense, anything and everything that we have in our computer, over the internet, within storage devices everything is…