Posts

Showing posts from October, 2016

Components of Big Data - Hadoop System

Image
In this blog i will explain important components which are part of Hadoop System. I will give very brief overview of these components. Below diagram shows very high level components in Hadoop system. Master Node (MN) Name Node (NN) It is a daemon process runs on Master Node. Takes care of reading the data file to be analyzed. Splits the data file based on block size configured, default is 64MB and 128 MB. Distributes the split data file across multiple Data Node. Maintains the index file to keep track of where the data has been distributed. Think this as "Table of Content" in a book. It provides input to Job Tracker for location of the data files in Data Node. This is one part of HDFS system in Hadoop. Job Tracker (JT) Job tracker is also a daemon process. This is part of Processing Engine of Hadoop system. It is responsible for running the program which will analyze the data and produce results. Job Tracker communicates with NN to identify the location of the the data file. ...

Load Testing of Rest Webservice Using SOAP UI

Image
SOAP UI provides easy integration with different web services like SOAP and REST along with feature of Load Testing. Below I will show how to setup SOAP UI for doing load testing. To start with you need to have SOAP UI installed in the system. In the example I will consume REST webservice. Web Service end point is http://localhost:9081/UserService/users Lets start with the load testing setup now. Start SOAP UI tool and setup the REST webservice call and do a round of testing to ensure that tool is able to connect to the service and is able to get the response. Following screens shows the same. Setup REST Project Create New Project Right click on the Project and click on create REST Project. After providing the URL in above alert box, You will get below windows where you can see the various options like Method Endpoint Resource Input parameter Once you provide all the necessary configuration required for your webservice do test and once you see the expected response in the output window...