What is big data hadoop ?

I'm going to talk about be data this is the next big thing in computing  and generates value from very large datasets but cannot be analyzed with traditional computing techniques  the quantity of computer data generated on planet Earth is growing exponentially for many reasons first start retailers a building vast databases ok recorded customer activity organizations working in the just sticks financial services health care and many other sectors also capturing more data and public social media is creating vast quantities of digital material as vision recognition improves it is additionally starting to become possible the computers to extract meaningful information from still images and video a small smart objects go online big data is also being generated by an expanding internet at things and finally several areas of scientific advancement starting to generate a mole on my own vast quantities of data the well until recently almost unimaginable dictator is often characterized using the 3v East volume the law City and the atty here volume Posey's pose the greatest challenge and the greatest opportunity as big data could help many organizations to understand people better and allocate resources more effectively however traditional computing solutions might relational databases on knot's capable to handle dates with this magnitude Big Data velocity also raises a number of issues with the rate at which stage was flowing into many organizations now exceeding the capacity up their IT systems in addition users increasingly demand data with his stream to them in real time and delivering this can prove quite a challenge finally the variety of data types to be processed is becoming increasingly diverse gone are the days when data centers only have to deal with documents financial transactions stock records and personnel files today photographs audio video 3d models complex simulations and location data are being piled into many a corporate data silent many such big data sources also unstructured and hence not easy to categorize let alone process with traditional computing techniques I'm due to the challenge is a volume velocity and variety many organizations have president had little choice but to ignore or rapidly excreted large quantities a potentially valuable information I'll indeed if we sing to organizations as creatures to protest data than most well as a primitive forms at life their senses nighty systems are simply not up to the job scanning in interpreting the vast oceans have data in which they swell as a consequence most to the data that surrounds organizations today is it Nored a large proportion of the data but they gather is that not processed with a significant quantity of useful information passing straight through them as day to exhaust I'm for example until recently the Joshi the data captured by we tailor loyalty cards was not processed in anyway and almost all video data captured by hospitals during surgery he still deleted within weeks today the leading Big Data technology he's had to poop this is an open source software likely for reliable scalable distributed computing and provides the first viable platform the big data analytics Hadoop is already used by most big data pioneers for example LinkedIn Cody uses it to generate over $100 billion personalized recommendations every week I'm Hadoop distributed to storage in processing have large datasets across groups or clusters of so the computers I'm whereas traditional large-scale computing solutions will on expensive so the hardware with a high fault tolerance Hadoop detection compensates the hardware failures or the system problems at the application-level I'm this allows a high level of service continuity to be delivered by clusters have individual computers each of which may be prone to failure when technically Hadoop consists of two key components the first is the Hadoop distributed file system which commits high-bandwidth close to base storage the second is a data processing framework called map produce based on Google search technology map which use distribute all maps lost a two-set across multiple servers each other then traces summary up today to its been allocated all this summer information used in aggregated in this so terms we do stage Matt would use subsequently allowed was extremely large role datasets to be rapidly distilled before more traditional data analysis tools are applied through organizations who cannot afford an internal big day to infrastructure cloud-based Big Data solutions already available where public big data sets need to be utilized running everything in the cloud also makes a lot of sense as data does not have to be downloaded for example Amazon Web Services already hosts many public datasets containing government and medical information looking further ahead quantum computing may greatly improvedbig data processing quantum computers stolen process data using quantum mechanical States I will in theory Excel a massively parallel processing unstructured data as IBM explain big data provides an opportunity to find insight in new and emerging types of data always a local put it big data holds the promise have getting into prices deeper insight internet customers partners and business in time big data may also help farmers to accurately forecast bad weather and crop failures meanwhile governments may use big data to predict and plan to civil unrest or pandemics in a recent report the McKinsey Global Institute estimated that the US healthcare sensual loan to Chief three hundred billion dollars inefficiency in coltie savings every year by leveraging big data across Europe they also estimate that using big data could save at least $249 billion in government administration costs in March 2012 the US government announced a $200 million dollar investment in Big Data projectsby the end of 15 Cisco estimate that global Internet traffic which 4.8 set up by TSE year that's 4.8 billion terabytes indicates both the big day to challenge and the big day to opportunity ahead more information on go to http://techstack.in