Hadoop What it is and why it matters

D0740857

Susan Wu 吳采霏

June 25, 2020



Hadoop

What it is and why it matters

Website link: https://www.sas.com/en_us/insights/big-data/hadoop.html 

This article introduces “Hadoop.” It is an application that can deal with a lot of data and run the algorithm. Moreover, it makes businesses do the analysis effectively. There are mainly four usages in Hadoop. 

  • Low-cost storage and data archive 

As I know for big data nowadays, the combination of big data and cloud computing has been created. Therefore, it could reduce the cost of data storage and save the analysis in the cloud. In that case, I think it will be much easier for businesses to run the results and will not lose data. 

  • Data Lake

This is the first time that I heard of the data lake. Originally, I thought it was something like a data warehouse. However, it is more than that. The goal of data lakes is to provide some new and unrefined views of data for scientists to explore and do the research. But since the database could be enormous, how to secure and manage the data becomes much harder for the IT department. 

  • Sandbox for discovery and analysis

Sandbox has a security mechanism for processing data. In the processing, it offers a safe environment for data also any operating will not influence the algorithm. Besides, this tech is widely used in testing malware. Therefore, the sandbox helps Hadoop offer a saver place to do the analysis. 

  • Complement your data warehouse

A data warehouse is a system that pulls together data from many sources within an organization for reporting and analysis. The reports created from complex doubting within a data warehouse are used to make business decisions. 

In conclusion, Hadoop is a useful application that very suitable for business. It can run the algorithm and also secures the processing. 


Comments

Post a Comment

Popular posts from this blog

How Big Data Can Boost Weather Forecasting

張岳庭 D0741017 Source:  https://www.wired.com/insights/2013/02/how-big-data-can-boost-weather-forecasting/ Considering the number of variables involved and the complex interactions between these variables, weather forecasting has always been extremely challenging. The significant increase in data collection and processing capabilities has greatly improved the ability of weather forecasters to pinpoint the time and severity of hurricanes, floods, snowstorms and other weather events. Globally, more and more evidence of climate change is prompting governments and scientists to take action to protect people and property from its effects. But to take effective measures, they need to know more about the weather-from everything that will happen tomorrow to what will happen next year. According to the professor of economics and finance , Alan Anderson, PhD , “Example of an application of big data to weather forecasting is IBM’s Deep Thunder. Unlike many weather forecasting systems...
Read more

How Big Data is Changing the Production Industry

Blog#4 : How Big Data is Changing the Production Industry Name : Aileen 蔣慧玲 Student ID : D0726917 Source :   https://www.productionhub.com/blog/post/how-big-data-is-changing-the-production-industry Information technology plays a major role in Hollywood. Producers have to use big data analytics to get the right consumers and communicate with them well. Big data technologies will help filmmakers figure out the best ways to share their ideas and deliver messages, develop movies and content that involve ethical and societal issues. Therefore, information that we can get from the help of big data can help filmmakers make key decisions. Big Data is Changing the Production Game Big data technology can help filmmakers to connect and engage with consumers more directly using social media, mobile devices and traditional advertising outlets. Using this technology, producers can develop promotions that reaches the right consumer at the right time. It is not enough just to mainta...
Read more

Big Data case study: 5 relevant examples from the airline industry

D0740712 Connie  吳霈晴 Website: https://blog.datumize.com/5-relevant-examples-of-a-big-data-case-study-from-the-airline-industry With the summer vacation coming, travel is the one that people love to do during vacation, especially long vacation, going abroad may be the first choice for many travelers. So this makes me think of what is the relationship between big data and airplanes? How will it apply on the airline industry? This article tells about the benefits of big data on airlines, which covers three main advantages. 1.      Smarter maintenance 2.      Safer flights 3.      Improve service The first one includes the fuel of airplane, by analyzing and predicting, the article takes some specific airplane company as an example, giving the real number and how much they save the cost. Second, safety. Like this kind of transportation has a higher risk to take, if have the big data’s help, th...
Read more