{"id":3383,"date":"2013-07-17T10:49:34","date_gmt":"2013-07-17T03:49:34","guid":{"rendered":"http:\/\/science-technology.vn\/?p=3383"},"modified":"2013-10-31T10:12:40","modified_gmt":"2013-10-31T03:12:40","slug":"du-lieu-lon-va-khai-pha-du-lieu","status":"publish","type":"post","link":"https:\/\/science-technology.vn\/?p=3383","title":{"rendered":"D\u1eef li\u1ec7u l\u1edbn v\u00e0 khai ph\u00e1 d\u1eef li\u1ec7u"},"content":{"rendered":"

M\u1ed9t sinh vi\u00ean vi\u1ebft cho t\u00f4i: \u201cV\u1edbi em d\u01b0\u1eddng nh\u01b0 Big Data l\u00e0 c\u00e1i t\u00ean m\u1edbi cho Khai ph\u00e1 d\u1eef li\u1ec7u, ch\u1ec9 x\u1eed l\u00ed nhi\u1ec1u d\u1eef li\u1ec7u. Em c\u00f3 \u0111\u00fang kh\u00f4ng? Kh\u00e1c bi\u1ec7t l\u00e0 g\u00ec gi\u1eefa Big Data v\u00e0 khai ph\u00e1 d\u1eef li\u1ec7u? Xin th\u1ea7y gi\u1ea3i th\u00edch.\u201d<\/span><\/p>\n

 <\/p>\n

\u0110\u00e1p: C\u00f3 kh\u00e1c bi\u1ec7t gi\u1eefa d\u1eef li\u1ec7u l\u1edbn v\u00e0 khai ph\u00e1 d\u1eef li\u1ec7u. Nhi\u1ec1u ng\u01b0\u1eddi tin khai ph\u00e1 kh\u1ed1i l\u01b0\u1ee3ng d\u1eef li\u1ec7u l\u1edbn l\u00e0 Big Data v\u00e0 \u0111i\u1ec1u \u0111\u00f3 l\u00e0 KH\u00d4NG \u0111\u00fang. Ch\u00fang ta h\u00e3y b\u1eaft \u0111\u1ea7u v\u1edbi \u0111\u1ecbnh ngh\u0129a \u0111\u01a1n gi\u1ea3n v\u1ec1 Khai ph\u00e1 d\u1eef li\u1ec7u v\u00e0 D\u1eef li\u1ec7u l\u1edbn.<\/p>\n

Khai ph\u00e1 d\u1eef li\u1ec7u l\u00e0 qu\u00e1 tr\u00ecnh ph\u00e2n t\u00edch d\u1eef li\u1ec7u \u0111\u1ec3 nh\u1eadn di\u1ec7n m\u1ed1i t\u01b0\u01a1ng quan hay h\u00ecnh m\u1eabu trong nhi\u1ec1u ki\u1ec3u d\u1eef li\u1ec7u \u0110\u00c3 \u0110\u01af\u1ee2C L\u01afU trong c\u01a1 s\u1edf d\u1eef li\u1ec7u r\u1ed3i t\u00f3m t\u1eaft ch\u00fang th\u00e0nh th\u00f4ng tin h\u1eefu d\u1ee5ng. Ch\u1eb3ng h\u1ea1n, ng\u01b0\u1eddi ch\u1ee7 nh\u00ecn v\u00e0o kinh doanh c\u1ee7a c\u00f4ng ti m\u00ecnh; ng\u01b0\u1eddi \u0111\u00f3 c\u00f3 th\u1ec3 th\u1ea5y thu nh\u1eadp, chi ph\u00ed v\u00e0 l\u1ee3i nhu\u1eadn. Nh\u01b0ng v\u1edbi khai ph\u00e1 d\u1eef li\u1ec7u, ng\u01b0\u1eddi \u0111\u00f3 th\u1ea5y nhi\u1ec1u h\u01a1n. Ng\u01b0\u1eddi \u0111\u00f3 bi\u1ebft trong h\u00e0ng ngh\u00ecn s\u1ea3n ph\u1ea9m m\u00e0 ng\u01b0\u1eddi \u0111\u00f3 b\u00e1n, s\u1ea3n ph\u1ea9m n\u00e0o l\u00e0 b\u00e1n ch\u1ea1y nh\u1ea5t. Ng\u01b0\u1eddi \u0111\u00f3 c\u0169ng bi\u1ebft kh\u00e1ch h\u00e0ng n\u00e0o mu\u1ed1n mua, d\u1ef1a tr\u00ean h\u00ecnh m\u1eabu c\u1ee7a h\u1ecd v\u1ec1 mua s\u1eafm. D\u1ef1a tr\u00ean b\u00e1o c\u00e1o ph\u00e2n t\u00edch khai ph\u00e1 d\u1eef li\u1ec7u, ng\u01b0\u1eddi \u0111\u00f3 bi\u1ebft r\u1eb1ng n\u1ebfu ng\u01b0\u1eddi \u0111\u00f3 gi\u1ea3m gi\u00e1 xu\u1ed1ng 5% ng\u01b0\u1eddi \u0111\u00f3 c\u00f3 th\u1ec3 l\u00e0m t\u0103ng s\u1ed1 b\u00e1n l\u00ean 45% v\u00e0 c\u00f3 25% l\u1ee3i nhu\u1eadn th\u00eam h\u01a1n so v\u1edbi tr\u01b0\u1edbc. V\u1ec1 c\u0103n b\u1ea3n khai ph\u00e1 d\u1eef li\u1ec7u cho ph\u00e9p ng\u01b0\u1eddi ch\u1ee7 d\u00f9ng th\u00f4ng tin hi\u1ec7n c\u00f3 \u0111\u1ec3 l\u00e0m l\u1ed9 ra xu h\u01b0\u1edbng ph\u1ee5 th\u00eam m\u00e0 ng\u01b0\u1eddi \u0111\u00f3 c\u00f3 th\u1ec3 c\u00f3 \u01b0u th\u1ebf.<\/p>\n

Ng\u00e0y nay Khai ph\u00e1 d\u1eef li\u1ec7u \u0111\u01b0\u1ee3c d\u00f9ng r\u1ed9ng r\u00e3i trong c\u00e1c c\u00f4ng ti b\u00e1n l\u1ebb, t\u00e0i ch\u00ednh, truy\u1ec1n th\u00f4ng v\u00e0 ti\u1ebfp th\u1ecb. N\u00f3 cho ph\u00e9p h\u1ecd x\u00e1c \u0111\u1ecbnh m\u1ed1i t\u01b0\u01a1ng quan gi\u1eefa c\u00e1c y\u1ebfu t\u1ed1 “n\u1ed9i b\u1ed9” nh\u01b0 gi\u00e1, s\u1ea3n ph\u1ea9m, chi ph\u00ed v\u1edbi c\u00e1c y\u1ebfu t\u1ed1 “b\u00ean ngo\u00e0i” nh\u01b0 kh\u00e1ch h\u00e0ng, c\u1ea1nh tranh v\u00e0 xu h\u01b0\u1edbng kinh t\u1ebf. D\u1ef1a tr\u00ean th\u00f4ng tin ph\u1ee5 n\u00e0y, c\u00e1c c\u00f4ng ti c\u00f3 th\u1ec3 x\u00e1c \u0111\u1ecbnh t\u00e1c \u0111\u1ed9ng l\u00ean s\u1ed1 b\u00e1n c\u1ee7a h\u1ecd, th\u00f3i quen mua h\u00e0ng c\u1ee7a kh\u00e1ch h\u00e0ng, v\u00e0 l\u1ee3i nhu\u1eadn c\u00f4ng ti. V\u1edbi khai ph\u00e1 d\u1eef li\u1ec7u, ng\u01b0\u1eddi b\u00e1n l\u1ebb c\u00f3 th\u1ec3 d\u00f9ng b\u1ea3n ghi s\u1ed1 b\u00e1n c\u1ee7a vi\u1ec7c mua c\u1ee7a kh\u00e1ch h\u00e0ng \u0111\u1ec3 g\u1eedi qu\u1ea3ng c\u00e1o khuy\u1ebfn m\u1ea1i d\u1ef1a tr\u00ean l\u1ecbch s\u1eed mua b\u00e1n c\u00e1 nh\u00e2n. Ch\u1eb3ng h\u1ea1n, t\u00f4i bao gi\u1edd c\u0169ng mua s\u00e1ch t\u1ea1i Amazon.com cho n\u00ean h\u00e0ng tu\u1ea7n c\u00f4ng ti \u0111\u1ec1u g\u1eedi cho t\u00f4i m\u1ed9t danh s\u00e1ch c\u00e1c s\u00e1ch m\u1edbi, ph\u1ea7n l\u1edbn l\u00e0 s\u00e1ch m\u00e1y t\u00ednh \u0111\u1ec3 t\u00f4i mua. H\u1ecd kh\u00f4ng bao gi\u1edd g\u1eedi danh s\u00e1ch c\u00e1c s\u00e1ch l\u00e3ng m\u1ea1n, s\u00e1ch t\u00e0i ch\u00ednh hay s\u00e1ch ki\u1ebfn tr\u00fac b\u1edfi v\u00ec h\u1ecd bi\u1ebft r\u1eb1ng t\u00f4i th\u01b0\u1eddng mua s\u00e1ch k\u0129 thu\u1eadt. Ph\u1ea7n m\u1ec1m khai ph\u00e1 d\u1eef li\u1ec7u c\u1ee7a h\u1ecd \u0111\u00e3 bi\u1ebft th\u00f3i quen mua s\u00e1ch c\u1ee7a t\u00f4i.<\/p>\n

Tuy nhi\u00ean, v\u1edbi Khai ph\u00e1 d\u1eef li\u1ec7u m\u1ecdi d\u1eef li\u1ec7u ph\u1ea3i C\u00d3 C\u1ea4U TR\u00daC v\u00e0 \u0110\u01af\u1ee2C X\u00c1C \u0110\u1ecaNH tr\u01b0\u1edbc khi ch\u00fang c\u00f3 th\u1ec3 \u0111\u01b0\u1ee3c l\u01b0u trong c\u01a1 s\u1edf d\u1eef li\u1ec7u. C\u00e1c c\u00f4ng c\u1ee5 khai ph\u00e1 d\u1eef li\u1ec7u \u0111\u1eb7c bi\u1ec7t \u0111\u01b0\u1ee3c d\u00f9ng \u0111\u1ec3 thu th\u1eadp nh\u1eefng d\u1eef li\u1ec7u n\u00e0y t\u1eeb c\u01a1 s\u1edf d\u1eef li\u1ec7u, ph\u00e2n t\u00edch ch\u00fang \u0111\u1ec3 nh\u1eadn di\u1ec7n c\u00e1c h\u00ecnh m\u1eabu v\u00e0 ph\u00e1t sinh b\u00e1o c\u00e1o cho c\u1ea5p qu\u1ea3n l\u00ed. N\u00f3i c\u00e1ch kh\u00e1c, n\u1ebfu d\u1eef li\u1ec7u \u0111\u01b0\u1ee3c l\u01b0u trong c\u01a1 s\u1edf d\u1eef li\u1ec7u v\u00e0 \u0111\u01b0\u1ee3c c\u1ea5u tr\u00fac theo h\u00e0ng v\u00e0 c\u1ed9t, b\u1ea5t k\u1ec3 k\u00edch c\u1ee1 c\u1ee7a ch\u00fang l\u1edbn t\u1edbi \u0111\u00e2u, \u0111\u1ec1u l\u00e0 mi\u1ec1n c\u1ee7a Khai ph\u00e1 d\u1eef li\u1ec7u.<\/p>\n

Ng\u00e0y nay, c\u00f3 c\u00e1c ki\u1ec3u d\u1eef li\u1ec7u kh\u00e1c KH\u00d4NG \u0110\u01af\u1ee2C X\u00c1C \u0110\u1ecaNH V\u00c0 KH\u00d4NG C\u00d3 C\u1ea4U TR\u00daC v\u00e0 ch\u00fang \u1edf r\u1ea3i r\u00e1c kh\u1eafp n\u01a1i.<\/p>\n

Ch\u1eb3ng h\u1ea1n, d\u1eef li\u1ec7u t\u1eeb Internet, t\u1eeb h\u00e0ng tri\u1ec7u website v\u00e0 m\u1ea1ng x\u00e3 h\u1ed9i nh\u01b0 \u1ea3nh Facebook, \u0111\u1ed3 th\u1ecb th\u1ecb tr\u01b0\u1eddng ch\u1ee9ng kho\u00e1n, tin t\u1ee9c t\u1eeb Twitter, d\u1eef li\u1ec7u c\u00e1 nh\u00e2n t\u1eeb Linkedln, b\u1ea3n ghi s\u1ee9c kho\u1ebb \u0111i\u1ec7n t\u1eed t\u1eeb c\u00e1c b\u1ec7nh vi\u1ec7n, d\u1eef li\u1ec7u xu h\u01b0\u1edbng kinh t\u1ebf t\u1eeb c\u00e1c vi\u1ec7n nghi\u00ean c\u1ee9u, d\u1eef li\u1ec7u th\u1eddi ti\u1ebft, d\u1eef li\u1ec7n kinh doanh, emails, \u1ea3nh, video c\u00e1 nh\u00e2n, video t\u1eeb YouTube, phim v\u00e0 nh\u1ea1c t\u1ea3i xu\u1ed1ng v.v. Nh\u1eefng d\u1eef li\u1ec7u n\u00e0y KH\u00d4NG TH\u1ec2 \u0111\u01b0\u1ee3c thu t\u1eadp hay l\u01b0u gi\u1eef b\u1edfi c\u00e1c c\u00f4ng c\u1ee5 c\u01a1 s\u1edf d\u1eef li\u1ec7u \u0111i\u1ec3n h\u00ecnh. H\u01a1n th\u1ebf n\u1eefa, nh\u1eefng d\u1eef li\u1ec7u n\u00e0y thay \u0111\u1ed5i hay t\u0103ng l\u00ean v\u1ec1 k\u00edch th\u01b0\u1edbc m\u1ed9t c\u00e1ch nhanh ch\u00f3ng. Ch\u00fang th\u00eam m\u00e3i v\u00e0o, h\u00e0ng t\u1ec9 h\u00e0ng t\u1ec9, h\u00e0ng ngh\u00ecn t\u1ec9 h\u00e0ng ngh\u00ecn t\u1ec9 th\u1ee9 x\u1ea3y ra trong “th\u1ebf gi\u1edbi \u1ea3o.” Nh\u1eefng d\u1eef li\u1ec7u n\u00e0y c\u0169ng r\u1ea5t c\u00f3 gi\u00e1 tr\u1ecb \u0111\u1ec3 x\u00e1c \u0111\u1ecbnh h\u00ecnh m\u1eabu hay xu h\u01b0\u1edbng n\u1eefa. Khi b\u1ea1n t\u1ed5 h\u1ee3p kh\u1ed1i l\u01b0\u1ee3ng d\u1eef li\u1ec7u l\u1edbn, s\u1ef1 \u0111a d\u1ea1ng c\u1ee7a c\u00e1c ki\u1ec3u d\u1eef li\u1ec7u, v\u00e0 t\u1ed1c \u0111\u1ed9 ch\u00fang thay \u0111\u1ed5i th\u00ec b\u1ea1n \u0111ang gi\u1ea3i quy\u1ebft v\u1edbi mi\u1ec1n c\u1ee7a Big Data.<\/p>\n

Big Data \u0111\u00e3 v\u01b0\u1ee3t qu\u00e1 c\u00e1c quan ni\u1ec7m c\u01a1 s\u1edf d\u1eef li\u1ec7u truy\u1ec1n th\u1ed1ng. Qui m\u00f4 l\u1edbn c\u1ee7a ch\u00fang v\u1ec1 c\u00e1c h\u00ecnh m\u1eabu v\u00e0 xu h\u01b0\u1edbng c\u0169ng kh\u00f3 \u0111\u01b0\u1ee3c th\u1ea5y. M\u1ed1i quan h\u1ec7 c\u1ee7a ch\u00fang trong m\u1ecdi ki\u1ec3u d\u1eef li\u1ec7u kh\u00e1c nhau l\u00e0 qu\u00e1 ph\u1ee9c t\u1ea1p \u0111\u1ec3 \u0111\u01b0\u1ee3c quan s\u00e1t. V\u00c0 ch\u00fang li\u00ean t\u1ee5c thay \u0111\u1ed5i v\u1edbi t\u1ed1c \u0111\u1ed9 c\u1ee7a internet cho n\u00ean kh\u00f3 nh\u1eadn di\u1ec7n d\u1eef li\u1ec7u n\u00e0y \u0111\u1ec3 l\u1ed9 ra c\u00e1i g\u00ec. V\u1ec1 c\u0103n b\u1ea3n, c\u00e1c quan ni\u1ec7m v\u00e0 c\u00f4ng c\u1ee5 c\u1ee7a c\u01a1 s\u1edf d\u1eef li\u1ec7u v\u00e0 khai ph\u00e1 d\u1eef li\u1ec7u hi\u1ec7n th\u1eddi KH\u00d4NG c\u00f3 t\u00e1c d\u1ee5ng n\u1eefa. \u0110\u00f3 l\u00e0 l\u00ed do t\u1ea1i sao n\u00f3 c\u1ea7n c\u00e1c quan ni\u1ec7m m\u1edbi, c\u00f4ng c\u1ee5 m\u1edbi, thu\u1eadt to\u00e1n m\u1edbi v\u00e0 \u0111\u00f3 l\u00e0 l\u00ed do t\u1ea1i sao Bid Data l\u00e0 th\u1ee9 m\u1edbi ng\u00e0y nay.<\/p>\n

 <\/p>\n

—English version—<\/p>\n

 <\/p>\n

Big Data and Data Mining<\/p>\n

A student wrote to me: \u201cIt seems to me that Big Data is a new name for Data Mining, just process more data. Am I correct? What is the difference between Big Data and Data Mining? Please explain.\u201d<\/p>\n

 <\/p>\n

Answer: There is a difference between Big Data and Data Mining. Many people believe by mining a massive amount of data is Big Data and it is NOT correct. Let\u2019s start with the simple definition of Data Mining and Big Data.<\/p>\n

Data Mining is the process of analyzing data to identify correlations or patterns among several types of data STORED in a database then summarize them into useful information. For example, an owner looks at his company business; he may see revenue, costs and profits. But with data mining, he sees much more. He knows among thousands of product that he sells, which products are best sellers. He also knows what customers want, based on their pattern of purchasing. Based on the data mining analytic report, he knows that if he reduces the price by 5% he could increases the sale by 45% and have a 25% more profit than before. Basically data mining allows the owner to use existing information to reveal additional trends that he could take advantage of.<\/p>\n

Today Data Mining is widely used in retail, financial, communication, and marketing companies. It allows them to determine correlations among “internal” factors such as price, products, costs, with “external” factors such as customers, competition, and economic trends. Based on this additional information, companies can determine the impact on their sales, customer buying habit, and corporate profits. With Data mining, a retailer could use sale records of customer purchases to send advertising promotions based on an individual’s purchase history. For example, I always buy books at Amazon.com so each week the company sends me a list of new books, mostly computer books for me to purchase. They never send the list of romantic books, fictional books or architecture books because they know that often buy technology books. Their Data mining software already know my books buying habit.<\/p>\n

However, with Data Mining all data must be STRUCTURED and DEFINED before they can be stored in the database. Special Data Mining tools are used to collect these data from the database, analyze them to identify patterns and generate reports to management. In other word, if the data is stored in a database and being structured in rows and columns, regardless how big are their size, it is the domain of Data Mining.<\/p>\n

Today, there are other types of data that are NOT DEFINED NOT STRUCTURED and they scattered all over the place.<\/p>\n

For example, data from the Internet, from millions of websites and social networks such as Facebook photos, stock market graphics, tweets from Twitter, personal data from Linkedln, electronic medical records from hospitals, economic trends data from research institutes, weather data, business data, emails, personal pictures, videos from YouTube, downloaded movies and music etc. These data CANNOT be collected or stored by typical database tools. More than that, each minute, these data changes or increases in size quickly. They add up, billion upon billion, trillion upon trillion of things happen in the \u201cvirtual world\u201d. These data are also very valuable to determine patterns or trends too. When you combine the massive volume of data, the variety of types of data, and the speed that they change than you are dealing with the domain of Big Data.<\/p>\n

Big Data has exceeded the traditional database concepts. Their large scale of patterns and trends are so difficult to be seen. Their relationships among all types of different data are too complex to be observed. AND they keep changing at the speed of the internet so it is hard to identify what the data reveals. Basically, the concept and tools of current database and data mining will NOT work anymore. That is why it needs new concept, new tools, new algorithms and that is why Bid Data is the new thing today.<\/p>\n","protected":false},"excerpt":{"rendered":"

M\u1ed9t sinh vi\u00ean vi\u1ebft cho t\u00f4i: \u201cV\u1edbi em d\u01b0\u1eddng nh\u01b0 Big Data l\u00e0 c\u00e1i t\u00ean m\u1edbi cho Khai ph\u00e1 d\u1eef li\u1ec7u, ch\u1ec9 x\u1eed l\u00ed nhi\u1ec1u … <\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[30,36,26],"tags":[],"class_list":["post-3383","post","type-post","status-publish","format-standard","hentry","category-hoi-va-dap","category-social-media-mobility-big-data-analytics-and-cloud-computing","category-xu-huong-cong-nghe"],"_links":{"self":[{"href":"https:\/\/science-technology.vn\/index.php?rest_route=\/wp\/v2\/posts\/3383","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/science-technology.vn\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/science-technology.vn\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/science-technology.vn\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/science-technology.vn\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=3383"}],"version-history":[{"count":3,"href":"https:\/\/science-technology.vn\/index.php?rest_route=\/wp\/v2\/posts\/3383\/revisions"}],"predecessor-version":[{"id":3385,"href":"https:\/\/science-technology.vn\/index.php?rest_route=\/wp\/v2\/posts\/3383\/revisions\/3385"}],"wp:attachment":[{"href":"https:\/\/science-technology.vn\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=3383"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/science-technology.vn\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=3383"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/science-technology.vn\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=3383"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}