Nowadays, big data is not new to us. Some of us use big data almost everyday, but how to  extract web data that is high-volume in a short time? we will talk something about it.

“Advances in data gathering, computing power and connectivity mean that we have more information than ever before at our fingertips. IBM estimates that by 2020 there will be 300 times more information in the world than there…

By Kevin Sonsky, Senior Director, Business Intelligence at Citrix Systems.  

If there is a gap, something will fill it.

I’ve always liked the “plumbing” analogy often used in Data and BI circles.  You know the one.  You’ve got the main “pipe” line coming from the city water system which can represent all of your enterprise data.  And then you’ve got the water pipes for the house branching out from the main line and going into each individual room or wing of the house…

To appreciate what it takes to get the most out of Big Data let’s look at what Big Data is and “information density”. Information density is the amount of valuable information per byte of data.

What is Big Data?

Big data is typically data from sources that are collecting interactions of people or…

Gartner indicated that by 2017, 33% of the largest global companies will experience an information crisis due to their inability to adequately value, govern and trust their enterprise information. In addition, data quality impacts business driven initiatives by only achieving 40% of the anticipated business value from projects and impacts labor productivity by 20%. To address information quality, usage, and maximize the…

Data analytics in healthcare should be easier.  We will never find the cure to cancer if everyone who has a data question has to call IT to request help obtaining and interpreting data.

I often wonder if I should admit that I have worked with data in the healthcare industry for 26 years.  I have dedicated most of my career to transforming raw data into valuable…

With increasingly complexity and challenges of Big Data systems,  governance is a critical foundation for realizing the value from big data and accelerating the time to find critical data for decision making.  Our Big Data Governance  is part of our broader information governance program which leveraged our current operational governance and scaled…

Choosing the Right Data Movement to minimize wait

We all want a zero wait infrastructure. This has spurred many organization to push all data through real-time infrastructure. Unfortunately I’ve seen the mistaken point of view that real-time is the “modern” solution and batch is the “old way”. But both batch and real time processing are very old they both exist for a reason. It is important to determine the nature…

Measurement can be key to improving data.  But, there are too many potential measures when it comes to data.  Every column, every row, every table, every relationship can be measured.  And that does not even get into the possibilities of metadata or data quality.  With all these possibilities coming up with a measurement scheme can seem too costly.  And…

Clavis Technology recently conducted a study showing significant problems with the integrity of product information available on 17 of the largest online consumer goods stores in North America. The study found that over two-thirds of the product pages evaluated suffered from significant gaps in the quality of product information.

When choosing a product in a traditional store a consumer can pick it up and read the packaging before making a choice; but in the online domain they rely…

In his book The Half-life of Facts: Why Everything We Know Has an Expiration Date, Samuel Arbesman introduced me to the Hawthorne Effect, which is “when subjects behave differently if they know they are being studied. The effect was named after what happened in a factory called Hawthorne Works outside Chicago…

Verizon recently blogged about one of its clients who caught an employee outsourcing his software development day job to China. While sitting at his computer working a normal day, he paid someone else to log into his computer using his physical RSA token which he FeExed to the contractor in Shenyang. He would spend the day surfing the internet while…

Many organisations are looking to build Business Intelligence competency centres, by pooling resources, systems and processes into one area. This has many advantages. But you may encounter some fierce opposition to your plans. Here are the top reasons why people will oppose your plans:

Last week, I posted this blog:  Logitech MDM Case Study: Seven Lessons for Mastering Product and Customer Data (Part I of II) which shares highlights from recent webinar. Logitech’s Severin Stoll, Senior Business Engagement Manager of Global IT Solutions spoke with David Decloux, MDM technical lead in EMEA about Logitech’s…

In his book Incognito: The Secret Lives of the Brain, David Eagleman discussed aspects of a bizarre, and rare, brain disorder called Anton’s Syndrome in which a stroke renders a person blind — but the person denies their blindness.

“Those with Anton’s Syndrome truly believe they…

Business process management and data governance are beginning to converge. Data governance practitioners need to take advantage of this trend for the following reasons:

• Address data at the source – Data stewards can use data profiling tools and data quality scorecards to uncover issues with the underlying data.…

So we all know about the Cassandra Complex from a previous post? Take time to read it. Done that? Good! So here is part two - getting your colleagues to believe in what you are saying, and act on your requests.

When you work in a…