BigData

IN the 1960s, mainframe computers posed a significant technological challenge to common notions of privacy. That's when the federal government started putting tax returns into those giant machines, and consumer credit bureaus began building databases containing the personal financial information of millions of Americans.

From Collection to Usage

If you're one to track the Q rating of tech trends, then you know the cloud is so last minute and big data is good for little more than wrapping fish at Whole Foods. For 2013, it's all about the Internet of Things.

Mark van Rijmenam The possibilities of big data are enormous, but moving into the big data era carelessly will have massive ethical and privacy impacts. We should master the technology and not the other way around. The goal is to develop better ways to use the unprecedented computing power to our advantage without intruding on our privacy or ethical standards.

The Emergence of Quantified Self in Enterprise The quantified self-movement (QS) is a hot topic in 2013 and focuses on using sensors and other trackers to acquire self-knowledge for the end goal of gaining deeper insight about personal habits. For example, I use Nike+ to log my daily run performance.

Big Data is a new book from Viktor Mayer-Schonberger, a respected Internet governance theorist; and Kenneth Cukier, a long-time technology journalist who's been on the Economist for many years. As the title and pedigree imply, this is a business-oriented book about "Big Data," a computational approach to business, regulation, science and entertainment that uses data-mining [...]

The past week brought big news for Big Data, with two firms securing multi-million dollar funding rounds, and Google rolling out new features to BigQuery. In addition, 10gen enhanced its flagship NoSQL database and Sqrrl hired a new CEO to help accelerate its growth.

If big-data raises fear in your heart, then you wouldn't be alone. Big-data has turned into a specter of sorts, sometimes paralyzing organizations from taking action lest they get it wrong. No doubt, big-data does represent change -- and change can be scary for the unprepared.

This one is a Javascript library to produce images for web documents. Here's some sample output: Source: http://d3js.org/. Note that Python has a nice, cool...

I recently wrote about "finding a mission" for Big Data. I firmly believe that it will be actual use cases in the business that move IT into a set of best practices for Big Data, and not some theoretical "best fit" processing and storage architecture that IT simply orchestrates for what it thinks Big Data will require.

25 maart 2013 - Dat big data in de lift zit, mag blijken uit het aantal conferenties dat er tegenwoordig over plaats vindt. Zo waren er vorige week liefst drie grote conferenties waar big data centraal stond: Gartner's Business Inteligence and Analytics Summit, GigaOm's Structure: Data en uiteraard ook Hadoop Summit Europe in Amsterdam.

Big data, if nothing else, is about lots of data. That's clear enough, even if the Devil lurks somewhere in the details. As a rough rule of thumb, if the people I talk to are a useful measure, big data means tens to hundreds of terabytes and beyond, and it includes scaling up and scaling out to be able to process whatever workloads one expects to run on such data.

Anonymous data is one of the staples of the big data movement, but there's a dark side. In theory, data from mobile phones lets us do things like map traffic patterns, while web-behavior data can be a boon to researchers and others trying to make sense of how people conduct their online lives.

Onze Online Dialogue collega en big data-expert Arend Zwaneveld heeft voor Webanalisten.nl een artikel geschreven over de Big Data workshop door Sandjai Bhulai op het Webanalytics Congres 2013. Op 13 maart hield Sandjai Bhulai een big data workshop op het Webanalytics congres 2013. Hier mijn hoogtepunten en meest interessante inzichten.

Big data and analytics startup Sociocast recently shifted its focus from enterprises to small and medium-sized businesses, but the move has already paid off with it serving more than 700 million calls from its flagship Prediction API in just a month.

Big Data biedt banken nieuwe kansen en verhoogt veiligheid Banken zijn al verplicht om heel veel data te verzamelen en te bewaren Banken weten veel over hun klanten. Aan de hand van allerlei innovatieve ideeën proberen zij die klantgegevens om te zetten in kennis en wijsheid om de concurrentie voor te blijven.

This looks to be the year that we reach peak big data hype. From wildly popular big data conferences to columns in major newspapers, the business and science worlds are focused on how large datasets can give insight on previously intractable challenges.

I published a blog post titled Big Data and Rise of Predictive Analytics a couple of days back in which I highlighted that "I am happy to say that Predictive Analytics (or Advanced Analytics as some would prefer to say) is going main stream in 2013, thanks to Big Data.

Big data is overhyped en kan nu al bijna niet meer voldoen aan het verwachtingspatroon dat gecreëerd is door leveranciers en consultants. Maar wat is nu echt de waarde van (big) data? Hieronder een aantal voorbeelden waarin verschillende interpretaties van de waarde van data de hoofdrol spelen. Apple - Goeie data, slecht resultaat.

Dagelijks genereren smartphones, sensors, videocamera's, slimme meters en andere aan internet verbonden apparatuur enorme hoeveelheden data. Deze data komen bovenop de enorme informatieberg die uit traditionele bronnen afkomst is. Deze 'datalawine' vertegenwoordigt een potentiële goudmijn aan inzichten, maar een nieuw onderzoek van Cisco laat zien dat IT-professionals en bedrijven voor de uitdaging staan om strategische waarde uit hun data te halen.

No matter what problem you're talking about these days, Big Data is inevitably the answer. We hear it constantly. Data will help us live healthier lives. Data will allow us to design smarter cities. Data will make sure nobody makes a bad TV show ever again!

Many of us would like to believe that we base our important business decisions on well grounded facts. It does not take much looking around to realise that the data do not necessarily support the decisions being made. David Brooks wrote an op-ed piece in the New York Times, "What Data Can't Do" that outlines five areas data science struggles with.

The study, conducted by the CMO Council in collaboration with SAS, found that 61% of marketing executives and 60% of IT executives believe that big data presents both an opportunity and an obstacle, since many companies are struggling to manage the complexity, flow, aggregation and analysis of massive amounts of structured and unstructured data flowing in to their organizations.

David Barker, is the founder and technical director of green colocation and connectivity supplier, 4D Data Centres. David (27) founded the company in 1999 at age 14. Since then he's masterminded 4D's development into the fully fledged colocation and connectivity provider that it is today.

When I talk to organizations about how they are using data visualization tools I am often struck by the fact that they use these tools mostly to generate charts and graphs that really aren't all that different from what they could have created with standard business intelligence or desktop tools.