Showing posts with label data quality. Show all posts
Showing posts with label data quality. Show all posts
Tuesday, 27 May 2014
The Roadmap to 'Hadoop in the Cloud'
The Twitter ball started rolling again just now. Matt Asay posed an interesting question about Forrester suggesting Hadoop isn't a great fit for the cloud. (Even) without context Vijay Vijayasankar and I started firing off questions and answers which inevitable led to my promise of writing down the transition plan for it
Here it is
Labels:
3.0,
A2A,
Architecture,
Big Data,
Cloud computing,
data quality,
EDI,
information,
Integration,
standardisation
0
reacties
Sunday, 8 September 2013
Influence tools: the devil is in the details
For those of you who haven't heard of Klout, let me give you a brief history: they started back in 2009 with a lot of marketing, a so-so product and non-existent service. They had two ways of handling criticism: either shower the critic in increased Klout score, or ignore him (or her).
With criticism multiplying as Klout was not willing or able to tackle it, Klout decided to take away the cause for it: detailed data on the components making up the Klout score. If you look now, Klout consists of a single score - just a number. Surprisingly, Tweetlevel has travelled the other way - or have they?
The business case for obfuscating Klout details is strong: not anymore will I be able to prove that their figures are statistically impossible:
The above pics show Klout's former marketing manager Megan Berry's @mention count and people mentioning her for a 30-day straight period: every single day the exact same number
The two pics above show Megan's friend count according to Klout, and according to Twittercounter. I'm sure you can see a striking resemblance - between the 3 Klout pics.
That was back in October-November 2010. I notified Klout of my post, several times, but never got a reaction. It wasn't long after that when Klout decided to not show these stats anymore, and just put out a single number for "all-time" RT's, mentions, etc:
That was back in May 2011. You can see the poor attempt at incorporating Facebook into their stats as well, but the most important point is that you can't spot a rotten trend anymore - or can you? I found it odd to notice that no two daily scores ever were the same exactly, but maybe Klout did improve the quality of their code?
Fast forward 4 months, when I investigate the so-called True Reach and find that it's basically your Twitter follower count multiplied by 2.6, give or take 10%:
Within a month, Klout decided to recalibrate True Reach into something even I couldn't recalculate, and eliminate all other subscores except "Amplification" and "Network", which resulted in dramatic increases but mostly drops for pretty much everyone they kept a record on. Soon after, popular opinion forced Klout to enable opt-out for everyone which resulted in a Klout o' Calypse where 2.5 million people opted out of Klout within a month.
Today, Klout is one measly single score without anything below to find out what it's made up of (see the picture at the top of this post). Now, on to Edelman's Tweetlevel: I've always liked their service. They only had one single number with 3 subscores (yes, I know!) and those were steady. They revealed their scoring mechanism to a good detail and appeared to be a roch in the rough sea of Online Influence. Until November 2012, when they revamped the layout and look of it:
That's my Word Cloud right there, plus some stats. The quick stats seem accurate-ish, but the Word Cloud certainly isn't. Thanks to Twitter allowing users to archive their tweets, I can guarantee you that I used the hashtag #Irene 5 times, the last one dating back to August 28 2011. Needless to say, #e20 hasn't been on top of my tweets since roughly then either.
I contacted Johnny Bentwood of Edelman about this and other inconsistencies, and his complete response was:
Thanks – as we are in beta, we are implementing many code fixes so that would explain your 440 errors, please try again laterI'd say he's following Klout tactics there. For completeness' sake, that conversation took place almost a year ago, and this is today's picture...
So I notice that I'm not that happy about Tweetlevel anymore, simply because I witness that part of the data used is over 2 years old - so how can the rest be even close to accurate?
I wonder whether or when Tweetlevel decides to pull detailed sub scores like Klout did, in order to evade simple questions that have no pleasant simple answer. Looking at the buzz around both, however, I'm pleased to see that Tweetlevel is flatlining and not even Microsoft pumping money into Klout raised any eyebrows whatsoever, with Klout attention being back to the same level when they still showed detailed subscores, no matter how ridiculously flawed they were.
The lesson learned? We're still very far away from measuring "online influence" or even Twitter use, and as long as we don't fully master semantics (perfect translation machines would be a proper indication of that), in stead of quality only quantity of interaction can be measured - and as far as we can check, both Klout as well as Tweetlevel stink at even that
Thursday, 6 December 2012
54% of blog posts contain pure facts
A post by Dion Hinchcliffe on "social business maturity" made me laugh and cry at the same time. It's one of those misleading semi-analytical semi-research posts that will be joyfully accepted by most people as solid truth.
However, it ain't. If it's anything solid, it's solid suggestimation. Why?
The post smacks the reader in the face with impressive percentages that most, if not all, are in the 50's, 70's or even 80's, seemingly showing that vast majorities of companies are "socially mature".
I'm not even going to dig around in the studies / research cited in every statement (truly chapeau for Dion for not only citing them, but also providing a link by the way - even if I got a 404 on 1 out of 9), I'm just going to show how the attempt to state
Social media is now being usedinen masse for marketing, sales, operations, customer care, supply chain, and amongst our workforces
is doomed to fail as the post combines two opposites: on the one hand perfect percentages are presented, on the other hand those are related to vague absolute truths, such as "using social technology for marketing and related functions" and "use social media to engage with customers". Any percentage of nothing is nothing
Tuesday, 4 December 2012
On the insignificance of (Re)tweets to a post
An auto-tweet is a schedule you set up against an RSS-feed or any other trigger, which tweets the URL with a title, some of the post itself, a fixed word or hashtag, etc. Some "thought-leaders" use it to ditch all attribution and pretend the tweet originated from themselves. Usually, their Twitter bio then also says "I tweet interesting links" - well, now you know how they do it and how original and carefully curated these are...
I wondered about the current state of affairs - and did a deep analysis this time, the results of which are depicted above
Monday, 3 December 2012
Why TwentyFeet is Total Twash
Yet another Twitter analytic tool has made it into the spotlights: Twentyfeet
Like most if not all other tools that try to measure Twitter stats (Klout, Tweetlevel), it horribly fails. Apparently it's too much work or money to actually measure all tweets, and do they take a sample and extrapolate - or rather, sugguestimate - the rest
That, or they really just can't count
Thursday, 19 July 2012
Google Drive breaks Google Docs?
Starting yesterday, I've been receiving requests from people to share some of the content I have on Google Docs. Yesterday I also shared a link with a friend of mine, and he couldn't access it. That puzzled me
I checked the last link myself, signed out, and tried again - I got a log-on. What? My publicly shared link wasn't publicly shared anymore?
I checked a few other links that I've been publicly sharing for years without problems - I couldn't access them, period
Thursday, 28 June 2012
TIBCO Transform - it says it all
I attended TIBCO's Transform event in London.
Located at the Westminster Bridge Park Plaza hotel, around 600 people were there. Kicked off by Raj Verma, Senior VP of worldwide Marketing, a 2 hour session started that never bored for a minute. Very smoothly Raj led us through a full history of TIBCO, showing impressive figures like a 21% CAGR over the last 15 years, reaching almost a billion dollars in revenue with currently 3,000 employees
Having spent $130 million in R&D last year, the total R&D sum over the years accounted to $1 billion - a huge amount that proves how serious TIBCO is about innovation and fulfilling their goal of "making this world a better place"
Tuesday, 15 May 2012
SAP Integration? Not what I had in mind
I couldn't attend nor even follow the stream at Sapphirenow, but I picked up a few tweets on Integration. Well actually, Seb pointed one out to me.
As much as I detest it, I'll have to base this post on the limited info I retrieved - although I did browse the usual placeholders for SAP news of course.
If you read my latest post on SAP and Integration, you might presume I was a little overexcited about what was going to be announced
Well, the excitement wore off. Really off
Tuesday, 31 January 2012
Pervasive's Integration World Europe 2012
I was at Integration World Europe 2012 today, organised by Pervasive at the Cumberland hotel in London.
A nice environment and a party of a hundred plus, today's topics were Big Data, Data Integration, Cloud and Strategic Business Solutions.
Clear divisions were made on Cloud: IaaS, PaaS and SaaS, and public, private, community and hybrid
Shawn Rogers from Enterprise Management Associates showed an extensive amount of tips and tricks on how to make sure you get the Cloud solution you need, being honest about the small print. The 50-page report he squeezed into one presentation showed many insights, and I'll certainly study it
Saturday, 28 January 2012
How Klout could make Twitter a better place
I've written my fair share of posts on Klout. 1.5 years ago I started off with a mild post called "Why I have doubt about @Klout"
At the beginning of that I stated
First of all, I highly appreciate the service- and I ended with
11 extra Klout points in 12 days on the one hand comforts me, and on the other makes me think about the stability and value of it all...Since then, I've become increasingly weary of the product, especially because of the consistently incosnsistent quality of the product, its lack of service, and its continuous drumming on the marketing machine nonetheless - no wonder 2.5 million people instantly killed their Klout profile as soon as they finally got the chance to do so
Today, I present a way for Klout to actually create some goodwill on Twitter
Wednesday, 25 January 2012
tibbr 3.5 turns the world into interactive post-its
Tibbr released version 3.5 to the public today in Palo Alto California, 9 AM Pacific time. I got a solo preview yesterday and I was impressed by it - as usual I'd say.
"In twelve months since launch, tibbr has been deployed to hundreds of thousands of employees across global enterprises, who can now use tibbr to unify people, data and businesses processes to get work done"
A clear message: ...to get work done. In my opinion, tibbr dramatically reduces unnecessary human intervention in the workplace, thereby making work less unpleasant while freeing up resources for the really interesting work.
Not the greatest nor shortest sales pitch - but then I'm not selling anything here
Tuesday, 17 January 2012
The evangalyst: preaching to the converted
There are definite signs of evolution in social media. Where I saw some issues around mainstream adoption over a year ago, I can now rest assured.
Dozens of "priests and monks" have arisen all over the world to further aid the conversion towards social; Social Business now is the way to go and according to most InfoGraphics over 3/4 of all businesses all over the globe have either implemented social media or are very happy with it, or both
Labels:
1.0,
adopt,
B2B,
change,
data quality,
marketing,
Social Business Design,
social media,
trust,
Twitter
0
reacties
Friday, 2 December 2011
Big Data needs Big Collection and Big Execution
Big Data is the new buzz it seems, and I must say I have been sceptic of it since I first saw the very word - or phrase, what is it?
As an IT architect, I've always equaled data to databases, and information to applications - and knowledge to the people on top of these
For one, I think you can very easily handle the perceived issue when dropping the data, and acting on the information instead. Since when did databases contain useful information?
Vijay Vijayasankar wrote a good post on it, and I'd like to add to that from another point of view
Thursday, 10 November 2011
Once bitten, twice shy? Klout scores get clouted again
Almost 1.5 years ago I showed how very, very flawed Klout's actually is. I made some nice screenshots and illustrated how Klout's scoring is statistically impossible, and how they magically manage to present you with two scores at the same time.
Today, history repeats itself, proving that Klout is still just as immature a product as they were in June 2010. Apparently, some need to fail more than once in order to learn something
Tuesday, 1 November 2011
Why I'm using fake identities to sign up
That is, from now on I will. It is not only getting harder to sign up, it is also getting harder to sign in, and out. Let me explain please as this story has a few sides to it.
But first, let me make my point: I'm going to use fake identities to sign up for new services. If I like the new service, I'll abandon the fake identity and sign up with a real one
Will that mean I'll be lying when accepting most ToS?
Thursday, 13 October 2011
Open Source and Cloud, Mobile, Data: what goes where?
After an interesting question from Matt Asay I gave a few answers, then decided that Twitter's not always suited for long conversations (ahem)
I'm working on the theme for OSBC2012. I want to highlight the connection btwn cloud/mobile/data. Can someone help me express that?
My first reaction was that these words are big, and could mean a lot of different things to different people. I don't like to talk about Cloud as it's a blanket term for three different main streams in general: IaaS, PaaS and SaaS (infra, operating system and software).
Mobile? Pretty much the same thing. Mobile has operating systems and software, and is useless without that special infrastructure called Connectivity: a connection to the Web
Sunday, 18 September 2011
Intrinsic motivation - I doubt the research 1/2
Deb Louison Lavoy shared a TED talk with me, Dan Pink on the surprising science of motivation
Briefly summarising that, Dan shows proof of extrinsic motivation (pure money in this case) actually having little to none and sometimes even a negative effect on people's performance. In short, when the reward for a task was at its highest, people did actually perform worse than when it was a medium reward: in the experiment conducted there were three kinds of rewards: low, medium and high
I want to write two posts on this. This one is about me hairsplitting the very research in question that underlies Dan's passionate and entertaining TED talk. The second one will be about my opinion on intrinsic (and of course, extrinsic as well) motivation
Update 19th September 15:05 CET: I exchanged some tweets yesterday with some people about this post, and the outcome baffled me: people attacked me about intrinsic motivation in general, pointing me to research even (how ironic), and I even got called jerk and idiot.
Please read the above carefully before you react. I also changed this post and added one line below in which I clearly state that good performance in this test would entitle a participant to the equivalent of one month's worth of salary - for half a day's work. Performing very well would "only" double that. Would any performance below good be rewarded? No, not at all. So only good or very good performance would be rewarded. Well, I think it suffices to say that merely performing good - according to the research team - would be considered to be outrageously well rewarded by any participant. I'd sure as hell make sure that I perform just good, so there's hardly any incentive to perform very well
Hence why I consider this very research to be fraudulent and urge it to be completely ignored from a scientific point of view; and that's the only focal point of this post
The research paper can be found here - I'm referring to Experiment I only
Wednesday, 24 August 2011
Social silos adding to enterprise silos? Not with proper Integration
Laurie Buzcek called out for Integration as a solution for the failure of Enterprise 2.0 and Social Business - which she equates to each other - and I couldn't help but think of Tibbr when reading her post
Dion Hinchcliffe responded with a post in which he also stresses the integration of social media with enterprise tools, albeit he's careful to stress that pure technology can't be the answer - apparently we're really beyond E2.0 now
Dion claims OpenSocial 2.0 is the answer but I fail to see how that will help us further: although an impressive amount of work, it is purely technical and relying on the fact that
Developers can create applications, using standard JavaScript and HTML, that run on social websites that have implemented the OpenSocial APIs
and I don't see that happen any time soon - the only successful 2.0 Social Tools are those that are 1.0 in nature: confined
Labels:
3.0,
A2A,
adapt,
adopt,
application development,
B2B,
B2C,
business exceptions,
business rules,
data quality,
E2E,
EAI,
EDI,
ESB,
growth,
Integration,
messaging,
social media,
standardisation
0
reacties
Another Infographic bites the dust
Mindflash produced another Infographic, subtitled "Are companies allowing employees to use social media in the workplace?"
That title couldn't be more misleading. Yet another time it's proven that content and presentation hardly ever go along

That title couldn't be more misleading. Yet another time it's proven that content and presentation hardly ever go along

Tuesday, 2 August 2011
Enterprise Architecture: it's like measuring the coastline
[Capgemini's Integrated Architectural Framework]
I've made the mistake once again: underestimating an enterprise's business and process flow while looking at it from a conceptual or logical point of view, before hitting what we call the physical layer. Call me an idiot please, yes you can
Let me use a few metaphors and make this an easy one to understand. I'll follow the model above
Subscribe to:
Posts (Atom)

























