Are you really data-driven?

Many companies and even individuals pride themselves on being data-driven. Or at least that’s what they claim – it is however clear many are data-driven only when it fits their preferred narrative or their view of how the world works.

They are data-driven only when convenient for them. Using data only when convenient is a lame, modern form of confirmation bias.

Let’s look at just three examples where many so-called data-driven companies completely ignore the actual data:

  • Working hours
  • Diversity
  • Exercise

These are all pretty fundamental building blocks of productivity – and as such, should be of paramount interest to organizations of any size and kind. Yet, the vast majority of activity and policies around these flies directly in the face of evidence – the very data that the said organizations claim guides them.

Let’s look at these, and some of the evidence, one at a time:

Working hours

That long working hours are harmful to productivity has long been known, but equally long mostly ignored by corporations. As evidence keeps piling up that long hours backfire for people and companies and that productivity declines steadily as hours worked increases, what are most companies doing?


At worst, you get reports like the NYT story on Amazon’s culture where companies do exactly the opposite of what research suggests. Or you might get inane stories like BoA Merill Lynch having to exhort their junior bankers to take four weekend days off per month. To say that’s “too little” is a bit of an understatement.


Most organizations pay at least lip service to diversity, because it’s perceived bad to be anti-diversity. At the same time, most organizations are hopelessly homogenous – especially on the executive leadership level. What’s worse, most talk about “diversity” is focused on really, really, basic things like gender. But there’s more to diversity than that; studies have shown that companies with 2-D diversity – both inherent diversity such as gender and ethnicity as well as acquired diversity like working in another country or following a divergent education or career path – are much more likely to grow market share and capture new markets.

As if that’s not enough, being around different people also makes people more creative, more diligent and harder-working. Like with working hours, the data on the benefits of diversity is not exactly new; people like Bob Sutton have been talking about the topic for 15 odd years (including in his book from 2002 that I can highly recommend: Weird Ideas That Work).


Basically nobody disagrees that sedentary lifestyle is a killer – The Economist recently said it has “reached epidemic proportions”. Many organizations may think that has little to do with them and that the best they can do is offer some gym discounts – and they would be wrong.

A Stanford study showed walking improves creativity by an average of 60%; as arranging walking meetings and the like is not exactly complicated, you’d think this would be encouraged more. It has also been shown beyond any reasonable doubt that sitting is bad for you, so simple things like standing desks have many proven benefits. But when was the last time someone asked you for a walking meeting? Does you workplace have adjustable desks all around?

But we’re an exception!

Of course there are genuine exceptions, but they remain precisely that – exceptions. Despite the masses of evidence, I’m stumped as to why organizations do not act on the data. At best, they’re being hypocrites. At worst, they are literally killing their employees and/or making them miserable and failing to reach business objectives effectively.

One reason could be the belief that all that evidence is fine for everyone else, but that we’re somehow different. There are a host of biases involved here, but two concepts stand out – exceptionalism (a perception that an institution is exceptional in some way and thus does not need to conform to normal rules and general principles) and illusory superiority (a cognitive bias where individuals overestimate their own qualities and abilities relative to others). Both are likely too common.

Alternatively, given all of the above have been known for years and years, it could be that organizations and individuals and just bloody slow learners even when faced with convincing data. In an age where learning, innovation and operational agility are imperative, this is not good news.

So, data-driven – really?

If you’re a genuine exception to the above – i.e. you strongly advocate reasonable working hours, are active in hiring and developing for multidimensional diversity and provide support and guidance to being physically active at work – congratulations! I would love to hear how you manage them, what benefits you have seen and what your employees think.

On the other hand, if you fail to acknowledge the points above – i.e. you believe that working perpetually stupid hours is a net positive, that homogeneous groups are superior in innovating and productivity, and that exercise doesn’t have any benefits – you could be called many things, but data-driven is not one of them.

Posted in Business, Culture | Tagged , , , , , , , , | 1 Comment

Don’t Forget How to Fly The Plane – Managing Technology Transitions Safely

A video of this recent impressive cross-wind landing at Schiphol airport found its way to my Facebook feed. Great work from the pilot, but in the comments I saw a friend of a friend wondering if that was the auto-landing software or a pilot at work.

Well, I can assure you it was the pilot; the wind speed at the Schiphol airport averaged 40kts at the time the video was taken, with gusts to 55kts. However, B777’s maximum wind limit for auto-landing is 25kts.

However, for people to even consider that it could’ve been an autopilot got me thinking on one topic that is currently making our world temporarily more dangerous: we are over-reliant on technology that is not ready to take over from us.

With all the – completely valid, I might add – concerns about artificial intelligence, there is a more imminent risk that we are facing, and living with every single day without paying much attention to it. Ironically, the culprit is technological progress; it’s a problem because there’s enough of it, but not enough of it.

Forgetting how to fly the plane

As technology becomes good enough to do some work on our behalf, we tend to be a bit lazy and let it do that work on our behalf.

At first, it breaks down frequently enough so that we retain the skills necessary to take over when needed. But as it improves, we use those skills less and less, until we begin to forget how to take over in the first place – but at the same time, the technology is not yet so developed as to be superior to humans in handling all situations, nor is it infallible or often even particularly resilient. We enter a dangerous chasm of being over-reliant on immature technology.

That’s the dangerous zone we currently live in, and it’s happening everywhere. Like the pilots on Air France flight 447, we happily rely on the computers to run the show for us when it’s smooth sailing. But when something goes wrong, we, like the pilots, suddenly find that we lack the experience to deal with the situation.

Under pressure, we’ve forgotten how to fly the plane; the pilots’ very first responsibility.

The tragedy is that this is unlikely to have happened if we had never had the autopilot taking care of things for us in the first place.

Progress and resilience

And that is how things go, on scales small and large. Over the past centuries and increasingly rapidly over the past decades, humanity has piled on technology upon technology, and as they have grown to be good enough most of the time, we forget how to live without them and rely on them, somehow wrongly assuming they are better than us all of the time.

Whether or not that has disastrous effects like on AF 447 is often a matter of luck.

It’s a matter of luck we haven’t had another Carrington event or a well-coordinated terrorist attack that could disable a large electricity grid for weeks or months.

It’s a matter of luck we’ve avoided a globally devastating pandemic for so many years.

It’s a matter of luck we haven’t hit any climate change tipping points yet. Maybe.

This is good, because we’re not ready for any of them. The electricity grid is remarkably fragile, and we are totally dependent on it. We are systematically unable to deal with a major pandemic – just visit an ER on a good day. And on climate change, the lack of action in face of near-certain string of escalating disasters is deafening.

But luck only lasts so long.

Building Resilience

At some point, the technology surpasses our capacity to deal with issues. At some point, autopilots on airplanes become statistically far superior to humans in dealing with any situation thrown at them.

It is only when that happens – if even then – that we can forget to fly and let the machine take over; when we’re confident it will handle anything better than we ever could have.

We are not at that point yet.

And until we reach that point, we must maintain our capacity to fly – to fly that aircraft, to manage this planet, and to get ready for the turbulent times ahead we so clearly see are ahead of us.

We need to build resilience and backups.

We need to be ready to change and adapt.

We need to harness technology as it becomes available – and yes, drive it forward.

But we must not forget how to survive without it too soon.

Posted in General, Innovation | Tagged , , , , , , , | Leave a comment

Cutting Through the Fluff

Sometimes, the world of technology is not much better than reading a tabloid; a lot of wasted enthusiasm and energy, but zero substance. In a world where every vendor needs to be the “global leader”, every startup a “disruptor” and every product “revolutionary”, it’s useful to have a set of quick techniques for performing elementary reality checks.

Luckily, there are two exceedingly simple tools/techniques that I’ve found invaluable; from performing due diligence to dissecting news articles to debunking outrageous analyst forecasts, they provide a quick and easy “first-pass” filter for most claims, technology-related or not.

1) Ask Why

The Five Whys is one of many variations of root cause analysis which can be used for much more than just troubleshooting. Asking why is incredibly powerful, because it forces the other party to justify the claims made in a logical manner – which strikingly often appears to be impossible for them. Granted, sometimes it can also be hazardous to one’s health – in a typical corporate environment, people are often ready to assault you by the third why 😉

A simple “Why” can quickly uncover basic, fundamental problems with an offering or activity. And if you prepare to answer such questions yourself, you’ll be forced to develop a much more compelling, logical story that is better based on data.

2) Do The Math

This is something so many companies, journalists, analysts and others fail to do that it’s not funny. We’re not talking about complex climate model-type of math either, but really basic fundamental reality checks. It’s more about answering some simple questions about any of presented numbers:
– do they make sense?
– are they realistic?
– are they backed up by some evidence/data?

Let’s take Cisco’s “IOT is a $19 trillion market“-spiel as an example that still gets repeated, completely uncritically, ad nauseam. For that to happen, it would require the global GDP growth to double, starting last year. Unless, of course, they think IOT is a zero-sum game and all the “opportunity” is someone else’s loss – which would in turn mean a rebalancing to the tune of 25% of global GDP. Unsurprisingly, Cisco isn’t keen to talk about such ‘details’.

Of course, it’s not about outrageously big numbers either; many more mundane claims can be debunked by basic math, realistic adoption curve modeling etc.

First-pass filter rate…resembles Sturgeon’s Law

Frankly, I find it alternatingly sad, infuriating and depressing that the vast majority of … everything, really … fail even such elementary tests. It is another proof point for Sturgeon’s Law (“90% of everything is crap”).

Speaking of laws, there’s another law that I see someone falling prey to on a daily basis – Amara’s Law; “We tend to overestimate the effect of a technology in the short run and underestimate the effect in the long run.” That’s something to think about before you pitch your next revolutionary overnight-world-domination idea.

But, but… I have to exaggerate!

This is a common retort to the above criticism; that one simply has to exaggerate and make ludicrously unrealistic claims to get any airtime these days. And there would be some truth to that – it is indeed difficult to be noticed by the media, VCs or whoever if you’re a realist. Extreme messages sell.

I might be naive in that way, but I don’t accept that one would somehow be essentially forced to lie. It reminds me of a quote from Jiddu Krishnamurti, which is a good place to wrap this rant up;

It is no measure of health to be well adjusted to a profoundly sick society.

Posted in Business | Tagged , , , | Leave a comment

Electric vehicles & utilities’ death spiral

Discussion on the potential energy utilities’ death spiral has moved from industry articles to mainstream media. It’s a fascinating topic that has the potential to rework one of the fundamental corner blocks of modern society, electricity.

Cycle started by solar PV

But what exactly is a death spiral in this context? For those unfamiliar with the term, a death spiral is when lower demand for electricity from the grid leads to higher prices (because the same infrastructure still needs to be maintained), further leading to lower demand, higher prices etc. Increasing prices will obviously hit the poor hardest, especially with the up-front capital requirements of solar PV (though some schemes are helping consumers with those).

In Australia, electricity demand has gone down for five consecutive years. There are many reasons for this (manufacturing recession, increased efficiency etc) but the most interesting and perhaps the most important one is increased distributed generation in the form of consumer solar PV panels – approximately 10% of the households now have a solar PV installation.

That amount of panels generates a significant amount of electricity, even if it is only when the sun shines. The aggregate impact is reduced grid demand – the distributors are however left with the same costs to cover for maintaining the grid, but with less revenue to cover it from. Their “natural” reaction to this is to raise network charges and lobby for policy changes like reducing feed-in-tariffs (FIT), both of which have successfully been done – see, e.g.Grattan Institute report Fair Pricing for Power on the former.

Enter storage

It seems inevitable that the cost of solar PV will continue to come down, as it has for decades. There is however another, even more important, part of the puzzle with also reducing costs: storage. While energy storage is still relatively clumsy, expensive and resource-intensive, this is slowly changing and household-scale batteries are already available, albeit at a high price.

When – not if – that price comes down sufficiently, it will become economically feasible for households to do something en masse that is today mostly a special circumstances or an ideological solution: disconnect from the electricity grid altogether. If households start disconnecting in significant numbers, the risk of a death spiral suddenly becomes much greater – and with rapid cost increases for grid-supplied electricity, the emotive rationale of disconnecting becomes increasingly compelling as well.

Will that happen? It remains to be seen, and there is another interesting development that may change the course of this development:

Electric cars

What do electric vehicles have to do with a death spiral? Perhaps ironically, they may delay it at first, and hasten it in long-term. Forbes reports on an EEI study that electric vehicles will save the utilities from the death spiral because of their high energy & power demands.

By proxy, however, success of electric vehicles may enable households to disconnect. Morgan Stanley highlights this angle in their report Solar Power & Energy Storage Policy Factors vs. Improving Economics where it is pointed out that the scale – Tesla’s Gigafactories in particular – will come to help:

“Given the relatively high cost of the power grid, we think that customers in parts of the US and Europe may seek to avoid utility grid fees by going “off-grid” through a combination of solar power and energy storage. [..] We believe there is not sufficient appreciation of the magnitude of energy storage cost reduction that Tesla has already achieved, nor of the further cost reduction magnitude that Tesla might be able to achieve. once the company has constructed its “Gigafactory,” targeted for completion later in the decade.“

Morgan Stanley is predicting battery costs will come down by more than 50% from today’s prices by 2020, with equal full system price reductions. Cheaper batteries of course mean not only cheaper electric cars, but cheaper household-scale energy storage. Barclays joins the sentiment and has downgraded the US utilities as it sees solar as viable competition, stating “We believe that solar + storage could reconfigure the organization and regulation of the electric power business over the coming decade”.

Tesla is already, through SolarCity, trialling stationary storage systems in up to 20kWh range; if all goes as planned, Tesla’s Gigafactories can in some years’ time feasibly produce battery packs at one fifth the price of currently offered solutions.

What do I think will happen?

So, interesting times. I can’t say where this will end, but I can say where I would like it to end: part of me, the resilience-seeking, decentralization/relocalization-driving part, would like to see the grid completely reconfigured, microgrids in place, with distributed generation commonplace and with a healthy dose of completely disconnected entities – with possibly the grid serving in reserve capacity for at least some time. On a system level, this would be much more resilient.

Transition to something so fundamentally different would, however, be extremely difficult and costly. If we wanted to maintain the current basic idea of centralized generation and the style of grid we have today, I would vote for the bulk of generation moving from coal to nuclear, with renewables playing a role as well.

Whatever the future brings, I hope we get rid of coal – it is by far the most environmentally disastrous and dangerous. In terms of deaths per TWh generated, coal is king at 161 deaths, followed by oil at 36, biofuels at 12, gas at 4 and hydro, solar, wind and nuclear all about 1 or less (data from here).

I’d welcome any thoughts or guesses on how this will play out and what the inevitable geographical differences will be.

Posted in Business, Energy, Environment | Tagged , , , , , , , , | Leave a comment