Spreadsheets and disasters

Bradley Prior

MyBroadband Journalist
Staff member
Super Moderator
Joined
Oct 16, 2018
Messages
5,007
Reaction score
1,580
Spreadsheets and disasters
Spreadsheet blunders aren’t just frustrating personal inconveniences. They can have serious consequences. And in the last few years alone, there have been a myriad of spreadsheet horror stories. [The Conversation]
 
This is my personal nightmare at work: the culture of using Excel as a database and even worse, of using Excel as an ERP when the rest of the business is using (and has been using for decades) an actual ERP.
 
This is my personal nightmare at work: the culture of using Excel as a database and even worse, of using Excel as an ERP when the rest of the business is using (and has been using for decades) an actual ERP.

Lack of internal training?

Must be a reason they don't use the solution that is provided.
 
This is my personal nightmare at work: the culture of using Excel as a database and even worse, of using Excel as an ERP when the rest of the business is using (and has been using for decades) an actual ERP.
Same boat. I’m doing a project supplying data to a 3rd party to predict demand and our supply chain department just can’t seem to wrap their heads around the fact that excel isn’t a database and is a complete pain in the backside to work with. Add to that a couple of macro geniuses and it’s a complete nightmare.
 
Same boat. I’m doing a project supplying data to a 3rd party to predict demand and our supply chain department just can’t seem to wrap their heads around the fact that excel isn’t a database and is a complete pain in the backside to work with. Add to that a couple of macro geniuses and it’s a complete nightmare.

So why is that - must be a way to change that.

If you cannot then you must grit your teeth and live with it.
 

The Tyranny of Spreadsheets​

Article - https://timharford.com/2021/07/the-tyranny-of-spreadsheets/
Podcast - https://timharford.com/2021/05/cautionary-tales-wrong-tools-cost-lives/

"Microsoft Excel is great for business accounts… but maybe don’t use it to track a deadly disease.

The British Government promised to create a “world-beating” system to track deadly Covid 19 infections – but it included an outdated version of the off-the-shelf spreadsheet software Microsoft Excel. The result was disastrous."


"Early last October my phone rang. On the line was a researcher calling from Today, the BBC’s agenda-setting morning radio programme. She told me that something strange had happened, and she hoped I might be able to explain it. Nearly 16,000 positive Covid cases had disappeared completely from the UK’s contact tracing system. These were 16,000 people who should have been warned they were infected and a danger to others, 16,000 cases contact tracers should have been running down to figure out where the infected went, who they met and who else might be at risk. None of which was happening.

Why had the cases disappeared? Apparently, Microsoft Excel had run out of numbers."
 
Different take.

Excel is awesome and the world runs on it.

Because this article was focused on Britain we should also mentioned their lovely non-spreadsheet Post Office system.

So above was a bit tongue in the cheek - but people is going to mess up whether it is Excel or another system. You need to evaluate the needs and risks and costs. Spending a million bucks to replace an unimportant spreadsheet is not wise either. My personal experience is people turn to spreadsheets when the systems are shite.
 
Last edited:
This is my personal nightmare at work: the culture of using Excel as a database and even worse, of using Excel as an ERP when the rest of the business is using (and has been using for decades) an actual ERP.
Excel is usually the best way to get started and works very well for almost any problem, until one day it doesn't, catastrophically.
 
Excel is quick and powerful, and really lowers the barrier to entry for capturing data. You can sit in a meeting and throw a bunch of information at a brand new intern and have them copy paste it all into one pretty looking spreadsheet with the filename "Issue Tracking Database.xlsx" and you'll have a database before the meeting is over. No need to worry about all the red tape, bureaucracy, and unnecessary timelines of having to get a DBA or an analyst from another department involved.

But do you really want to store and track critical workplace actions, the kind that prevent people getting hurt or hundreds of thousands of rand in asset damage, to be sitting in a spreadsheet on a network share somewhere, with people going in and just drag filling data down across hidden rows? Or copy pasting into a different cell than they thought they were working in? Or typing a date the wrong way around and an issue never flags up as overdue?

As Sapphiron mentioned, yes it works fine now, until it doesn't, and then they'll blame the users for not manually implementing Change Data Capture or Audit Logs :rolleyes:.

Lack of internal training?

Must be a reason they don't use the solution that is provided.
Least path of resistance amongst users, managers don't care about (or prioritise) potential risks of incorrect/lost data. Office politics, not wanting to deal with IT/IS/ERP department, and wanting to silo data and obfuscate it from the rest of business to hide any shortcomings.

Same boat. I’m doing a project supplying data to a 3rd party to predict demand and our supply chain department just can’t seem to wrap their heads around the fact that excel isn’t a database and is a complete pain in the backside to work with. Add to that a couple of macro geniuses and it’s a complete nightmare.
I see you're also dealing with "We don't need normalisation - our Excel database uses Data Validation!". Next you'll tell us that their idea of revision control is looking in their Outlook Inbox and using whichever version of the file has the most counts of the word "FINAL" in the filename :unsure:

Different take.

Excel is awesome and the world runs on it.

Because this article was focused on Britain we should also mentioned their lovely non-spreadsheet Post Office system.

So above was a bit tongue in the cheek - but people is going to mess up whether it is Excel or another system. You need to evaluate the needs and risks and costs. Spending a million bucks to replace an unimportant spreadsheet is not wise either. My person experience is people turn to spreadsheets when the systems are shite.
Agreed, it's all about using the right tool for the job. But even if the proper system is better, people are going to take the path of least resistance. If you're going to give them the option of copy pasting any garbage into an Excel sheet, versus having to input data in a DB front end that gets validated and automatically sent for for review/approval, they'll take the option that creates less work for themselves.

Excel is usually the best way to get started and works very well for almost any problem, until one day it doesn't, catastrophically.
Reminds me of the saying: "There are two types of people. Those who make backups, and those who will."
 
This is my personal nightmare at work: the culture of using Excel as a database and even worse, of using Excel as an ERP when the rest of the business is using (and has been using for decades) an actual ERP.
This is actually a very common situation. I've seen it in a few SME's, most of whom were (coincidentally) running Syspro.

Knowledge/training is part of it. How the implementation goes down also is a factor - financial and basic inventory modules are implemented at the beginning and we'll get to the other stuff in 'phase 2' - inevitably, 5 years later janky spreadsheets and reports are still be used for replenishment, forecasting etc.
 
The international economic recession of 2007, driven by the subprime mortgage crisis, was dealt with through severe austerity measures. This strategy was developed following an IMF analysis of the optimum debt as a percentage of GDP to get out of the recession. The austerity packages were implemented many nations and resulted in company closures, unemployment, more people moving into poverty and ultimately some riots. After the dust had settled a student discovered an error in the spreadsheet that the strategy was based on, with several rows being left out of an equation. When this error was corrected the results showed a completely different strategy should have been followed. Subsequent analysis of the impact of the austerity measures also showed that there was a significantly negative impact on economies. This probably rates as one of the biggest spreadsheet blunders of all time.

At the time this happened some economists were already questioning the use of spreadsheets for this type of work. Errors had previously led to the collapse of the Jamaican banking system and inflating the perceived investment value of subprime mortgages, the latter of which had contributed to the subprime mortgage crisis in the first place.

I have been using spreadsheets since the 80s (Lotus anyone?), and have at least tried to develop some techniques to trap errors. One is to use an RPN calculator for check calculations. Since this uses a totally different logic to Excel it is less likely that the same logic error will be repeated during the check. There are three old ones in the drawer still.
 
The biggest issue is the software auto converting data. Several times I have entered values into a spreadsheet or even other software and it changes. Mind you it's harder to catch with a spreadsheet where data is entered repetitively so not checked but it's not true that user error is the problem when the software itself is unintuitive to use and hides some of its workings.
 

The Tyranny of Spreadsheets​

Article - https://timharford.com/2021/07/the-tyranny-of-spreadsheets/
Podcast - https://timharford.com/2021/05/cautionary-tales-wrong-tools-cost-lives/

"Microsoft Excel is great for business accounts… but maybe don’t use it to track a deadly disease.

The British Government promised to create a “world-beating” system to track deadly Covid 19 infections – but it included an outdated version of the off-the-shelf spreadsheet software Microsoft Excel. The result was disastrous."


"Early last October my phone rang. On the line was a researcher calling from Today, the BBC’s agenda-setting morning radio programme. She told me that something strange had happened, and she hoped I might be able to explain it. Nearly 16,000 positive Covid cases had disappeared completely from the UK’s contact tracing system. These were 16,000 people who should have been warned they were infected and a danger to others, 16,000 cases contact tracers should have been running down to figure out where the infected went, who they met and who else might be at risk. None of which was happening.

Why had the cases disappeared? Apparently, Microsoft Excel had run out of numbers."
Oh the horror, 16,000 people that MIGHT have been in contact with a Covid positive individual while millions of Covid positive people are running around we never even knew the details of. It became apparent afterwards that contact tracing and forced quarantine was a sham.
 
Top
Sign up to the MyBroadband newsletter
X