Dark data clogging up company computers

Thor

Honorary Master
Joined
Jun 5, 2014
Messages
42,322
I might have read to fast but can someone define "DarkData" for me please as the article did not.
 

saor

Honorary Master
Joined
Feb 3, 2012
Messages
27,852
I might have read to fast but can someone define "DarkData" for me please as the article did not.
Gartner defines dark data as the information assets organizations collect, process and store during regular business activities, but generally fail to use for other purposes (for example, analytics, business relationships and direct monetizing). Similar to dark matter in physics, dark data often comprises most organizations’ universe of information assets. Thus, organizations often retain dark data for compliance purposes only. Storing and securing data typically incurs more expense (and sometimes greater risk) than value.

http://www.gartner.com/it-glossary/dark-data
^^^
 

gregmcc

Honorary Master
Joined
Jun 29, 2006
Messages
23,416
Dark data is data that is stored somewhere but not used. That backup that someone 10 years ago and still sits on the file server taking up valuable space.
 

Thor

Honorary Master
Joined
Jun 5, 2014
Messages
42,322

Dark data is data that is stored somewhere but not used. That backup that someone 10 years ago and still sits on the file server taking up valuable space.

Okey okey I see, so solutions?

I would simply archive any backups older than 5 years onto physical disks.

And store them in a safe and if someone wants to recover stuff going back five years that's in a backup them you charge them.


I assume this is not the best way, so what would you guys recommend.

Especially aimed at bigger companies
 

LCBXX

Honorary Master
Joined
Apr 11, 2006
Messages
15,145
Just call it stale/orphaned data. Dark Data..wtf.
 

Swa

Honorary Master
Joined
May 4, 2012
Messages
29,393
So facebook is taking over the world again?
 

Francois Marais

Senior Member
Joined
Jul 19, 2011
Messages
855
Had trhe problem when I worked at a bank. We had to keep 50 years of records. Our data base in 2005 was some 150GB. We did a RAR on the database every day and had to store it on 5 DVD's.

We had a backup tape system as well. Used for a full backup every week and a backup on the last business day of the financial year. That was sent to MetroFile on tapes (yes there are still people using tapes)

We had the option to request the return of a backup in case of emergency. Took about a week to get our data back. Funny thing. We sent a set of backups and when we tried to recover the data of one set, a NOOB working for us decided that he was just going to dump the tapes in the box and send it to MetroFile.
 

Francois Marais

Senior Member
Joined
Jul 19, 2011
Messages
855
Oh and the other dark data (pick of people and their videos and pirated software) is a huge impact. I work on a site with about 4000 computers. On 99% of those systems there are some form of non work related shyte. We had to implement a data transfer cap of 35GB of data. 99.9% of people with more than 35 GB of data will have a crap load of movies, music and other things. Had only 3 people the last year with more than 50GB of data that were full research and data related. The one client had a whopping 350GB of data and every last piece of data was work related, and not older than 5 years.
 

Sapphiron

Expert Member
Joined
Jan 29, 2004
Messages
2,614
Dark data is the "old data" folder inside the "old 2005" folder inside the "pats backups" inside the "purchased company" inside the "general share" folder

* an actual real word example.

I put a batch file in place, letting our CEO sign off that should nobody touch a file in that folder by end of 2015, it will automatically be deleted.
 

Neoprod

Honorary Master
Joined
May 21, 2004
Messages
18,610
My company (financial services) deletes files stored on network folders with common non-work extensions (videos, music etc.).

Of course, that doesn't solve the problem of things like staff's Outlook .pst files (guilty of this...mine is about 25Gb or so :eek:).
 

Space_Chief

Honorary Master
Joined
Aug 22, 2012
Messages
12,950
I thought they were referring to forgotten hidden porn folders.

That too.

And probably temp files. Tons and tons of temp files. ;)

Just imagine, right now the BS I'm posting is being saved on a server at MyBB's datacentre. Those bytes will also be backed up. :)
 
F

Fudzy

Guest
That too.

And probably temp files. Tons and tons of temp files. ;)

Just imagine, right now the BS I'm posting is being saved on a server at MyBB's datacentre. Those bytes will also be backed up. :)

Well I wouldn't really call MyBB content dark data, okay maybe some of it. Depends on the section.
 

HavocXphere

Honorary Master
Joined
Oct 19, 2007
Messages
33,156
Had trhe problem when I worked at a bank. We had to keep 50 years of records. Our data base in 2005 was some 150GB. We did a RAR on the database every day and had to store it on 5 DVD's.

We had a backup tape system as well. Used for a full backup every week and a backup on the last business day of the financial year. That was sent to MetroFile on tapes (yes there are still people using tapes)

We had the option to request the return of a backup in case of emergency. Took about a week to get our data back. Funny thing. We sent a set of backups and when we tried to recover the data of one set, a NOOB working for us decided that he was just going to dump the tapes in the box and send it to MetroFile.
Holy Fk. No wonder the banks systems are constantly crashing. Doesn't seem very enterprisey even for daily backups.
 

Thor

Honorary Master
Joined
Jun 5, 2014
Messages
42,322
That too.

And probably temp files. Tons and tons of temp files. ;)

Just imagine, right now the BS I'm posting is being saved on a server at MyBB's datacentre. Those bytes will also be backed up. :)

Glary Utilities the temp(shiat) out of that server
 

kianm

Honorary Master
Joined
Jan 13, 2014
Messages
10,532
This is a problem for many companies especially when people leave
 
Top