A New World of Data

Question

A New World of Data

Louis Davidson (@drsql)

SSCommitted

Points: 1516
More actions
February 15, 2020 at 12:00 am

#3724848

Comments posted to this topic are about the item A New World of Data

Viewing 6 posts - 1 through 5 (of 5 total)

You must be logged in to reply to this topic. Login to reply

skeleton567 SSCertifiable Points: 5435 More actions · Answer 1

As I recently pointed out, even though mass storage is pretty inexpensive, there is also the consideration of time and effort spent with backups and validation and such that goes along with the whole thing. I think that data architects need to include in their efforts ways to summarize and archive data even offline such that it can be retrieved effectively IF AND WHEN needed to get to the detail.

Massive storage of detail may be of value in the case of audits and such requirements, but is hardly of much value as it ages and can be more meaningful for many needs if well summarized.

Offline storage of detail can be so much more cost-effective if it is properly designed and managed.

Rick

One of the best days of my IT career was the day I told my boss if the problem was so simple he should go fix it himself.

Jeff Moden SSC Guru Points: 1000539 More actions · Answer 2

I think it's funny... way back when a 1GB disk was the "ultimate", people filled them up. Now we have easy access to inexpensive disks that measure in TeraBytes and, yet, people still manage to fill them up. In both instances, they're usually filled up with junk that no one will ever use a year from now but no one will delete it even 5 years from now.

Same old problems for the last 20 years... the only two things that have changed are the sizes of the disk and the ratio of absolute junk data that people keep compared to what is really needed.

--Jeff Moden

RBAR is pronounced "ree-bar" and is a "Modenism" for Row-By-Agonizing-Row.
First step towards the paradigm shift of writing Set Based code:
________Stop thinking about what you want to do to a ROW... think, instead, of what you want to do to a COLUMN.
"Change is inevitable... change for the better is not".

Helpful Links:
How to post code problems
How to Post Performance Problems
Create a Tally Function (fnTally)
Intro to Tally Tables and Functions

skeleton567 SSCertifiable Points: 5435 More actions · Answer 3

Maybe it's time for a new version of DVD-RW about the size of the old LP records, and a drive the size of a turntable. You could get lots of those DVD-RW's in a 5-drawer lateral file cabinet and it could be indexed and automated to mount and dismount. My old LP turntable would hold ten at a time decades ago and then I had a Sony CDP-CX400 rotary CD player that held 400 at a time.

This reply was modified 4 years, 7 months ago by skeleton567.
This reply was modified 4 years, 7 months ago by skeleton567.
This reply was modified 4 years, 7 months ago by skeleton567.

Rick

One of the best days of my IT career was the day I told my boss if the problem was so simple he should go fix it himself.

Jeff Moden SSC Guru Points: 1000539 More actions · Answer 4

skeleton567 wrote:

Maybe it's time for a new version of DVD-RW about the size of the old LP records, and a drive the size of a turntable. You could get lots of those DVD-RW's in a 5-drawer lateral file cabinet and it could be indexed and automated to mount and dismount. My old LP turntable would hold ten at a time decades ago and then I had a Sony CDP-CX400 rotary CD player that held 400 at a time.

Oh my... too funny that you brought that up. I was working for a DOD company back in the 80's and early 90s and their document library was stored on a large array of what they referred to as "optical storage" and the plastic disks they used were actually the same size as an LP, as you've described. I don't recall how much they could hold but I don't believe that it came anything close to what a DVD can.

--Jeff Moden

RBAR is pronounced "ree-bar" and is a "Modenism" for Row-By-Agonizing-Row.
First step towards the paradigm shift of writing Set Based code:
________Stop thinking about what you want to do to a ROW... think, instead, of what you want to do to a COLUMN.
"Change is inevitable... change for the better is not".

Helpful Links:
How to post code problems
How to Post Performance Problems
Create a Tally Function (fnTally)
Intro to Tally Tables and Functions

skeleton567 SSCertifiable Points: 5435 More actions · Answer 5

Jeff Moden wrote:

skeleton567 wrote:
Maybe it's time for a new version of DVD-RW about the size of the old LP records, and a drive the size of a turntable. You could get lots of those DVD-RW's in a 5-drawer lateral file cabinet and it could be indexed and automated to mount and dismount. My old LP turntable would hold ten at a time decades ago and then I had a Sony CDP-CX400 rotary CD player that held 400 at a time.
Oh my... too funny that you brought that up. I was working for a DOD company back in the 80's and early 90s and their document library was stored on a large array of what they referred to as "optical storage" and the plastic disks they used were actually the same size as an LP, as you've described. I don't recall how much they could hold but I don't believe that it came anything close to what a DVD can.

I never worked with them myself, but recall the "optical storage" days too. Assuming those LP-sized disks had the same density as a DVD-RW, they would be some pretty cheap bulk storage.

I've never tried it, but can you put a SQL Server db on a DVD-RW and then detach and store it for when you want the data? Waiting for slow retrieval and processing might be an alternative for seldom needed data.

Rick

One of the best days of my IT career was the day I told my boss if the problem was so simple he should go fix it himself.