Database help needed

WTF_Lerize

New Member
Joined
Jun 4, 2015
Messages
7
Good day,
I'm new to my broadband, I hope these types of questions are answered here.
I'm developing a web application and I was wondering which database software application (free or cheap) would be best to use for larger databases.

I know MySQL has a 2GB per machine limitation
Microsoft SQL Server Express is 10GB and so forth.

But which database allows for the most data to be stored? Again, preferably free.

I have my own server, but struggling with the database application a bit.
My server is running Ubuntu.
 

Dark Agent

Expert Member
Joined
Nov 30, 2008
Messages
2,009
2GB? My MySQL database is 108GB on one machine.

Go MySQL, you be fine. Make sure you using 64 bit operating system and also make sure not FAT filesystem.
 
Last edited:

adinfinitum

Expert Member
Joined
Apr 26, 2015
Messages
2,024
I'm not too sure about other database applications, but I find that MS-SQL is a very powerful database system. I've had the extreme displeasure of working with Pervasive SQL - just stay away from that. As you mentioned, SQL Server Express does go up to 10GB but this is only from SQL2008R2 up. I worked with many companies that use the free version and it has suited them fine in a small to medium enterprise for ERP software. You do lose some functionality with the free version, but most people don't use them anyway.
 

Nerfherder

Honorary Master
Joined
Apr 21, 2008
Messages
24,599
What is filling up your db? Why not have jobs that clean out and restore space?

Do you really need all the data?
 

Hamster

Resident Rodent
Joined
Aug 22, 2006
Messages
31,677
Also depends on what type of data you are storing. Is it highly transactional or more of a lookup database?

How much data do you need stored? Can some of this data be dumped/archived periodically to keep the db size smaller and even speed up your queries?
 

Kilgore_Trout_Redux

Executive Member
Joined
Sep 20, 2006
Messages
7,506
I'd go with MS SQL simply because it has such great, easy to use tools. I don't recommend MySQL for beginners.
 

Hamster

Resident Rodent
Joined
Aug 22, 2006
Messages
31,677
Unless something has changed and I missed it, MSSQL isn't really an option for his Ubuntu server.
 

adinfinitum

Expert Member
Joined
Apr 26, 2015
Messages
2,024
Unless something has changed and I missed it, MSSQL isn't really an option for his Ubuntu server.
Gosh darn I completely overlooked that. Sorry Hamster is right. Only way would be to virtualize a Windows box, but that on top of SQL is going to be resource hungry. I still love MS-SQL though. ;)
 

Hamster

Resident Rodent
Joined
Aug 22, 2006
Messages
31,677
MSSQL is the scht! Especially compared to the likes of DB2 :sick:

The reason I ask for the type of data OP is going to be storing is because there are NOSQL alternatives like Mongo available to him.

If relational is what he needs his only real options are MySQL and PostgreSQL?
 

Swa

Honorary Master
Joined
May 4, 2012
Messages
21,499
The limit is only on memory usage and this can be bumped up with a Windows switch. I assume there's something similar on Ubuntu. There's no definite storage limitations but large amounts of data will slow down some more than others. MySQL is rather good at handling large databases.
 

gkm

Expert Member
Joined
May 10, 2005
Messages
1,496
MySQL limits are more in the 64TB area, per tablespace etc:
http://dev.mysql.com/doc/mysql-reslimits-excerpt/5.6/en/table-size-limit.html

But if you are moving into that kind of size, you shall need more than a passing knowledge about databases and hardware to run it on. So, MySQL should most likely be fine for what you want. Depending on exactly what you want to do, Postgress or Mongo are also options. If you do not have very specific requirements, MySQL probably the easiest general purpose option.
 

WTF_Lerize

New Member
Joined
Jun 4, 2015
Messages
7
Hi Everyone,
Thanks for all the helpful answers.
I have a Windows Server as well, which I paid for, but I like Ubuntu better.
I have an SQL developer so he will be able to manage the database.
The database is currently being set up for a streaming video service on which users can also save their videos.
My developers keep asking me to buy database software programs but I don't want to do that before I see that this project is a success.

That's why I'm looking for a cheap or free version, with lots of space and then I will expand onto that after initial testing etc.

Oh and just a side note, my one server is 32GB Ram, 4x 3.0 Ghz Quad Core CPU's, 1.5TB of hard disc space, set up in RAID of 250GB increments.
 
Last edited:

gkm

Expert Member
Joined
May 10, 2005
Messages
1,496
Streaming video and databases are not good friends. Any database. You can maybe store the metadata about the videos in your database, but for the videos themselves maybe rather consider something else like AWS S3 with Cloudfront or whatever.
 

WTF_Lerize

New Member
Joined
Jun 4, 2015
Messages
7
GKM, I'm looking at AWS S3 now, I think I will use MySQL (108GB as per Dark Agent's post) and then maybe get 100GB from AWS.
Will that work together until I decide to purchase?
 

Hamster

Resident Rodent
Joined
Aug 22, 2006
Messages
31,677
Streaming video and databases are not good friends. Any database. You can maybe store the metadata about the videos in your database, but for the videos themselves maybe rather consider something else like AWS S3 with Cloudfront or whatever.

This. Do not store the video data in the database.
 

evilskaap

Expert Member
Joined
May 13, 2008
Messages
1,139
Please dont store videos in a DB!

Hi Everyone,
Thanks for all the helpful answers.
I have a Windows Server as well, which I paid for, but I like Ubuntu better.
I have an SQL developer so he will be able to manage the database.
The database is currently being set up for a streaming video service on which users can also save their videos.
My developers keep asking me to buy database software programs but I don't want to do that before I see that this project is a success.

That's why I'm looking for a cheap or free version, with lots of space and then I will expand onto that after initial testing etc.

Oh and just a side note, my one server is 32GB Ram, 4x 3.0 Ghz Quad Core CPU's, 1.5TB of hard disc space, set up in RAID of 250GB increments.
 

evilskaap

Expert Member
Joined
May 13, 2008
Messages
1,139
And didn't you consult your "SQL developer" before asking here? If he is worth anything he would have told you not to store video in a DB. Atleast not a traditional relational DB.
 

WTF_Lerize

New Member
Joined
Jun 4, 2015
Messages
7
"Evilskaap" I'm here for advice, whether it be additional advice or my primary source of advice shouldn't be an issue. I'm exploring all options. Thank you for your concern.
 
Top