HTFC Forums

H.T.F.C.

How To Fix Computers





Go Back   HTFC Forums > Hardware Newsgroups > Storage

Register FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1  
Old 09-06-2007, 01:22 AM
timeOday
 
Posts: n/a
Default How much hardware do I need?

I am making a system which uses a SQL database (currently H2) for data
acquisition. This requires many very small disk writes.

Initial benchmarking of the database with a plain-Jane 7200 RPM IDE
desktop drive, probably 3 or 4 years old, reveals the maximum rate of
insertions is only about 30% of what we need. It is I/O rather than CPU
bound.

We could put more effort ($$$) making the code more optimized (and
complex), but I'd rather just buy faster storage if possible.

Is a current fast hard drive (say, a Raptor) likely to triple database
insert speed? I'm guessing not. How about a RAID array - what sort of
card, which RAID level, and how many drives might be required?

I realize nothing is guaranteed based on the information I've provided,
but economically, it's well worth it for me to just buy it and see, if
there's a decent chance of success.
Reply With Quote
Sponsored Links
Fix your Windows Problems - FAST.
FREE Safe Scan Registry Check. Locate & Fix Errors in Minutes!
  #2  
Old 09-06-2007, 02:01 AM
Arno Wagner
 
Posts: n/a
Default Re: How much hardware do I need?

Previously timeOday <timeOday-UNSPAM@theknack.net> wrote:
> I am making a system which uses a SQL database (currently H2) for data
> acquisition. This requires many very small disk writes.


> Initial benchmarking of the database with a plain-Jane 7200 RPM IDE
> desktop drive, probably 3 or 4 years old, reveals the maximum rate of
> insertions is only about 30% of what we need. It is I/O rather than CPU
> bound.


> We could put more effort ($$$) making the code more optimized (and
> complex), but I'd rather just buy faster storage if possible.


> Is a current fast hard drive (say, a Raptor) likely to triple database
> insert speed? I'm guessing not. How about a RAID array - what sort of
> card, which RAID level, and how many drives might be required?


> I realize nothing is guaranteed based on the information I've provided,
> but economically, it's well worth it for me to just buy it and see, if
> there's a decent chance of success.


A Raptor gives you lower latency and sligly lower seek time.
Say 30% more transactions per second or so. RAID gains you
notning in terms of access speed, only throughput, i.e. nothing
in your application.

Your options are:
- Try a different Database system or
- Try different setting of the database system.
- Use a FLASH disk (not an USB stick, there are FLASH disks out there
exactly for database acceleration).
- Use a RAMdisk designed for database acceleration. These have
backup HDDs and batteries and are very expensive.
- Write a log instead of a database and consolidate the log offline

The only ones of these that work (unless your database system is
really broken) is the move to FLASH or RAM. Theya re also likely
the most expensive option.

Arno
Reply With Quote
  #3  
Old 09-06-2007, 02:46 AM
CJT
 
Posts: n/a
Default Re: How much hardware do I need?

timeOday wrote:

> I am making a system which uses a SQL database (currently H2) for data
> acquisition. This requires many very small disk writes.
>
> Initial benchmarking of the database with a plain-Jane 7200 RPM IDE
> desktop drive, probably 3 or 4 years old, reveals the maximum rate of
> insertions is only about 30% of what we need. It is I/O rather than CPU
> bound.
>
> We could put more effort ($$$) making the code more optimized (and
> complex), but I'd rather just buy faster storage if possible.
>
> Is a current fast hard drive (say, a Raptor) likely to triple database
> insert speed? I'm guessing not. How about a RAID array - what sort of
> card, which RAID level, and how many drives might be required?
>
> I realize nothing is guaranteed based on the information I've provided,
> but economically, it's well worth it for me to just buy it and see, if
> there's a decent chance of success.


Write to a virtual disk in ram and move it to rotating disk periodically
(if at all).

--
The e-mail address in our reply-to line is reversed in an attempt to
minimize spam. Our true address is of the form che...@prodigy.net.
Reply With Quote
  #4  
Old 09-13-2007, 03:09 AM
isaac4all
 
Posts: n/a
Default Re: How much hardware do I need?

Hi
Go get a Hard disk of minimum of 80 GB of hard disk space, Memory
DDram of Minimum of 256Mb and CPU of 1.2Mhz. Go to any of those sites
to compare and purchase those item to create your database system. I
have remember that a system that contains important data's should not
be connected to the internet to keep it safe. Here are the site to
shop for the components

1. Amazon
http://www.amazon.com/?_encoding=UTF...reative=380557


2. Tiger direct
http://click.linksynergy.com/fs-bin/...type=4&subid=0


Isaac okoye
Information Rules the World
http://www.finditall100free.ds4a.com

Reply With Quote
  #5  
Old 09-13-2007, 09:35 AM
Arno Wagner
 
Posts: n/a
Default Re: How much hardware do I need?

Previously isaac4all <finditall100free@yahoo.com> wrote:
> Hi
> Go get a Hard disk of minimum of 80 GB of hard disk space, Memory
> DDram of Minimum of 256Mb and CPU of 1.2Mhz. Go to any of those sites
> to compare and purchase those item to create your database system. I
> have remember that a system that contains important data's should not
> be connected to the internet to keep it safe. Here are the site to
> shop for the components


> 1. Amazon
> http://www.amazon.com/?_encoding=UTF...reative=380557



> 2. Tiger direct
> http://click.linksynergy.com/fs-bin/...type=4&subid=0



> Isaac okoye
> Information Rules the World
> http://www.finditall100free.ds4a.com


Complete nonsense, I am afraid.

Arno
Reply With Quote
  #6  
Old 09-13-2007, 05:15 PM
Folkert Rienstra
 
Posts: n/a
Default Re: How much hardware do I need?

Arno Wagner wrote in news:5ksb1tF54vbjU1@mid.individual.net
> Previously isaac4all <finditall100free@yahoo.com> wrote:
> > Hi
> > Go get a Hard disk of minimum of 80 GB of hard disk space, Memory
> > DDram of Minimum of 256Mb and CPU of 1.2Mhz. Go to any of those sites
> > to compare and purchase those item to create your database system. I
> > have remember that a system that contains important data's should not
> > be connected to the internet to keep it safe. Here are the site to
> > shop for the components

>
> > 1. Amazon
> > http://www.amazon.com/?_encoding=UTF...reative=380557

>
>
> > 2. Tiger direct
> > http://click.linksynergy.com/fs-bin/...type=4&subid=0

>
>
> > Isaac okoye
> > Information Rules the World
> > http://www.finditall100free.ds4a.com

>
> Complete nonsense,


> I am afraid.


And you well should be, babblebot.

>
> Arno

Reply With Quote
Sponsored Links
Fix your Windows Problems - FAST.
FREE Safe Scan Registry Check. Locate & Fix Errors in Minutes!
Reply


Thread Tools
Display Modes


Similar Threads
Thread Thread Starter Forum Replies Last Post
4GB RAM. 1GB Used For Hardware Haydon Windows Vista 15 06-08-2007 06:21 PM
New Hardware vrakita@gmail.com Dell 0 06-01-2007 09:12 PM
mini dump analysis -> Probably caused by : hardware ( nt+4832 ) but what hardware??? Philippe Roy Windows XP 1 04-17-2007 01:34 PM


All times are GMT. The time now is 03:08 PM.


Powered by vBulletin® Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
LinkBacks Enabled by vBSEO 3.1.0
© 2004 - 2007 Web-S-Sense Pty. Ltd. Usenet and forums posts © their respective authors.
Ad Management by RedTyger