HTFC Forums

H.T.F.C.

How To Fix Computers





Go Back   HTFC Forums > Hardware Newsgroups > Hardware

Register FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1  
Old 08-15-2008, 03:50 PM
PeteOlcott
 
Posts: n/a
Default Hard disk sustained throughput

How fast should a SATA hard-drive be able to copy a 16 GB folder from
one disk to another?
http://www.nextlevelhardware.com/storage/barracuda/

This link (Folder Copy Test) indicates that 5 minutes is about the
maximum speed when there are few
large files. My machine took ten times this long on 12.3 GB of data in
196,916 files in 48,761 folders. Is this a reasonable amount of time
to copy data from one SATA drive to another?
Reply With Quote
Sponsored Links
Fix your Windows Problems - FAST.
FREE Safe Scan Registry Check. Locate & Fix Errors in Minutes!
  #2  
Old 08-15-2008, 04:06 PM
CBFalconer
 
Posts: n/a
Default Re: Hard disk sustained throughput

PeteOlcott wrote:
>
> How fast should a SATA hard-drive be able to copy a 16 GB folder
> from one disk to another?
>
> http://www.nextlevelhardware.com/storage/barracuda/
>
> This link (Folder Copy Test) indicates that 5 minutes is about
> the maximum speed when there are few large files. My machine took
> ten times this long on 12.3 GB of data in 196,916 files in 48,761
> folders. Is this a reasonable amount of time to copy data from one
> SATA drive to another?


Doesn't sound unreasonable. Consider that the system had to create
those files, create and expand the directories involved, find the
storage, etc. That was still about 3900 files per minute, ignoring
directory creation.

--
[mail]: Chuck F (cbfalconer at maineline dot net)
[page]: <http://cbfalconer.home.att.net>
Try the download section.

Reply With Quote
  #3  
Old 08-15-2008, 04:34 PM
GT
 
Posts: n/a
Default Re: Hard disk sustained throughput

"PeteOlcott" <PeteOlcott@gmail.com> wrote in message
news:20ede702-fec8-4f36-8611-4dfc8ff644cc@79g2000hsk.googlegroups.com...
> How fast should a SATA hard-drive be able to copy a 16 GB folder from
> one disk to another?
> http://www.nextlevelhardware.com/storage/barracuda/
>
> This link (Folder Copy Test) indicates that 5 minutes is about the
> maximum speed when there are few
> large files. My machine took ten times this long on 12.3 GB of data in
> 196,916 files in 48,761 folders. Is this a reasonable amount of time
> to copy data from one SATA drive to another?


On Vista or XP?
On Vista - get the service pack!!


Reply With Quote
  #4  
Old 08-15-2008, 04:36 PM
PeteOlcott
 
Posts: n/a
Default Re: Hard disk sustained throughput

On Aug 15, 10:34*am, "GT" <ContactGT_rem_ove_th...@hotmail.com> wrote:
> "PeteOlcott" <PeteOlc...@gmail.com> wrote in message
>
> news:20ede702-fec8-4f36-8611-4dfc8ff644cc@79g2000hsk.googlegroups.com...
>
> > How fast should a SATA hard-drive be able to copy a 16 GB folder from
> > one disk to another?
> > *http://www.nextlevelhardware.com/storage/barracuda/

>
> > This link (Folder Copy Test) indicates that 5 minutes is about the
> > maximum speed when there are few
> > large files. My machine took ten times this long on 12.3 GB of data in
> > 196,916 files in 48,761 folders. Is this a reasonable amount of time
> > to copy data from one SATA drive to another?

>
> On Vista or XP?
> On Vista - get the service pack!!


This is on XP x64
Reply With Quote
  #5  
Old 08-15-2008, 05:54 PM
Paul
 
Posts: n/a
Default Re: Hard disk sustained throughput

PeteOlcott wrote:
> On Aug 15, 10:34 am, "GT" <ContactGT_rem_ove_th...@hotmail.com> wrote:
>> "PeteOlcott" <PeteOlc...@gmail.com> wrote in message
>>
>> news:20ede702-fec8-4f36-8611-4dfc8ff644cc@79g2000hsk.googlegroups.com...
>>
>>> How fast should a SATA hard-drive be able to copy a 16 GB folder from
>>> one disk to another?
>>> http://www.nextlevelhardware.com/storage/barracuda/
>>> This link (Folder Copy Test) indicates that 5 minutes is about the
>>> maximum speed when there are few
>>> large files. My machine took ten times this long on 12.3 GB of data in
>>> 196,916 files in 48,761 folders. Is this a reasonable amount of time
>>> to copy data from one SATA drive to another?

>> On Vista or XP?
>> On Vista - get the service pack!!

>
> This is on XP x64


A folder copy test will have a strong "seek" component to the copy
time. The sustained transfer rate of a drive is not the only consideration.
If you had 196,916 2KB files, the transfer time when the head gets there,
would be virtually zero for each file, but it takes milliseconds to find each
file ("seek" the heads to the appropriate track). If you can process
500 of the 2KB files each second, due to the limitations of head movement,
that is 1MB/sec transfer rate, and looks pathetic. And this is where a flash
drive would excel, as the seek time is very low by comparison. (USB flash
is 1 millisecond seek, while IDE or SATA based flash can be 1/10th of that.)

Paul
Reply With Quote
  #6  
Old 08-15-2008, 05:59 PM
Big_Al
 
Posts: n/a
Default Re: Hard disk sustained throughput

Paul wrote:
> PeteOlcott wrote:
>> On Aug 15, 10:34 am, "GT" <ContactGT_rem_ove_th...@hotmail.com> wrote:
>>> "PeteOlcott" <PeteOlc...@gmail.com> wrote in message
>>>
>>> news:20ede702-fec8-4f36-8611-4dfc8ff644cc@79g2000hsk.googlegroups.com...
>>>
>>>> How fast should a SATA hard-drive be able to copy a 16 GB folder from
>>>> one disk to another?
>>>> http://www.nextlevelhardware.com/storage/barracuda/
>>>> This link (Folder Copy Test) indicates that 5 minutes is about the
>>>> maximum speed when there are few
>>>> large files. My machine took ten times this long on 12.3 GB of data in
>>>> 196,916 files in 48,761 folders. Is this a reasonable amount of time
>>>> to copy data from one SATA drive to another?
>>> On Vista or XP?
>>> On Vista - get the service pack!!

>>
>> This is on XP x64

>
> A folder copy test will have a strong "seek" component to the copy
> time. The sustained transfer rate of a drive is not the only consideration.
> If you had 196,916 2KB files, the transfer time when the head gets there,
> would be virtually zero for each file, but it takes milliseconds to find
> each
> file ("seek" the heads to the appropriate track). If you can process
> 500 of the 2KB files each second, due to the limitations of head movement,
> that is 1MB/sec transfer rate, and looks pathetic. And this is where a
> flash
> drive would excel, as the seek time is very low by comparison. (USB flash
> is 1 millisecond seek, while IDE or SATA based flash can be 1/10th of
> that.)
>
> Paul

http://www.geocities.com/vgrinenko/DiskSpeed32/
You can use something like this disk speed test to get an general idea
of the speed of a drive. Still Paul has a point, seek speed, buffer
size, defrag status, etc all factor into the overall speed.
Reply With Quote
  #7  
Old 08-16-2008, 04:38 AM
Peter Olcott
 
Posts: n/a
Default Re: Hard disk sustained throughput


"Paul" <nospam@needed.com> wrote in message
news:g84c58$681$1@aioe.org...
> PeteOlcott wrote:
>> On Aug 15, 10:34 am, "GT"
>> <ContactGT_rem_ove_th...@hotmail.com> wrote:
>>> "PeteOlcott" <PeteOlc...@gmail.com> wrote in message
>>>
>>> news:20ede702-fec8-4f36-8611-4dfc8ff644cc@79g2000hsk.googlegroups.com...
>>>
>>>> How fast should a SATA hard-drive be able to copy a 16
>>>> GB folder from
>>>> one disk to another?
>>>> http://www.nextlevelhardware.com/storage/barracuda/
>>>> This link (Folder Copy Test) indicates that 5 minutes
>>>> is about the
>>>> maximum speed when there are few
>>>> large files. My machine took ten times this long on
>>>> 12.3 GB of data in
>>>> 196,916 files in 48,761 folders. Is this a reasonable
>>>> amount of time
>>>> to copy data from one SATA drive to another?
>>> On Vista or XP?
>>> On Vista - get the service pack!!

>>
>> This is on XP x64

>
> A folder copy test will have a strong "seek" component to
> the copy
> time. The sustained transfer rate of a drive is not the
> only consideration.
> If you had 196,916 2KB files, the transfer time when the
> head gets there,
> would be virtually zero for each file, but it takes
> milliseconds to find each
> file ("seek" the heads to the appropriate track). If you
> can process
> 500 of the 2KB files each second, due to the limitations
> of head movement,
> that is 1MB/sec transfer rate, and looks pathetic. And
> this is where a flash
> drive would excel, as the seek time is very low by
> comparison. (USB flash
> is 1 millisecond seek, while IDE or SATA based flash can
> be 1/10th of that.)
>
> Paul


Yes that makes complete sense, so it is quite reasonable
that copying folders of 200,000 small files takes
fifteen-fold longer than copying the same amount of data
comprised of 100 very large files.

Do you know why deleting many small files could take a much
more unreasonable amount of time on Windows XP x64?
At the rate the deletion was going it would have taken 20
hours to delete about 200,000 files. I ended up reformatting
the drive and reloading the data, this took much less time.


Reply With Quote
  #8  
Old 08-16-2008, 05:48 AM
Paul
 
Posts: n/a
Default Re: Hard disk sustained throughput

Peter Olcott wrote:
>
> Yes that makes complete sense, so it is quite reasonable
> that copying folders of 200,000 small files takes
> fifteen-fold longer than copying the same amount of data
> comprised of 100 very large files.
>
> Do you know why deleting many small files could take a much
> more unreasonable amount of time on Windows XP x64?
> At the rate the deletion was going it would have taken 20
> hours to delete about 200,000 files. I ended up reformatting
> the drive and reloading the data, this took much less time.
>


I haven't a clue. I don't know if there is any way, short of
using some kind of development environment debugger, to
find out what is going on.

Some problems are obvious ones. There was an SIS chipset and
driver, where when you clicked on an icon, there was no
response from the computer for five seconds, and then the
operation would start. In that case, it seemed the
first file operation would fail (no response), time out,
and get retried. At least that has obvious visible symptoms.
(Nice consistent 5 second delay, no CPU utilization to speak of
until the five seconds is up.) But for more subtle cases
(like yours - only being able to delete 3 files per second),
it could be something hidden, like antivirus software activity.

Sysinternals.com has some tools for watching what is going on,
but if there were issues at a driver level, I don't know if
you'd see anything incriminating or not. I cannot play with
just any Sysinternals tool on my computer here, because my
antivirus software (Kaspersky) gets into a fight with some of
the programs, resulting in a computer freeze that not even
control-alt-delete can fix. (Control-alt-delete is "hooked" by
the AV software, and if the AV is "busy", then control-alt-delete
stops working. Talk about invasive.)

Paul
Reply With Quote
  #9  
Old 08-17-2008, 03:46 AM
Paul
 
Posts: n/a
Default Re: Hard disk sustained throughput

Peter Olcott wrote:

>
> Yes that makes complete sense, so it is quite reasonable
> that copying folders of 200,000 small files takes
> fifteen-fold longer than copying the same amount of data
> comprised of 100 very large files.
>
> Do you know why deleting many small files could take a much
> more unreasonable amount of time on Windows XP x64?
> At the rate the deletion was going it would have taken 20
> hours to delete about 200,000 files. I ended up reformatting
> the drive and reloading the data, this took much less time.
>


I figured I'd pass this along, as this was referenced in another
group tonight.

"Increase XP NTFS performance - NtfsDisableLastAccessUpdate, fiddle with MFT"
http://www.tweakxp.com/article37043.aspx

Paul

Reply With Quote
Sponsored Links
Reply


Thread Tools
Display Modes


Similar Threads
Thread Thread Starter Forum Replies Last Post
Dual Disk SATA - question for the hard disk gurus Spin Storage 2 05-27-2008 05:59 PM
Boot Hard disk doest not show in Disk Management console Nikesh Windows XP 2 05-18-2008 01:49 PM
Win XP 802.11 maximum throughput? PaulH Windows XP 0 10-08-2007 04:24 PM
download throughput very low, upload OK - LAN OK bogus@bogus.com Windows Vista 0 10-04-2007 08:46 PM
100GB Hard Disk Drive, 7200rpm versus 160GB Hard Disk Drive, 5400rpm amandaf37@gmail.com Laptops 46 09-25-2007 11:26 AM


All times are GMT. The time now is 09:07 PM.


Powered by vBulletin® Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
LinkBacks Enabled by vBSEO 3.1.0
© 2004 - 2007 Web-S-Sense Pty. Ltd. Usenet and forums posts © their respective authors.
Ad Management by RedTyger