DotDragnet
February 08, 2012, 10:37:10 PM *
Welcome, Guest. Please login or register.

Login with username, password and session length
News: Welcome to the new trading eye refugees
 
   Home   Help Search Login Register  
Pages: [1]   Go Down
  Print  
Author Topic: Networking Gurus Needed  (Read 1346 times)
slaughteredlamb
DDN Contributor
Hero Member
*****
Posts: 1059



peakoverload
View Profile WWW Awards
« on: January 29, 2010, 11:21:25 AM »

We are having lots of problems with our server at work where our entire network grinds to a halt which we think is due to us trying to ask too much of either our entire network or of the single network card in the server. This is our set-up:

Windows 2003 Server with 2TB of storage 12GB of RAM 3GHz Xeon CPU with a Gigabit Network card.
This server is connected to one of three bridged Gigabit switches
Into these switches are connected 25 PC's each with Gigabit Cards via Cat5e cables.

Of these 25 PC's 20 of them read and write audio files, both uncompressed WAV and MP3 files to the server constantly all day long.
This is broken down further as follows:
6 PC's write WAV files to the server in real time (a mono WAV file has a file size of 5MB per min) but also play back audio which is first cached locally allowing for instant playback. How much audio is cached I'm not sure but all I can say is that we can jump anywhere in a 23hr recording and get instant playback.
4 PC's read and write WAV files at faster than real time, how fast depends on how fast the network will allow but should be around 4-5x real time
6 PC's read WAV files whilst they are compressed to MP3 which are written back to the server
4 PC's also read WAV files whilst they are compressed to MP3 which are written back to the server but also rip CD's to stereo WAV files. How fast the ripping takes depends on how fast the network will allow but should be 24x (often though it's around 2x!)

So all in all there is a lot of data flying back and fourth.

Is there a piece of software or something that I can install on the server which will actually measure how much traffic is going through that network card and how much that is of the available 'bandwidth', if that's the right word, of that card i.e. can I detect if we are simply maxing out the network card with too much traffic?
Logged
robwhizz
Hero Member
*****
Posts: 550


Would like a pet Chain Chomp


robwhizz
View Profile WWW Awards
« Reply #1 on: January 29, 2010, 12:23:03 PM »

What about your disk set up too? Are you running an array and what type? How fast are the disks?
There is a lot of disk activity here that could also be contributing to the slow down.
Logged

Great post Jon! I have been following the effort since you started it, and although I have understood its purpose this post does a really great job solidifying the full rationale.
slaughteredlamb
DDN Contributor
Hero Member
*****
Posts: 1059



peakoverload
View Profile WWW Awards
« Reply #2 on: January 29, 2010, 01:06:25 PM »

What about your disk set up too? Are you running an array and what type? How fast are the disks?
There is a lot of disk activity here that could also be contributing to the slow down.

It's a RAID 5 with 320GB SATA 7200rpm drives (giving us 1.8TB of storage plus a parity drive)
Logged
Tony
Administrator
Hero Member
*****
Posts: 1248



@temps
View Profile WWW Awards
« Reply #3 on: January 29, 2010, 02:19:26 PM »

SL, aren't you a sound engineer? why don't they employ a network engineer to sort it out for you? can't be a valid use of your time doing that can it?
Logged

slaughteredlamb
DDN Contributor
Hero Member
*****
Posts: 1059



peakoverload
View Profile WWW Awards
« Reply #4 on: January 29, 2010, 02:43:51 PM »

SL, aren't you a sound engineer?
Indeed I am although over the years I have become more of a 'Support Audio Engineer' in that I support the staff Sound Engineers in terms of studio hardware (mics and mixers) and software and computer hardware. However the latter tends to step on the toes a little of our 'real' I.T. engineers.

why don't they employ a network engineer to sort it out for you? can't be a valid use of your time doing that can it?

That's just it though, we do. Two I.T. departments in fact! Unfortunately though there are multiple issues with this:

1. Neither I.T. department really wants to support us for various reasons that make no sense. Basically they each say that the other I.T. Department should help us - result is that nobody helps us.

2. One of our audio systems is one called SADiE which is software combined with proprietary hardware. Nobody in our I.T. department knows anything about SADiE whatsoever, and to be fair why should they, it's very specialised software/hardware and not something they would have come across before. Whilst SADiE might just be a Windows program there are certain things about it that don't fit into a 'bog standard office PC' approach. One very minor example is that Anti-Virus software plays havoc with it and you have to know what files or directories not to scan. I've been an audio engineer for 20 years and for 17 years I've used SADiE. To put it simply, I know more about SADiE then everyone else in my organisation combined.

3. Our I.T. departments are only really experienced about networks and PC's for general office use and wouldn't know that the choice of chipset used on the North Bridge can dramatically effect how a professional sound card operates. Again, this is not their fault. 99% of all computers in my organisation are just basic off the shelf Dell PC's which only run MS Office.

4. Our I.T. department are very slow at getting anything done. For example I logged a job with them on Monday and still nobody has even phoned to ask for more details. If we have a problem in a studio that means we can't record we need it fixed in minutes, not hours or days.

As a result I try to involve our I.T. departments as little as possible because the majority of times that they do come to fix something they end up breaking something else, simply because they don't know how our systems work, how they are integrated and how much data we are pushing around the network.

You are absolutely right though, this is a complete waste of my time, it's just that if I don't do it either:

1. Won't get fixed
2. Will take another year to be fixed
3. Will take another year to be fixed but will then have broken something else

I don't want to sound like I'm slagging off our I.T. department because there are some things they know infinitely more than me about, it's just getting them to do something and do it in a way that won't mess other things up is virtually impossible!
Logged
Tony
Administrator
Hero Member
*****
Posts: 1248



@temps
View Profile WWW Awards
« Reply #5 on: January 29, 2010, 03:21:58 PM »

Can you not hire someone from another studio on a dayrate to sort it out for you - then bill the IT dept for it?

The trouble with IT departments, is once they've written all of their forum and blog posts on what the lusers have called in about for that day and satisfied themselves that they are a higher life form, they have very little time left to come and turn things off and on again and stare blankly - it's a tough life! wink
Logged

Granty
Hero Member
*****
Posts: 507



grantyh
View Profile Awards
« Reply #6 on: February 01, 2010, 02:02:42 PM »

Check out PRTG traffic grapher. If your switches have management IP's then you can monitor the interfaces of all ports. smile That would be a good starting point before you consider installation additional NIC's in your computers.

You might also want to consider monitoring disk utilisation to.
Logged
Rosco
Global Moderator
Hero Member
*****
Posts: 907



View Profile Awards
« Reply #7 on: February 01, 2010, 07:44:51 PM »

The trouble with IT departments, is once they've written all of their forum and blog posts on what the lusers have called in about for that day and satisfied themselves that they are a higher life form, they have very little time left to come and turn things off and on again

touché big grin
Logged
Granty
Hero Member
*****
Posts: 507



grantyh
View Profile Awards
« Reply #8 on: February 01, 2010, 08:58:58 PM »

The trouble with IT departments, is once they've written all of their forum and blog posts on what the lusers have called in about for that day and satisfied themselves that they are a higher life form, they have very little time left to come and turn things off and on again

touché big grin
If only I had the time!
Logged
Matt
DDN Contribs
Hero Member
*****
Posts: 1652



View Profile WWW Awards
« Reply #9 on: February 02, 2010, 09:18:52 AM »

The trouble with IT departments, is once they've written all of their forum and blog posts on what the lusers have called in about for that day and satisfied themselves that they are a higher life form, they have very little time left to come and turn things off and on again

touché big grin
If only I had the time!

 laugh Its funny because its true!
Logged

Tony
Administrator
Hero Member
*****
Posts: 1248



@temps
View Profile WWW Awards
« Reply #10 on: February 04, 2010, 09:49:45 PM »

My god, that one was a slow burner! wink
Logged

Pages: [1]   Go Up
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF | SMF © 2006-2008, Simple Machines Valid XHTML 1.0! Valid CSS!