Author Topic: Network monitoring  (Read 1998 times)

55starchief

  • Trainee Gangsta
  • *
  • Posts: 16201
    • View Profile
Network monitoring
« on: November 04, 2007, 11:44:12 pm »
Anyone know of any osx network monitoring tools? I want to keep track of the access on my ftp, uploads and downloads



art b

  • Pro Pimp
  • *
  • Posts: 8917
    • View Profile
Network monitoring
« Reply #1 on: November 04, 2007, 11:59:01 pm »
luckily no ..............or id be a geek/nerd...........
This forum needs, ''YOU'' posting,Not just reading ! :moon:

Rob

  • Filthy Ho
  • *
  • Posts: 2515
    • View Profile
Network monitoring
« Reply #2 on: November 05, 2007, 01:46:32 am »

F Body

  • Trainee Gangsta
  • *
  • Posts: 15551
    • View Profile
Network monitoring
« Reply #3 on: November 05, 2007, 07:14:05 am »
Quoting: 55starchief
I want to keep track of the access on my ftp


What's a FTP

Oh...... Full Thread Porn

Cunning Plan

  • Mega Ho
  • *
  • Posts: 5452
    • View Profile
Network monitoring
« Reply #4 on: November 05, 2007, 08:42:22 am »
Quoting: F Body
FTP


File Transfer Protocall

But no
1968 VW T2 Bay Bus (currently being restored and upgraded)
1999 Jeep Cherokee XJ (modern classic daily driver)

55starchief

  • Trainee Gangsta
  • *
  • Posts: 16201
    • View Profile
Network monitoring
« Reply #5 on: November 05, 2007, 09:58:36 am »
It was meant for HRC, guess i should have PM'd him seeing as most people on here use windozzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzzz

HardRockCamaro

  • Low Down Dirty ho
  • *
  • Posts: 3331
    • View Profile
    • http://www.lightsourcemedia.co.uk
Network monitoring
« Reply #6 on: November 05, 2007, 10:55:32 am »
Hello mate!


What exactly do you want to monitor?

Your bandwidth usage on your broadband connection at home?
If so do you need to break it down by service (eg web browsing, email, ftp )?

The available/unavailable status of a far away web site?
If so, uptime, bandwidth usage, detailed web stats etc?


Before you answer I'll let you know a couple of things:

1) Bandwidth usage on your broadband is not too difficult
2) Breaking it down by service is
3) Availbility of a website is easy
4) Web stats for a site are generally easy


Note, when I say difficult the answer can mean that it depends on your network equipment, can be expensive (for a home user), needs a lot of tech knowledge to setup.

55starchief

  • Trainee Gangsta
  • *
  • Posts: 16201
    • View Profile
Network monitoring
« Reply #7 on: November 05, 2007, 11:03:37 am »
Quoting: HardRockCamaro
What exactly do you want to monitor?


Morning matey,

Here is what i have:

Netgear DG834 with a Lacie 1TB Big Ethernet Disc running as an FTP. I have a few friends dumping stuff on the drive but the lacie software sucks as it doesnt tell me how much is being uploaded and downloaded and how much bandwidth is being used

I can see the drive in istat pro so i know how much space is free and used without having to access the admin cp on the drive

Allanv

  • Trainee Ho
  • *
  • Posts: 330
    • View Profile
Network monitoring
« Reply #8 on: November 05, 2007, 12:35:00 pm »
doesnt the FTP software have logging to tell you that?

55starchief

  • Trainee Gangsta
  • *
  • Posts: 16201
    • View Profile
Network monitoring
« Reply #9 on: November 05, 2007, 12:36:52 pm »
Quoting: Allanv

doesnt the FTP software have logging to tell you that?



yeah but it sucks ass, it doesnt say what the upload download is. It does tell you which users are online and how much space is free but you have to access it by its IP then login as the admin to see the info.

What i want is a widget or a program i can run on the laptop that i use all the time so i can see whats going on

HardRockCamaro

  • Low Down Dirty ho
  • *
  • Posts: 3331
    • View Profile
    • http://www.lightsourcemedia.co.uk
Network monitoring
« Reply #10 on: November 05, 2007, 01:34:22 pm »
Hmm...

Although it seems like it should be an easy thing to do, it actually isn't.

This is gonna be a long one so pay attention...




The problem is that traffic needs to be separated by protocol and ideally by source and destination ip addresses.  This needs good "layer 3" networking gear which a broadband router is not.


1) You enable SNMP on the Netgear router and you install some software that monitors SNMP devices.  Basically what happens is that software connects to each SNMP compatible device (most computers and network devices have SNMP) and "polls" it.  The device will have a load of info that it will cough out, for example your router might have a value called "TimeConnected" which might be the length of time (often in seconds) that the router has been connected to your ISP.  It will probably also have a value for "DataPacketsIn" and "DataPacketsOut" which is a count of the number of packets coming in and out.  Chances are it will only have this figure for your net connection, not for each of the 4 switch ports on the back but you might get lucky.  The SNMP software will connect to your devices every 5 minutes or so and pull off this count figure and reset it to 0.  By doing that it knows how much data came in and out on that port(s) and can thus give you a running total for the day, week or month and even draw you a graph.  This is how we bill for server usage at work, we poll the switch and it tells us how much traffic went in and out of that servers switch port.  If your router does not report the info for the 4 internal switch ports (and chances are it does not) you will need to buy a switch that does and stick it between your router and your NAS box.
Alternatively your NAS box may respond to SNMP and give the figure to your software.

2) Even if you get the system above working, either by monitoring the switch port the NAS box is connected to or by getting the info off the NAS box, the problem is, how much of that traffic to the NAS box was to/from the internet and how much was you accessing it yourself on the local network right?  The switch port doesn't know, it just counts packets as they pass...  This is the problem we had/have at work.  Customers with 2 servers might have a situation with their servers are communicating with each other and something as simple as them sending a file from one to the other that's say 1GB in size will get counted twice, once on the port of the source server and once on the switch port of the destination server.  Oops!
So we now use something called Netflow on our Cisco routers to not only look at how much traffic came from a certain place, but where it was going to and what typer of traffic was it (eg FTP, Web etc).  But clearly you're not gonna buy a 30 grand router right?  


But your only option really is to use SNMP to monitor the traffic to the switch port that the NAS box is on but you will have to remember to bear in mind that some of that access will be you.  Hopefully you will know which access is you as on the graph that your SNMP software will give you any traffic that is faster than your internet connection can do is clearly you on the local LAN.  Plus it won't break it down per user for you.


Bearing those limitations in mind you will need to install something like MRTG on your Mac which will run through the Macs built-in web browser.  To do so it will also need you to install MySQL and possible PHP.  Installing PHP and MySQL is fairly straightforward but MRTG is not as easy as it could be.  And then you will need to download a MIB for each device you want to monitor (which is a config file that details the SNMP communication details for that device) and add it to MRTG.

Seriously, it's not simple unless you're a techie but it is the way it's done at most small ISP's / hosting companies...


********************************

There is no app you can just download, install and get what you want virtually automatically.

The closest to it is this:
http://dartware.com/downloads/index.html?sfx=fiveforfree&src=fiveforfree

It's called Intermapper and it runs on OSX.  I used it for a while to monitor the traffic on my home network but stopped after I had difficulty getting it to work with my bizarre router (would have been easier with a Netgear).  It gave me basic info but not the live transfer speeds (although it can with some routers).  It's very cool but you will still need to faff with it. It's by far a lot easier to use than MRTG believe me...  It can use SNMP to pull off stats from devices, but getting the "probe" configured just right for each device can be tricky and it can only pull off what information the device offers up.  So if your router or NAS box wont tell it what it needs to give you the usage graphs you'll need to buy what is called a "fully managed" switch to sit between your router and the rest of your stuff and monitor that.  Bear in mind they start at a good £150 I would have thought, just for a 10/100 version with a small amount of ports.

55starchief

  • Trainee Gangsta
  • *
  • Posts: 16201
    • View Profile
Network monitoring
« Reply #11 on: November 05, 2007, 01:54:01 pm »
Cool thats what i needed to know, the nas is only used by me to back up once a month and for me to move data off when some one has sent me a file which isnt going to be a huge amount.

Will have a look tonight,

Thanks andy, knew you would know what i needed to do

Roadkill

  • Guest
Network monitoring
« Reply #12 on: November 05, 2007, 02:15:07 pm »
Holy $hit ! Uber post, HRC.



T'was worth clicking on this thread for that alone !

Not that i understand any of it but -

F Body

  • Trainee Gangsta
  • *
  • Posts: 15551
    • View Profile
Network monitoring
« Reply #13 on: November 05, 2007, 04:39:38 pm »
Quoting: Roadkill
Holy $hit ! Uber post, HRC.



T'was worth clicking on this thread for that alone !

Not that i understand any of it but -



 

art b

  • Pro Pimp
  • *
  • Posts: 8917
    • View Profile
Network monitoring
« Reply #14 on: November 05, 2007, 09:06:41 pm »
well tbh that was a bit obvious.........
i thought it was gonna be something difficult..........

pick the bones outta that starfish.........
This forum needs, ''YOU'' posting,Not just reading ! :moon:

Roadkill

  • Guest
Network monitoring
« Reply #15 on: November 06, 2007, 09:55:50 am »
Quoting: art b
well tbh that was a bit obvious.........


All hail Artb, Expert on Network Monitoring.


Pod

  • Pro Ho
  • *
  • Posts: 1300
    • View Profile
Network monitoring
« Reply #16 on: November 06, 2007, 05:44:51 pm »
I'd have skipped everything HRC posted and just put:

http://www.mrtg.org/

Then maybe a follow up post with

mrtg + netgear + dg834 = ***************************/



Edit: I didn't know there was a swear filter on here?!

ianjpage

  • Administrator
  • Trainee Gangsta
  • *****
  • Posts: 15352
    • View Profile
Network monitoring
« Reply #17 on: November 06, 2007, 08:19:28 pm »
what word were you trying to use??

art b

  • Pro Pimp
  • *
  • Posts: 8917
    • View Profile
Network monitoring
« Reply #18 on: November 06, 2007, 09:42:33 pm »
Quoting: Roadkill
All hail Artb, Expert on Network Monitoring.



well how hard can it be................?    
This forum needs, ''YOU'' posting,Not just reading ! :moon:

philoldsmobile

  • Pro Pimp
  • *
  • Posts: 8917
    • View Profile
Network monitoring
« Reply #19 on: November 06, 2007, 10:41:26 pm »
depends on how bit the tiddies are!

art b

  • Pro Pimp
  • *
  • Posts: 8917
    • View Profile
Network monitoring
« Reply #20 on: November 06, 2007, 10:46:16 pm »
about two megapigseals per nigracycle.............roughly  
This forum needs, ''YOU'' posting,Not just reading ! :moon:

philoldsmobile

  • Pro Pimp
  • *
  • Posts: 8917
    • View Profile
Network monitoring
« Reply #21 on: November 06, 2007, 10:48:19 pm »
too small

Pod

  • Pro Ho
  • *
  • Posts: 1300
    • View Profile
Network monitoring
« Reply #22 on: November 07, 2007, 11:42:56 am »
Quoting: ianjpage
what word were you trying to use??


It's a url with f**k in it.

ianjpage

  • Administrator
  • Trainee Gangsta
  • *****
  • Posts: 15352
    • View Profile
Network monitoring
« Reply #23 on: November 07, 2007, 12:41:44 pm »
hmm obviously swear filter dont like the f word !!!

Pod

  • Pro Ho
  • *
  • Posts: 1300
    • View Profile
Network monitoring
« Reply #24 on: November 07, 2007, 12:55:26 pm »
hmm.

Try this, but remove the space in the middle:

http://justfu ckinggoogleit.com/

A link everyone should have a use for.