Discussion:
[mrtg] How to setup the mrtg for monitoring more things
Shuk Pong Leong
2008-08-16 07:56:42 UTC
Permalink
Dear All,

I just installed the following packages under windows :
mrtg-2.16.2.zip
ActivePerl 5.8.8

And running the following command lines :
1, perl mrtg
2, perl cfgmaker ***@192.168.0.1 --global "WorkDir: c:\inetpub\mrtg"
--output mrtg.cfg

1, During the testing, there are some problem for asking :
1.1 How to create the index.html file for browser which hyper link for
measuring / monitoring which device ?
1.2 How to output the daily grah every 15 mins ?
1.3 How to detect the following info ?
1.3.1 SNMP port number
1.3.2 SNMPOID
1.3.3 read-only SNMP community string

2, How to setup ( config ) the mrtg for measuring ( monitoring ) the
following hardware usage ( used ) percentage ?
2.1 CPU usage persentage.
2.2 Hard Disk usage persentage [ Total ( Read / Write ), Read, Write].
2.3 Ram ( Memory ) usage persentage [ Available MB, Page/sec ].
2.4 Network INT usage persentage [ Total ( Packets/sec ), Packets
Received/sec, Packets Sent/sec].

So, is there the sample for reference ?

Many thanks for your help !

Edward.
McDonald, Dan
2008-08-16 10:50:47 UTC
Permalink
Post by Shuk Pong Leong
Dear All,
mrtg-2.16.2.zip
ActivePerl 5.8.8
1, perl mrtg
\mrtg" --output mrtg.cfg
1.1 How to create the index.html file for browser which hyper link for
measuring / monitoring which device ?
there should be a script called indexmaker.
Post by Shuk Pong Leong
1.2 How to output the daily grah every 15 mins ?
why? It only rolls up 30-minute averages....
Post by Shuk Pong Leong
1.3 How to detect the following info ?
1.3.1 SNMP port number
1.3.2 SNMPOID
1.3.3 read-only SNMP community string
Sorry, we are not hackers. That information should be provided by the
network administrator.
Post by Shuk Pong Leong
2, How to setup ( config ) the mrtg for measuring ( monitoring ) the
following hardware usage ( used ) percentage ?
2.1 CPU usage persentage.
That really depends on the platform. But I have a template that tends
to work ok for Windows 2000 using the built-in snmp agent. If you have
some other agent, there is no telling...

[***@ldap ~]$ cat /var/mrtg/cfg/w2kcpu.template
$head_lines .= <<ECHO
#.....................................................................
# Windows 2000 processor utilization. Based on MIBII Host MIB.
#
#Vendor Specific Auto-Discovery Entry:
# 1.3.6.1.2.1.25.3.3.1.2|1.3.6.1.2.1.25.3.3.1.2|microsoft_win2k_cpu|
tree|CPU Utilization
#
# Example CFGNAME: [DEVICE NAME]-percent_processor_util
# (add instance number to the end of the name for multiple processors)

ECHO
;
my (@temp) = snmpwalk($router_connect,'1.3.6.1.2.1.25.3.3.1.2');
foreach my $tempi(@temp) {
$tempi =~ /(\d+):\d/;
my $instance=$1;
my $target_name=$router_name.".cpu".$instance;
$target_lines .= <<CPU
Target[$target_name]:
1.3.6.1.2.1.25.3.3.1.2.$instance&1.3.6.1.2.1.25.3.3.1.2.$instance:
$router_connect
MaxBytes[$target_name]: 100
routers.cgi*ShortDesc[$target_name]: CPU # $instance
bb*host[$target_name]: $router_name
bb*svc[$target_name]: cpu
bb*red[$target_name]: 90
bb*yellow[$target_name]: 80
Options[$target_name]: gauge, unknaszero, noo
Directory[$target_name]: $directory_name
WithPeak[$target_name]: wmy
YLegend[$target_name]: % Utilization
ShortLegend[$target_name]: %
Legend1[$target_name]: Proc Load in next minute
Legend3[$target_name]: Maximal 5 Minute Proc Load
LegendI[$target_name]: Load:
Title[$target_name]: $sysname
PageTop[$target_name]: <H1>$sysname Processor Load</H1>
<TABLE>
<TR><TD>System:</TD><TD>$sysname </TD></TR>
<TR><TD>Location:</TD><TD>$syslocation </TD></TR>
</TABLE>
CPU
;
}

snmpMIB_to_OID("/usr/share/snmp/mibs/HOST-RESOURCES-MIB.txt");
my (@temp) = snmpwalk($router_connect,'hrStorageAllocationUnits');
foreach my $tempi(@temp) {
$tempi =~ /(\d+):(\d+)/;
next if $2 == 0;
my $instance=$1;
my $blocksize=$2;
my ($diskname, $disksize) =
snmpget($router_connect,'hrStorageDescr.'.$instance,
'hrStorageSize.'.$instance);
my $shortdisk= $instance;
if ($diskname =~ /^(\w):/) { $shortdisk = $1; }
my $target_name=$router_name.".disk.".$shortdisk;
my $maxsize = $disksize * $blocksize;
$target_lines .= <<DISK
#--------------------------------------------------------------------------------------
# WIN2000 Disk Utilization. Based on MIB II Host MIB.

Target[$target_name]:
1.3.6.1.2.1.25.2.3.1.6.$instance&1.3.6.1.2.1.25.2.3.1.6.$instance:
$router_connect * $blocksize
YLegend[$target_name]: KBytes Used
Options[$target_name]: gauge, unknaszero, noo
Directory[$target_name]: $directory_name
MaxBytes[$target_name]: $maxsize
ShortLegend[$target_name]: bytes
routers.cgi*ShortDesc[$target_name]: Drive $shortdisk:
bb*host[$target_name]: $router_name
bb*svc[$target_name]: disk
bb*red[$target_name]: 95%
bb*yellow[$target_name]: 92%
kilo[$target_name]: 1024
Legend1[$target_name]: Disk Used
Legend3[$target_name]: Max value per interval on graph
LegendI[$target_name]: Disk Used
WithPeak[$target_name]: ymw
Title[$target_name]: $sysname
PageTop[$target_name]: <H1>$diskname on $sysname/H1>
<TABLE>
<TR><TD>System:</TD><TD>$sysname </TD></TR>
<TR><TD>Location:</TD><TD>$syslocation </TD></TR>
</TABLE>
DISK
;
}
Post by Shuk Pong Leong
2.2 Hard Disk usage persentage [ Total ( Read / Write ), Read, Write].
2.3 Ram ( Memory ) usage persentage [ Available MB, Page/sec ].
2.4 Network INT usage persentage [ Total ( Packets/sec ), Packets
Received/sec, Packets Sent/sec].
packets per second doesn't have a hard maximum - as the packet size gets
larger, the max goes down. It's not a terribly interesting figure.
--
Daniel J McDonald, CCIE #2495, CISSP #78281, CNX
Austin Energy
http://www.austinenergy.com
Nico Kadel-Garcia
2008-08-16 11:00:42 UTC
Permalink
Post by McDonald, Dan
Post by Shuk Pong Leong
Dear All,
mrtg-2.16.2.zip
ActivePerl 5.8.8
1, perl mrtg
\mrtg" --output mrtg.cfg
1.1 How to create the index.html file for browser which hyper link for
measuring / monitoring which device ?
there should be a script called indexmaker.
OK, answering a newbie's question without actually answering the
question. Strike one. (I'll leave out when you did this to me the other
day.)
Post by McDonald, Dan
Post by Shuk Pong Leong
1.2 How to output the daily grah every 15 mins ?
why? It only rolls up 30-minute averages....
OK, strike two. He wants every 15 minutes, can it be tweaked or not?
Post by McDonald, Dan
Post by Shuk Pong Leong
1.3 How to detect the following info ?
1.3.1 SNMP port number
1.3.2 SNMPOID
1.3.3 read-only SNMP community string
Sorry, we are not hackers. That information should be provided by the
network administrator.
Strike three. This guy probably *is* the systems administrator: not all
of us have enough knowledge to trivially deduct this stuff.

For one thing, I am a hacker. And this sort of 'hacking' is exactly what
a sys-admin or network admin needs to do as part of their job.

Leong? (Is that the right way to address you informally?) There have
been scripts published, such as cfgstoragemaker, to generate .cfg files
with precisely this sort of information. I've had poor success with it
since RHEL 4, and keep meaning to try to update it, but failing. Even if
they don't work for you, they should give you a better idea about how to
roll your own.
Post by McDonald, Dan
Post by Shuk Pong Leong
2, How to setup ( config ) the mrtg for measuring ( monitoring ) the
following hardware usage ( used ) percentage ?
2.1 CPU usage persentage.
That really depends on the platform. But I have a template that tends
to work ok for Windows 2000 using the built-in snmp agent. If you have
some other agent, there is no telling...
And then you went on to give a usable example. But Dan, please ease up
on the newbies. We should foster them, even if they're asking questions
that they'd find in the documentation. In this case, the setup of
templates is awkward.
Post by McDonald, Dan
Post by Shuk Pong Leong
2.2 Hard Disk usage persentage [ Total ( Read / Write ), Read, Write].
2.3 Ram ( Memory ) usage persentage [ Available MB, Page/sec ].
This is usually reported via 'hrStorage' SNMP settings by tools like
cfgstoragemaker with MRTG, but I've been having trouble with it for a
while now.
Post by McDonald, Dan
Post by Shuk Pong Leong
2.4 Network INT usage persentage [ Total ( Packets/sec ), Packets
Received/sec, Packets Sent/sec].
packets per second doesn't have a hard maximum - as the packet size gets
larger, the max goes down. It's not a terribly interesting figure.
Also an interesting point.
McDonald, Dan
2008-08-16 11:56:27 UTC
Permalink
Post by Shuk Pong Leong
Post by Shuk Pong Leong
1.1 How to create the index.html file for browser which
hyper link for
Post by Shuk Pong Leong
measuring / monitoring which device ?
there should be a script called indexmaker.
Is there sample command line for creating ?
indexmaker --output=index.html mrtg.cfg

See http://oss.oetiker.ch/mrtg/doc/indexmaker.en.html
Post by Shuk Pong Leong
Post by Shuk Pong Leong
1.2 How to output the daily grah every 15 mins ?
why? It only rolls up 30-minute averages....
By default, it ouput the daily graph every 5 mins...
Oh, right. I was thinking about the weekly graph.
Post by Shuk Pong Leong
So, how to re-config the mrtg, then output the graph every 15 mins ?
Add an Interval: statement to your config:

Interval: 15

See http://oss.oetiker.ch/mrtg/doc/mrtg-reference.en.htm and search for
Interval
Post by Shuk Pong Leong
Post by Shuk Pong Leong
1.3 How to detect the following info ?
1.3.1 SNMP port number
1.3.2 SNMPOID
1.3.3 read-only SNMP community string
Sorry, we are not hackers. That information should be
provided by the
network administrator.
------------------------------------------------------------------------------------------------------------------------
http://oss.oetiker.ch/mrtg/doc/mrtg-nt-guide.en.html
CONFIGURING MRTG
Now it is time to create a configuration for MRTG. But before we begin
you need to know a few things. Take an opportunity to gather the
* The IP address or hostname and the SNMP port number, (if non
standard), of the device you want to monitor.
* If you want to monitor something other than bytes in and out,
you must also know the SNMPOID of what you want to monitor.
* Finally you need to know the read-only SNMP community string
for your device. If you don't know it, try public, that is the
default.
So, I want to know how to get the info of SNMP ?
I have no idea, since I don't run windows. There are 5 or 6 common 3rd
party snmp agents for windows, in addition to the really nasty one that
Microsoft provides, that are all configured differently. I have no idea
which one you are using or how you would configure it.
Post by Shuk Pong Leong
------------------------------------------------------------------------------------------------------------------------
Post by Shuk Pong Leong
2, How to setup ( config ) the mrtg for measuring ( monitoring ) the
following hardware usage ( used ) percentage ?
2.1 CPU usage persentage.
That really depends on the platform. But I have a template that tends
to work ok for Windows 2000 using the built-in snmp agent. If you have
some other agent, there is no telling...
Sorry, the script files seems running with Linux / Unix System,
right ?
cfgmaker has a --host-template option that allows you to use perl-based
templates. There is one path (to the host-resources-mib) that is
posix-like, but if you change that to a windows-like path and the file
is there, then it should work fine on any platform.

from http://oss.oetiker.ch/mrtg/doc/cfgmaker.en.html
--host-template=templatefile
In addition to creating targets for a host's interfaces
do also create targets for the host itself as specified
by the contents in the file templatefile. The file is
supposed to contain Perl code to be executed to generate
the lines for the host related targets (such as CPU,
ping response time measurements etc.) in the config-
uration file.
(Experimental, under development, might change)
--
Daniel J McDonald, CCIE #2495, CISSP #78281, CNX
Austin Energy
http://www.austinenergy.com
Steve Shipway
2008-08-17 22:40:08 UTC
Permalink
Post by McDonald, Dan
Post by McDonald, Dan
Post by Shuk Pong Leong
1.2 How to output the daily grah every 15 mins ?
why? It only rolls up 30-minute averages....
By default, it ouput the daily graph every 5 mins...
Oh, right. I was thinking about the weekly graph.
The daily graph updates every 5 mins, of course. You can change the auto-update frequency of the web pages in the browser (I cant remember the directive offhand) although there's not much point in doing that really.
Post by McDonald, Dan
Post by McDonald, Dan
So, how to re-config the mrtg, then output the graph every 15 mins ?
Interval: 15
Sort of. If you do this, *and delete the .log file*, then you'll get a 15min interval; although of course you'll want to then run data collection every 15mins as well. What it wont do is change your daily graph to a 3-day graph; you'll just end up with a blockier daily graph.

The best solution, really, is to move to using RRDtool as the backend, because then the graphs are only created when someone actually wants to see them.

There is a cfgmaker-host script that is shipped with the routers2 package, it's a bit limited (no explicit windows-mib support) but can spit our some nice MRTG config files for monitoring a variety of SNMP agents on hosts. The cfgstoragemaker script does the same for disk space monitoring, which is an awkward thing to do if you have removeable storage as the indexes keep changing. I also have a home-grown script mrtg-storage which lets you query via SNMP storage objects more portably; let me know if you need a copy.

Steve
Edward Leung
2008-08-18 03:37:57 UTC
Permalink
Dear You,


I just installed the mrtg and perl with a Windows Server 2000 machine...

BUT there is my big problem as the following :


1, Would you mind to tell me how can we to find out the SNMP port number,

SNMPOID and read-only SNMP community string of the devices / hardwares ?



2, How to setup the mrtg for measuring ( monitoring ) the following hardware
usage percentage ( Windows OS also )?

2.1 CPU usage persentage.

2.2 Hard Disk usage persentage [ Total ( Read / Write ), Read, Write].

2.3 Ram ( Memory ) usage persentage [ Available MB, Page/sec ].

2.4 Network INT usage persentage [ Total ( Packets/sec ), Packets
Received/sec, Packets Sent/sec].



So, is there the sample config ( CPU, HD, Ram and Network INT ) for
reference ?



Many thanks for your help !



Edward.
Steve Shipway
2008-08-18 03:45:53 UTC
Permalink
1. The port number is probably the default. The OID depends on what you want to monitor: if you want network statistics, then MRTG will do this automatically. The community string should be provided to you by whoever configured and maintains SNMP on the device you are monitoring.
2. Depends on the OS you are monitoring
2.2, 2.3 these OIDs actually change depending on how many storage devices are attached
2.4 With SNMP, these come in the standard location and MRTG can monitor them directly

We use the nsclient agent under windows and the mrtg-pnsclient.pl script to query it instead of using SNMP, its easier and possibly more secure.

I suggest you concentrate first on making it work with just network traffic, and probably on network switches and routers, before trying to monitor hosts and other host-related metrics. These require not only more complex configuration to obtain the data but also you have to do other additional configuration in the labels etc.

Try to get it working in the simplest case (network traffic) first before trying to do server monitoring

Also read the MRTG configuration reference on www.mrtg.org<http://www.mrtg.org/> for more understanding of the Target[] definition.

Steve

________________________________
From: Edward Leung [mailto:***@gmail.com]
Sent: Monday, 18 August 2008 15:38
To: ***@lists.oetiker.ch
Subject: Re: [mrtg] How to setup the mrtg for monitoring more things

Dear You,

I just installed the mrtg and perl with a Windows Server 2000 machine...

BUT there is my big problem as the following :

1, Would you mind to tell me how can we to find out the SNMP port number,
SNMPOID and read-only SNMP community string of the devices / hardwares ?

2, How to setup the mrtg for measuring ( monitoring ) the following hardware usage percentage ( Windows OS also )?
2.1 CPU usage persentage.
2.2 Hard Disk usage persentage [ Total ( Read / Write ), Read, Write].
2.3 Ram ( Memory ) usage persentage [ Available MB, Page/sec ].
2.4 Network INT usage persentage [ Total ( Packets/sec ), Packets Received/sec, Packets Sent/sec].

So, is there the sample config ( CPU, HD, Ram and Network INT ) for reference ?

Many thanks for your help !

Edward.
Edward Leung
2008-08-18 05:07:28 UTC
Permalink
Dear Steve,

After installed and setup the mrtg with the Windows Server machine :
Running : perl cfgmaker ***@xxx.xxx.xxx.xxx --global "WorkDir:
c:\inetpub\mrtg" --output mrtg.cfg
Then the mrtg may be know ( Auto detect ) the snmp port of the Network INT (
Surecom-EP320G-TX-Family-Gigabit-Ethernet-NIC ) is 16777219, but what is the
SNMPOID ?

So, if this is the network traffic usage ( B/s ), then how can I create the
following hardware usage config file also ?
1, CPU
2, HD
3, Ram
4, Network INT

"We use the nsclient agent under windows and the mrtg-pnsclient.pl script to
query it instead of using SNMP" ???

Sorry, would you mind give me more help ?
All of the OS is Windows 2000 Server...

Many thanks for your help !

Edward.
Post by Steve Shipway
1. The port number is probably the default. The OID depends on what you
want to monitor: if you want network statistics, then MRTG will do this
automatically. The community string should be provided to you by whoever
configured and maintains SNMP on the device you are monitoring.
2. Depends on the OS you are monitoring
2.2, 2.3 these OIDs actually change depending on how many storage devices are attached
2.4 With SNMP, these come in the standard location and MRTG can monitor them directly
We use the nsclient agent under windows and the mrtg-pnsclient.pl script to
query it instead of using SNMP, its easier and possibly more secure.
I suggest you concentrate first on making it work with just network
traffic, and probably on network switches and routers, before trying to
monitor hosts and other host-related metrics. These require not only more
complex configuration to obtain the data but also you have to do other
additional configuration in the labels etc.
Try to get it working in the simplest case (network traffic) first before
trying to do server monitoring
Also read the MRTG configuration reference on www.mrtg.org for more
understanding of the Target[] definition.
Steve
------------------------------
*Sent:* Monday, 18 August 2008 15:38
*Subject:* Re: [mrtg] How to setup the mrtg for monitoring more things
Dear You,
I just installed the mrtg and perl with a Windows Server 2000 machine...
1, Would you mind to tell me how can we to find out the SNMP port number,
SNMPOID and read-only SNMP community string of the devices / hardwares ?
2, How to setup the mrtg for measuring ( monitoring ) the following
hardware usage percentage ( Windows OS also )?
2.1 CPU usage persentage.
2.2 Hard Disk usage persentage [ Total ( Read / Write ), Read, Write].
2.3 Ram ( Memory ) usage persentage [ Available MB, Page/sec ].
2.4 Network INT usage persentage [ Total ( Packets/sec ), Packets
Received/sec, Packets Sent/sec].
So, is there the sample config ( CPU, HD, Ram and Network INT ) for reference ?
Many thanks for your help !
Edward.
Steve Shipway
2008-08-18 05:23:49 UTC
Permalink
Then the mrtg may be know ( Auto detect ) the snmp port of the Network INT ( Surecom-EP320G-TX->Family-Gigabit-Ethernet-NIC ) is 16777219, but what is the SNMPOID ?
This is not the SNMP port, this is the SNMP interface number. You do not need to know the OID when you are monitoring network interfaces, as MRTG takes care of this for you.
So, if this is the network traffic usage ( B/s ), then how can I create the following hardware >usage config file also ?
For these, you need to know the OIDs and configure the MRTG target definitions appropriately. This can be complex and not all are necessarily supported by your system, and also not necessarily in a consistent manner (eg storage can re-enumerate itself if you insert a USB key)

The cfgmaker script only generates configuration files for network interfaces (unless you use templates, but that's a bit advanced for you at the moment)
"We use the nsclient agent under windows and the mrtg-pnsclient.pl script to query it instead of using SNMP" ???
This is a different way to obtain information, using a data collection plug-in rather than SNMP. You can read about how to do this in the MRTG manual (you've looked at this, right?). If you obtain the Routers2 frontend, in the extras directory are the query tools and some instructions on how to use them.
Sorry, would you mind give me more help ?
All of the OS is Windows 2000 Server...
The best thing for you to do is to initially try installing configuration just for network interfaces, and get this working correctly before trying to monitor something more complex like server statistics. Once you have network stats working, and you have fully read the MRTG configuration manual plus all the help on the website, you should be ready to configure to monitor other things

Steve
Edward Leung
2008-08-18 07:23:07 UTC
Permalink
Dear Steve,

1, Sorry, I don't quit to familar with SNMP...
So, please never mind !

2, Did you means :
2.1 For monitoring the Network INT, we needn't to know any info of SNMP, due
to the mrtg will auto detect by using the following command line, rgiht ?
cfgmaker ***@ipaddress
2.2 For monitoring other hardware ( such as CPU, HD and Ram ) of the Server
machines and it is running with Windwos OS System, we need to know the OIDs
( including SNMP port / INT ) and configure the MRTG target definitions,
right ?

So, for my problem is :
How can we know the OIDs ( including SNMP port / INT ) and configure the
MRTG target definitions for measuring the CPU, HD and Ram of the Server
machine ?
I just need the report about the output of usage percentage....
Is there the assistant tools and sample config file for doing this report ?

Many thanks for your help !

Edward.
c:\inetpub\mrtg" --output >mrtg.cfg
Post by Edward Leung
Then the mrtg may be know ( Auto detect ) the snmp port of the Network INT
( Surecom-EP320G-TX->Family-Gigabit-Ethernet-NIC ) is 16777219, but what is
the SNMPOID ?
This is not the SNMP port, this is the SNMP interface number. You do not
need to know the OID when you are monitoring network interfaces, as MRTG
takes care of this for you.
Post by Edward Leung
So, if this is the network traffic usage ( B/s ), then how can I create
the following hardware >usage config file also ?
For these, you need to know the OIDs and configure the MRTG target
definitions appropriately. This can be complex and not all are necessarily
supported by your system, and also not necessarily in a consistent manner
(eg storage can re-enumerate itself if you insert a USB key)
The cfgmaker script only generates configuration files for network
interfaces (unless you use templates, but that's a bit advanced for you at
the moment)
Post by Edward Leung
"We use the nsclient agent under windows and the mrtg-pnsclient.pl script
to query it instead of using SNMP" ???
This is a different way to obtain information, using a data collection
plug-in rather than SNMP. You can read about how to do this in the MRTG
manual (you've looked at this, right?). If you obtain the Routers2
frontend, in the extras directory are the query tools and some instructions
on how to use them.
Post by Edward Leung
Sorry, would you mind give me more help ?
All of the OS is Windows 2000 Server...
The best thing for you to do is to initially try installing configuration
just for network interfaces, and get this working correctly before trying to
monitor something more complex like server statistics. Once you have
network stats working, and you have fully read the MRTG configuration manual
plus all the help on the website, you should be ready to configure to
monitor other things
Steve
Steve Shipway
2008-08-18 22:18:40 UTC
Permalink
Asking how to configure MRTG to monitor generic things is a very open-ended question, due to the flexibility of MRTG.

For any SNMP-enabled device, there should be a manual showing the OIDs and their contents. The MRTG documentation will give details about how to configure for various OIDs.

There are examples on the MRTG website, but of course there are so many different things out there that it is not possible to give instructions for everything. Some templates for the cfgmaker command are available for download, and some utilities like cfgmaker-host and cfgstoragemaker are available to probe an SNMP-enabled server for commonly-known OIDs and generate the appropriate configuration files.

By far the best thing to do is to start of simply, configuring to monitor network traffic, and then work your way up once you understand the Target definition syntax and cfgmaker templates more thoroughly. There are a lot of resources available online but you need to understand the basics before building up to the more complex configurations.

In a shameless act of self-promotion, I'd like to let you all know that in a month or two a new book will be published, "Using MRTG with RRDtool and Routers2", which will hopefully be of great use to people wanting to get a MRTG installation working and also to those who want to use the more advanced features. Advance copies will be available at a discount at LISA08 in San Diego (reserve yours now!) Final price is likely to be about US$25-US$30.

Steve

Loading...