Performance Counter monitoring plugin

[stangowner]

PerfCount

Current Version: PerfCount 0.9
OS: XP/Vista/7 (32 & 64 bit)
PreReq: VC++ 2008 Redist

This plugin allows available Performance Counters to be added to the RivaTuner Hardware Monitoring module. Standard performance counters include detailed information about logical/physical disks, processor, processes, network, ram/paging, and much, much more. Windows includes hundreds of values that can be queried out of the box. If you're new to performance counters, you can open the performance monitor in Windows (Start->Run->perfmon<enter>). Click the '+' button to add a counter and browse the list of available categories and counters. Some software/drivers also make counters available, so you may have additional data. For instance, you'll see categories for .NET and MSSQL if you have either of those installed.

Here is an example of some of the data that can be extracted. These examples are using the ModType and ModFactor values in PerfCount.cfg for unit translation. Please read that file for additional information.



Here is a brief description of the files included in the download.
PerfCount.dll - the actual RivaTuner hardware monitoring plugin
Perfcount.cfg - the configuration for the plugin, which instructs which counters to query, any necessary formatting to perform, and other misc RivaTuner configuration information
PerfCount.rth - the RivaTuner help file for this plugin
PerfCountCLI.exe - a command line application to retreive the performance counter syntax and test reading it prior to incorporating it into the PerfCount.cfg - the proper syntax for the counters are "\\Computer\PerfObject(ParentInstance/ObjectInstance#InstanceIndex)\Counter" (\\Computer can be left out for the local machine)

Installation:
1 - Copy the PerfCount.dll and PerfCount.cfg files into the "%RivaTunerInstall%\PlugIns\Monitoring" folder
2 - Copy the PerfCount.rth file into the "%RivaTunerInstall%\Help\Plugins\Monitoring" folder
3 - Enable the plugin via the hardware monitoring setup->plugins screen

PerfCountCLI.exe can be run from any directory and is RivaTuner independent. Running the application with no arguments will prompt you to select a counter. Running it with one argument will attempt to query the counter provided as an argument. I'll incorporate human readable error codes in the future, but for now you can reference the error codes here.

Here is an example:

C:\temp>PerfCounterCLI.exe
 
Counter selected by user: \\MyPCName\Processor(_Total)\% Idle Time
Press any key to stop collection
 
"09/14/2009 09:16:07.954","94.167376908148768"
"09/14/2009 09:16:08.954","100"
"09/14/2009 09:16:09.954","98.174499329772118"
"09/14/2009 09:16:10.953","98.174499329772118"
 
C:\temp> PerfCounterCLI.exe "\Processor(_Total)\% Idle Time"
 
Counter provided via argument: \Processor(_Total)\% Idle Time
Press any key to stop collection
 
"09/14/2009 09:16:55.378","99.176279935177959"
"09/14/2009 09:16:56.378","95.169157513554609"
"09/14/2009 09:16:57.377","99.176279935177959"
 
C:\temp> PerfCounterCLI.exe "\LogicalDisk(C:)\Free Megabytes"
 
Counter provided via argument: \LogicalDisk(C:)\Free Megabytes
Press any key to stop collection
 
"09/14/2009 09:18:24.028","8338"
"09/14/2009 09:18:25.028","8338"
"09/14/2009 09:18:26.027","8338"
 
C:\temp>

NVPerfCount

Current Version: NVPerfCount 0.9.1
OS: XP/Vista/7 (32 bit OS only)
PreReq: NVIDIA PerfKit, VC++ 2008 Redist

This plugin allows GPU Performance Counters from NVIDIA's PerfKit to be added to the RivaTuner Hardware Monitoring module. Counters include detailed information about the driver, ROP, Shader, Textures, Memory and much, much more.

NVPerfCount64

Current Version: NVPerfCount64 0.9.3
OS: XP/Vista/7 (64 bit OS only)
PreReq: NVIDIA PerfKit, VC++ 2008 Redist

Same as NVPerfCount, but for 64 bit systems.
** you must use the version of PerfKit designed for 32 bit apps on 64 bit systems

- Nick

EDIT:
- Removed NVIDIA PDH information as this only works on 32 bit XP
- Removed ATI PerfStudio Information
- Added NVPerfCount and revised layout to make first post more friendly for the latest info concerning these plugins.

[Unwinder]

Awesome! Good job, Nick. Was thinking about adding a plugin for accessing OS performance counters myself a few times

P.S. Making the thread sticky

[burebista]

Yep, I've played last night a couple of hours with it and I like it. I can monitor whatever Windows counters I want but I'm stuck at nVidia ones. Probably it has something to do with my Vista64 and GTX 260.

the NVIDIA PerfKit User Manual clearly states PDH is not available on 64bit XP.

Anyway, good job stangowner. As always.

[stangowner]

Originally Posted by Unwinder

Awesome! Good job, Nick. Was thinking about adding a plugin for accessing OS performance counters myself a few times

P.S. Making the thread sticky

Hi Unwinder. Thanks for the extremely well documented SDK examples. I started with the Everest one, so you did 80% of the work

I really just need to do some work on the export option for logging. Once I do that, if you want the source so you can proof & include in the base install, just let me know

Originally Posted by burebista

Yep, I've played last night a couple of hours with it and I like it. I can monitor whatever Windows counters I want but I'm stuck at nVidia ones. Probably it has something to do with my Vista64 and GTX 260.

Anyway, good job stangowner. As always.

Hi Burebista. I have not played with PerfKit too much yet....just been trying to get the plugin done. But I have also had similar results in the few minutes I've played with it. On Win7 x64 with a GTX280, I have not been able to get the counters to show. On Vista x86 with a QuadroFX 4000, it creates the categories in perfmon, but no valid counters are available. Even when trying to query them manually, PerfCounterCLI.exe returns 0x800007D5 (PDH_NO_DATA) No data to return. So I reverted to my wife's old machine with XP and a GeForce 8800GTS just to test and prove it out. I did not spend more then a few minutes playing with it yet. When I get to some further testing, I'll post anything that may be of value.

What do you show in perfmon after enabling the driver instrumentation and adding counters via nvdevcpl.cpl? BTW - one quirk I did notice on the XP machine is even hitting "Apply" in the dev panel does not enable the counter. You actually have to click OK.

[burebista]

Man I was so sad that I wasn't able to monitor nVidia so I've uninstalled PerfKit but I'll install again today and if you want to help I'll be all ears.
All I can remember is that after adding counters via nvdevcpl.cpl in permon appear a new category (Video something, i forgot) and %GPU Busy was an entry (I'll post a screenshot in a hour or so) but I cannot make it move in your plugin.

[stangowner]

Originally Posted by burebista

Man I was so sad that I wasn't able to monitor nVidia so I've uninstalled PerfKit but I'll install again today and if you want to help I'll be all ears.
All I can remember is that after adding counters via nvdevcpl.cpl in permon appear a new category (Video something, i forgot) and %GPU Busy was an entry (I'll post a screenshot in a hour or so) but I cannot make it move in your plugin.

Yeah, I know the ATI boys have GPU Usage available....and was hoping this could make it available for us without needing to wait for the 300 series cards And my Win7x64/GTX280 machine is the one I want to monitor it on

If it displays in the perfmon window, that is a promising sign. Did you actually add it in perfmon and does it work (I used FurMark to get that 100% usage in the pic above)? If it works in perfmon, then we can test with PerfCounterCLI.exe to ensure the proper syntax. If we can get it working there, then we can just add it to PerfCount.cfg and you should be good to go.

Let me know when you have more info.

[burebista]

OK, installed again. Pick from nvdevcpl.cpl only gpu_idle and hit OK.



Then in perfmon Video Scheduler appears but with %GPU Busy as counter.



Unfortunately despite idle or Furmark load output is the same: 100 in perfmon and 0 in your PerfCounterCLI.

Now what?

[stangowner]

Originally Posted by burebista

OK, installed again. Pick from nvdevcpl.cpl only gpu_idle and hit OK.

That looks good.

Then in perfmon Video Scheduler appears but with %GPU Busy as counter.

hmmm. Are you sure Video Scheduler is not there even without PerfKit? PerfKit should add the counters under NVIDIA GPU Performance. See page 4 (pdf page 9/32) in the User Guide. This is where I found them on XP - and I used the GPU0/% gpu_idle counter that is pictured.

Unfortunately despite idle or Furmark load output is the same: 100 in perfmon and 0 in your PerfCounterCLI.

Not sure why PerfCounterCLI is outputting 0. However, it is not 100 in perfmon. The last reading was 7.4 million. Its just off the chart.

Do you show any counter categories under NVIDIA...?

[burebista]

Originally Posted by stangowner

hmmm. Are you sure Video Scheduler is not there even without PerfKit?

I've uninstalled PerfKit, reboot and Video Scheduler is still there.
So it looks like I cannot add nVidia counters.

[DSK]

Wow im really likeing theses niffty plug-ins

Great work

[chinobino]

This is a great start strangowner!

I noticed that NVIDIA System Tools v6.05 has GPU usage and GPU FB (Frame Buffer) usage stated as a percentage.

If you would like to have a look at the "NVIDIA General Purpose Ring0 driver" you can download it here.

Maybe this could be helpful...

[edit: I tested on GTX280 SLI and 8800GTX Tri-SLI and it gave valid data for both using Windows 7 64-bit]

[tswalker]

hi, i've had some troubles adding counters outside of the Win32_PerfRawData_PerfOS_System class.

Seems like the only ones I am able to do are like this:

[Source0]
ID = \System\File Read Bytes/sec
Name = Disk Mbits/sec Read
Dim = Mb/s
MaxLimit = 972
MinLimit = 0
GridDim = 10
Desc = Disk Megabits Read per Second
Group = HDD
ModType = 1
ModFactor = 0.00000762939453

[Source1]
ID = \System\File Write Bytes/sec
Name = Disk Mbits/sec Write
Dim = Mb/s
MaxLimit = 972
MinLimit = 0
GridDim = 10
Desc = Disk Megabits Write per Second
Group = HDD
ModType = 1
ModFactor = 0.00000762939453


I am able to add "\Processor(_Total)\% Processor Time"

I also am not able to add any counters from the following classes:

Win32_PerfRawData_PerfDisk_LogicalDisk
Win32_PerfRawData_PerfDisk_PhysicalDisk
Win32_PerfRawData_Tcpip_NetworkInterface

for example: when i attempt to use LogicalDisk...

C:\Temp\rivatuner_perfcounter0.9b>PerfCounterCLI "\LogicalDisk(_Total)\Avg. Disk Bytes\Transfer"
Counter provided via argument: \LogicalDisk(_Total)\Avg. Disk Bytes/Transfer
PdhAddCounter failed with status 0xc0000bb8.
C:\Temp\rivatuner_perfcounter0.9b>


oh i wanted to add that i'm using the following:
XFX 780i ISH9
Intel E6850 3.0GHz
Vista64

[stangowner]

Originally Posted by tswalker

I also am not able to add any counters from the following classes:

Win32_PerfRawData_PerfDisk_LogicalDisk
Win32_PerfRawData_PerfDisk_PhysicalDisk
Win32_PerfRawData_Tcpip_NetworkInterface

for example: when i attempt to use LogicalDisk...

C:\Temp\rivatuner_perfcounter0.9b>PerfCounterCLI "\LogicalDisk(_Total)\Avg. Disk Bytes\Transfer"
Counter provided via argument: \LogicalDisk(_Total)\Avg. Disk Bytes/Transfer
PdhAddCounter failed with status 0xc0000bb8.
C:\Temp\rivatuner_perfcounter0.9b>

I tried querying a few of the LogicalDisk and PhysicalDisk counters and could not either. But I was getting error 0xc0000bc0(Unable to parse the counter path. Check the format and syntax of the specified path.), not 0xc0000bb8 (The specified object is not found on the system.).

I opened one in perfmon, and it was fine. So I tried an elevated command prompt.....and it worked??!!! So I went back to my normal user prompt and it works there too now. That is weird. So I rebooted and tried those again, along with a network interface counter.....and it all works. I have no idea why, unless accessing it the first time as an admin registers the counter.

Here is my PC (Win7x64 RTM) accessing those values:

C:\Users\Nick>cd "c:\temp\PerfCount_v0.9"
c:\temp\PerfCount_v0.9>PerfCounterCLI.exe
Counter selected by user: \LogicalDisk(_Total)\Avg. Disk Bytes/Transfer
Press any key to stop collection
"10/16/2009 18:57:59.684","14484.737430167597"
"10/16/2009 18:58:00.698","63511.54022988506"
"10/16/2009 18:58:01.712","21504"
"10/16/2009 18:58:02.726","16756.363636363636"

c:\temp\PerfCount_v0.9>PerfCounterCLI.exe
Counter selected by user: \PhysicalDisk(_Total)\Avg. Disk Bytes/Transfer
Press any key to stop collection
"10/16/2009 18:58:53.957","4096"
"10/16/2009 18:58:54.971","0"
"10/16/2009 18:58:55.985","3840"
"10/16/2009 18:58:56.999","5266.2857142857147"
"10/16/2009 18:58:58.013","0"

c:\temp\PerfCount_v0.9>PerfCounterCLI.exe
Counter selected by user: \Network Interface(*)\Bytes Total/sec
Press any key to stop collection
"10/16/2009 19:00:17.059","0"
"10/16/2009 19:00:18.073","0"
"10/16/2009 19:00:19.087","209.07586571673687"
"10/16/2009 19:00:20.101","0"
"10/16/2009 19:00:21.115","504.94927819824369"
"10/16/2009 19:00:22.129","209.07683446508995"
"10/16/2009 19:00:23.143","0"
"10/16/2009 19:00:24.157","0"
c:\temp\PerfCount_v0.9>

Do they work in perfmon? Also, maybe try PerfCounterCLI.exe again from an elevated command prompt.

Please let me know how you make out.

[tswalker]

i elevated cmd privs with no luck and same errors, perfmon does show the counters though.. of course UAC always kicks in when i start that app. but that shouldn't effect cmd when i execute it as admin.

(elevated cmd)





just to make sure i was not getting any typos, i saved the config (.tsv) from perfmon to see what the counter, instance, and objects are... i'm 99% sure i'm using them correctly.

[stangowner]

Originally Posted by tswalker

i elevated cmd privs with no luck and same errors, perfmon does show the counters though.. of course UAC always kicks in when i start that app. but that shouldn't effect cmd when i execute it as admin.

true

just to make sure i was not getting any typos, i saved the config (.tsv) from perfmon to see what the counter, instance, and objects are... i'm 99% sure i'm using them correctly.

you can always just run the app without an argument and it gives you the dialog to select the counter from - and prints what you selected to the screen


I just booted into a fresh install of Vista x64 SP2. I installed a video driver and rebooted. Then installed the VC++ 2008 Redistributable and tried to run the PerfCounterCLI.exe. I never opened perfmon or an elevated command prompt, and did not even run Windows update. I successfully queried the following:

\PhysicalDisk(_Total)\Avg. Disk Bytes/Transfer
\LogicalDisk(_Total)\Avg. Disk Bytes/Transfer
\LogicalDisk(C:)\Avg. Disk Bytes/Transfer
\Network Interface(NVIDIA nForce Networking Controller)\Bytes Total/sec

I looked to see if there were any fixes for PDH on Vista. I found one, but it is concerning memory leaks. But anyways, can you tell me what versions you have for pdh.dll? Here is what I am showing on this fresh install.

version: 6.0.6002.18005 for both of these files:
C:\Windows\System32\pdh.dll
C:\Windows\SysWOW64\pdh.dll

I'm not sure what to do at this point. I can not even reproduce the issue to try and resolve it. I'll continue to test/ivestigate though.

[tswalker]

hi, i also have versions 6.0.6002.18005

i executed perfcountercli gui instead of at the cmd line and the list of counters available doesn't list PhysicalDisk, LogicalDisk, nor Network Inteface ... that seems strange!

o.O

i wonder why it is not showing up in your tool.. maybe that is a good starting point?

let me know if you want me to run some type of debug or special check.

[tswalker]

i must apologize, i had been busy with work tasks and have not been able to perform what you requested.

i also am in the process of installing windows 7, x64

i saved an image of the Vista x64 system i was using, if i get a chance to go back sometime to verify your requests i will.

i think though first, i will attempt to get win7x64 going and will also test your tool. so far i like this OS much better.

[stangowner]

NP. Thanks for the update. Let me know how you make out on the new system.

[tswalker]

well.. got win7x64 up and running.. latest nvidia drivers and such. runs good.

one good thing though, PerfCounterCLI works great and see's all of the system's counters (including the ones that were missing before!).. good right?

well... in rivatuner hardware monitoring, eventhough i can enable PerfCount.dll in the plugins, none of the counters i setup in perfcount.cfg are showing up to enable them >.<

not sure what the disconnect is there... still working on it.

[stangowner]

Great.....progress

Was it working with just the 3 standard ones in the default config? Can you post or pm me your config?

[tswalker]

hi, it does not seem to work with default config you have provided either. no counters defined in the file are showing up in the hardware monitoring > setup > data sources list.

the config i setup was:
[Settings]
Export = 0

[Source0]
ID = \LogicalDisk(_Total)\Avg. Disk Bytes/Transfer
Name = Disk Mbits/sec Transfer
Dim = Mb/s
MaxLimit = 972
MinLimit = 0
GridDim = 10
Desc = Disk Megabits/s Average
Group = HDD
ModType = 1
ModFactor = 0.00000762939453

[Source1]
ID = \Network Interface(NVIDIA nForce 10_100_1000 Mbps Ethernet)\Bytes Received/sec
Name = Net Kb/sec Inbound
Dim = Kb/s
MaxLimit = 6000
MinLimit = 0
GridDim = 10
Desc = Net Kilobits/s Received
Group = HDD
ModType = 1
ModFactor = 0.0078125

[Source2]
ID = \Network Interface(NVIDIA nForce 10_100_1000 Mbps Ethernet)\Bytes Sent/sec
Name = Net Kb/sec Outbound
Dim = Kb/s
MaxLimit = 6000
MinLimit = 0
GridDim = 10
Desc = Net Kilobits/s Sent
Group = HDD
ModType = 1
ModFactor = 0.0078125

[Source3]
ID = \Processor(_Total)\% Processor Time
Name = CPU Usage
Dim = %
MaxLimit = 100
MinLimit = 0
GridDim = 10
Desc = Processor Usage Time
Group = CPU
ModType = 0

[stangowner]

I just copied and pasted your cfg into mine. I changed the name of the network controller and added the last ModFactor that was missing. Here is the final cfg.

[Settings]
Export  = 0
 
[Source0]
ID = \LogicalDisk(_Total)\Avg. Disk Bytes/Transfer
Name = Disk Mbits/sec Transfer
Dim = Mb/s
MaxLimit = 972
MinLimit = 0
GridDim = 10
Desc = Disk Megabits/s Average
Group = HDD
ModType = 1
ModFactor = 0.00000762939453
 
[Source1]
ID = \Network Interface(NVIDIA nForce Networking Controller)\Bytes Received/sec
Name = Net Kb/sec Inbound
Dim = Kb/s
MaxLimit = 6000
MinLimit = 0
GridDim = 10
Desc = Net Kilobits/s Received
Group = HDD
ModType = 1
ModFactor = 0.0078125
 
[Source2]
ID = \Network Interface(NVIDIA nForce Networking Controller)\Bytes Sent/sec
Name = Net Kb/sec Outbound
Dim = Kb/s
MaxLimit = 6000
MinLimit = 0
GridDim = 10
Desc = Net Kilobits/s Sent
Group = HDD
ModType = 1
ModFactor = 0.0078125
 
[Source3]
ID = \Processor(_Total)\% Processor Time
Name = CPU Usage
Dim = %
MaxLimit = 100
MinLimit = 0
GridDim = 10
Desc = Processor Usage Time
Group = CPU
ModType = 0 
ModFactor = 1024

I had to restart RT (not just disable & enable the plugin), but it is working fine. I started a large download to test the network transfer readings.



You can query all those fine with PerfCounterCLI.exe? EDIT: Nevermind, you already answered yes to this.

Maybe to simplify just try one at a time? Do any of them work?

[tswalker]

i simplified the config file to a single entry:

[Settings]
Export = 0

[Source0]
ID = \LogicalDisk(_Total)\Avg. Disk Bytes/Transfer
Name = Disk Mbits/sec Transfer
Dim = Mb/s
MaxLimit = 972
MinLimit = 0
GridDim = 10
Desc = Disk Megabits/s Average
Group = HDD
ModType = 1
ModFactor = 0.00000762939453


and no, it is not working >.<

[tswalker]

here's some event details i've been seeing:

Log Name: Application
Source: SideBySide
Date: 10/20/2009 2:31:56 PM
Event ID: 33
Task Category: None
Level: Error
Keywords: Classic
User: N/A
Computer: PC
Description:
Activation context generation failed for "C:\Program Files (x86)\RivaTuner v2.24c\PlugIns\Monitoring\PerfCount.dll". Dependent Assembly Microsoft.VC90.MFC,processorArchitecture="x86",pub licKeyToken="1fc8b3b9a1e18e3b",type="win32",versio n="9.0.21022.8" could not be found. Please use sxstrace.exe for detailed diagnosis.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="SideBySide" />
<EventID Qualifiers="49409">33</EventID>
<Level>2</Level>
<Task>0</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2009-10-20T19:31:56.000000000Z" />
<EventRecordID>937</EventRecordID>
<Channel>Application</Channel>
<Computer>PC</Computer>
<Security />
</System>
<EventData>
<Data>Microsoft.VC90.MFC,processorArchitecture="x8 6",publicKeyToken="1fc8b3b9a1e18e3b",type="win32", version="9.0.21022.8"</Data>
<Data>
</Data>
<Data>
</Data>
<Data>
</Data>
<Data>
</Data>
<Data>
</Data>
<Data>
</Data>
<Data>
</Data>
<Data>
</Data>
<Data>
</Data>
<Data>C:\Program Files (x86)\RivaTuner v2.24c\PlugIns\Monitoring\PerfCount.dll</Data>
<Data>
</Data>
<Data>
</Data>
<Data>
</Data>
<Data>
</Data>
<Data>
</Data>
<Data>
</Data>
<Data>
</Data>
<Data>
</Data>
<Data>
</Data>
</EventData>
</Event>

[tswalker]

DOH!

i'm feeling kinda dumb now

i installed only the VC++ x64 not the x86.. i have now installed both and look.. magic!