COSBI

1
COSBI
COSBI

• Comprehensive Open Source Benchmark Initiative
• Todd Keuleman
• tkeulema_at_connect.carleton.cagt
• COMP 5900 Selected Topics Open Source Software

2
Introduction

• Why COSBI selected
• Considered Asterix, Amanda, but
• wanted a simple practical application that I
  actively use.
• COSBI created by Van Smith as a personal project.
• http//www.vanshardware.com/news/2004/04/040422_OS
  Mark/040422.htm
• (His political views are his own and do not
  reflect my own views.)
• http//sourceforge.net/projects/opensourcemark/
• License
• GNU GENERAL PUBLIC LICENSE
• Version 2, June 1991

3
Purpose of COSBI

• Why Created
• He wanted an independent yet effective way to
  measure the performance of computer systems
• Wanted a flexible plug-in type framework that
  individuals can add their own tests.
• Wanted to expand his skills and knowledge
• What Problem addressed?
• Object Oriented framework for creating tests
• A way to independently test the performance
  rating of computer hardware

4
When to Use COSBI

• IT support.
• Performance of old systems
• Performance of new systems
• Performance of different configurations
• How much of a difference does 1 gig of ram make
  versus 2?
• Is a P4 2 gig system that much slower than a P4 3
  gig?
• I use this application to benchmark performance
  of windows based systems.

5
COSBI Design

• is an object oriented testing harness written in
  Borland Delphi 7
• class framework to facilitate the quick and easy
  development of new benchmarks
• Borland because it is Objected Oriented Pascal
  which is much easier to read and understand
• Delphi's Rapid Application Development (RAD)
  tools are superlative, greatly simplifying the
  production of complex GUI-based applications and
  tests

6
Windows Installation Guidelines

• Executable
• The installation executable can be downloaded
  from Sourceforge, or from Van Smiths own site.
• To install run the executable.
• Can select where the application will be
  installed.
• This creates a directory but little else.
• By going to the installation directory can click
  on the CosbiOpenSourceMark.exe

7
Source Installation Guidelines

• Installing OSMark Source Files
• unzip OSMark files into c\data\cosbi\
• Download Graphics32 library from www.g32.org
• Unzip Graphics32 zip file to c\lib\delphi\
• launch Delphi
• Open gr32_d7.dpk and choose "Install" option
• close project
• Open gr32_dsgn_d7.dbk and install
• close project
• close Delphi
• download GLScene (www.glscene.org)
• install GLScene (you may have to uncomment the
  plugin file references from the D7 dpk project
  source)
• Download ZipForge component from
  http//www.componentace.com/zip_component_zip_delp
  hi_zipforge.htm
• Run ZipForge installation program (make sure
  Delphi is closed first)
• Open Delphi and load OSMark project file
• These GLScene paths should be added to the opengl
  tests Base and Platform

8
How To Add A New Test

• Add Enumerated Type Values
• Add a New Checkbox
• add a line for the new test
• cboxMyNewTest.Checked Ini.ReadBool( 'Tests',
  'MyNewTest', TRUE )
• And in the corresponding location in routine
  procedure TfrmOSMark.WriteIniFile add
• Ini.WriteBool( 'Tests', 'MyNewTest',
  cboxMyNewTest.Checked )
• Modify OSMark Test Suite
• Write the Test
• Adding the new test to the Result Viewer.

9
Screen Shots
Version 1.0 beta 7a
Can see the tests that are selected for execution.
10
Newest Version
This version doesnt list the individual tests.
I prefer the older one.
11
Results
) Add more slides as needed
12
Results
) Add more slides as needed
13
Advantages and Disadvantages

• Advantages
• You can clearly see the tests that will be run
  and how they are run.
• You can add your own test if there is something
  in particular you want to test for.
• It is a framework.
• Source is available
• Disadvantages
• It is using some proprietary tool sets for
  development.
• The source is using a non mainstream language
• Little support
• Small community
• Issues
• Requires a lot of hard drive space on c - more
  than 150M
• Requires large amount of disk for temp storage
  (gt500m)
• Some bugs in tests filecopy.
• Saving and importing tests buggy date format
  conversion

14
Competition
PassMark 24. http//www.passmark.com/sales/inde
x.php?buyPM001 FutureMark 3DMark Vantage 7
- 20 Si Soft Sandra 99 to 300 HPC challenge
benchmark Open source benchmark
http//www.netlib.org/benchweb/
15
Ecosystem
This is a very small OSS project compared to
many. 1 developer, some users. Why partially
it is a niche area. - Tool set and language is
non standard. I suspect it will never become a
big project.
16
Demo
Is there time and can it be set up?
17
Questions
????
18
Title Page Introduction and Web URL of
Framework/Application/Utility/... Problem
Addressed/Purpose of OSS When to use and not use
the OSS Installation Guidelines Sample Usage
(with real code where possible)
Benefits/Advantages/Disadvantages Competing OSS
Packages/Frameworks Conclusion (include comments
on maturity and adaption of OSS) Who uses the
OSS and why References (books and URLs) Add
more slides as needed