Benchmark Factory^® for Databases

Version 6.1.1

Release Notes

January 2010

Contents

Welcome to Benchmark Factory for Databases

Quest Software is pleased to make available Benchmark Factory^® for Databases 6.1 to meet your database workload testing needs. Benchmark Factory is a database performance and code scalability testing tool that simulates users executing transactions on the database and replays production workloads in non-production environments. This enables developers, DBAs, and QA teams to validate database scalability as their user load increases, application changes are made, and platform changes are implemented. Benchmark Factory is available for Oracle, SQL Server, DB2, Sybase, MySQL, and other databases via ODBC connectivity. Benchmark Factory:

• Simulates thousands of concurrent users with a minimal amount of hardware.

• Simulates database production workloads.

• Reports tests results with built-in reporting features.

Upon completion of a test execution, all test results are collected and stored in the repository for data analysis and reporting. Benchmark Factory collects a variety of informative and detailed statistics that include:

• Overall server throughput (measured in transactions per second/minute or bytes transferred).

• Detailed transaction executed statistics by individual agent workstations producing a load.

Back to Top

New in This Release

Future Direction of Benchmark Factory for Databases

Quest Software has been committed to constant improvement of Benchmark Factory® for Databases for over ten years and will maintain this commitment for the foreseeable future. Benchmark Factory® for Databases will continue to be an industry leading load testing and scalability tool for the DBA and database developers. We will maintain our heterogeneous support for database platforms, including native support for Oracle and MS SQL Server, and support for DB2, MySQL, and Sybase via ODBC. We are committed to continued integration with our flagship Toad for Oracle product, hugely popular amongst Oracle developers and DBAs alike over the last ten years.

Because our focus is on the DBA and Developer user community and not necessarily on the large scale performance testing market, Quest software will be providing a more focused approach to supporting this customer base by limiting the amount of concurrent virtual users that will be supported on a single test. Moving forward, we will support only those instances where users are testing concurrent user loads no greater than 2,500 virtual users in a single test. This support limitation will also apply to the use of Benchmark Factory Agents. Quest Software will support no more than five agents in a single test scenario. While the product currently allows user loads and agent distribution greater than the afore mentioned amounts, support will only be provided in those scenarios where the user is working within the designated parameters.

This change is effective on Sep 17, 2008 for all supported versions of Benchmark Factory for Databases.

In future releases of Benchmark Factory® for Databases, we will be building these limits into the tool but until then, this will serve as notification that the support offering for Benchmark Factory has changed with the strategy of the product.

New for 6.1.1

This release of Benchmark Factory for Databases provides critical bug fixes.

New for 6.1

• Support for 11gR2.
• New global variable support for BFScript.
• Enhanced bind types.

New for 6.0

• TPC-E Benchmark-The TPC-E benchmark is now available in this release for both Oracle and Microsoft SQL Server.

• Installer has been changed with the following enhancements:
                 1. Option to remove all user modified/created files.
                 2. Option to not install the default MySQL repository.

New for 5.8

• Trace file imports for both Oracle and SQL Server with less than 1000 total SQL transaction will now be imported with the SQL transaction being shown in the Benchmark Factory user interface (this is the same as Benchmark Factory 5.7).
• Oracle trace import will be imported with the SQL information contained within XML files.
• Oracle trace import now supports ref cursors and LOB datatypes.

Back to Top

Resolved Issues and Enhancements

The following is a list of issues addressed in this release of Benchmark Factory for Databases.

Back to Top

Known Issues

The following is a list of issues known to exist at the time of this Benchmark Factory for Databases release.

Back to Top

Upgrade and Compatibility

• You may receive a 1306 error when uninstalling either the trial or commercial version of Benchmark Factory when both versions are installed at the same time. Make sure that when you uninstall that you have administrator rights or have turned off the User Access Control.

• If you have installed the Benchmark Factory for Databases Beta, uninstall first, before installing the latest version.

• Older versions of Benchmark Factory may not work using a repository created with newer version of Benchmark Factory.

• Client libraries for database types used during the load testing process must be installed on all testing machines (Benchmark Factory console and Agents).

• The Benchmark Factory 3.3 files and below can be converted to newer versions of Benchmark Factory files. A project conversion program is available, and can be accessed by logging on to Quest Software, then select Downloads and Upgrades|Benchmark Factory for Databases|Special Patches| Benchmark Factory Project Converter.zip.

• There is no upgrade path for the Benchmark Factory Repository version 3.3 or below.

Licensing

• New Benchmark Factory users or users upgrading from versions 3.3 or below, will enter a new license key provided by Quest Software.
• Benchmark Factory for Oracle 4.0 users will enter the current Benchmark Factory for Oracle license key.
• Quest Central Load Generator 4.0 and above users will enter the current Quest Central license key.

Back to Top

System Requirements

Before installing Benchmark Factory for Databases, ensure your system meets the following minimum hardware and software requirements:

Back to Top

Global Operations

This section contains information about installing and operating this product in non-English configurations, such as those needed by customers outside of North America. This section does not replace the materials about supported platforms and configurations found elsewhere in the product documentation.

The platforms and configurations supported in this release may use any time zone, character encoding, language, or locale configuration to operate this product. All components of this product must/should be configured to use the same or compatible character encodings and must/should be installed to use the same locale and/or regional options.

This release has been tested with the following language and platform combinations in addition to U.S. English:

• English (UK)
• German
• French
• Spanish
• Japanese
• Korean
• Chinese
• Polish
• Hebrew

Back to Top

Getting Started

Contents of the Release Package

The Benchmark Factory for Databases release package contains the following products:

1. Benchmark Factory for Databases version 6.1.1
2. Product Documentation, including:
   • Release Notes
   • Online Help
   • User Guide

Back to Top

For More Information

Contacting Quest Software:

Refer to our web site for regional and international office information.

Contacting Quest Support:

Quest Support is available to customers who have a trial version of a Quest product or who have purchased a commercial version and have a valid maintenance contract.
Quest Support provides around the clock coverage with SupportLink, our web self-service. Visit SupportLink at http://support.quest.com.

From SupportLink, you can do the following:

• Quickly find thousands of solutions (Knowledgebase articles/documents).
• Download patches and upgrades.
• Seek help from a Support engineer.
• Log and update your case, and check its status.

View the Global Support Guide for a detailed explanation of support programs, online services, contact information, and policy and procedures.

The guide is available at: http://support.quest.com/pdfs/Global Support Guide.pdf.

Back to Top

© 2010 Quest Software, Inc.

ALL RIGHTS RESERVED.

This document contains proprietary information protected by copyright. The software described in this document is furnished under a software license or nondisclosure agreement. This software may be used or copied only in accordance with the terms of the applicable agreement. No part of this guide may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying and recording for any purpose other than the purchaser’s personal use without the written permission of Quest Software, Inc.

If you have any questions regarding your potential use of this material, contact:

Refer to our web site for regional and international office information.

Trademarks

Quest, Quest Software, the Quest Software logo, AccessManager, ActiveRoles, Aelita, Akonix, AppAssure, Benchmark Factory, Big Brother, BusinessInsight, ChangeAuditor, ChangeManager, DeployDirector, DirectoryAnalyzer, DirectoryTroubleshooter, DS Analyzer, DS Expert, ERDisk, Foglight, GPOADmin, Imceda, IntelliProfile, InTrust, Invirtus, iToken, I/Watch, JClass, Jint, JProbe, LeccoTech, LiteSpeed, LiveReorg, LogADmin, MessageStats, Monosphere, NBSpool, NetBase, NetControl, Npulse, NetPro, PassGo, PerformaSure, Quest Central, Quest vToolkit, Quest vWorkSpace, ReportADmin, RestoreADmin, SelfServiceADmin, SharePlex, Sitraka, SmartAlarm, Spotlight, SQL LiteSpeed, SQL Navigator, SQL Watch, SQLab, Stat, StealthCollect, Storage Horizon, Tag and Follow, Toad, T.O.A.D., Toad World, vAutomator, vControl, vConverter, vFoglight, vOptimizer Pro, vPackager, vRanger, vRanger Pro, vSpotlight, vStream, vToad, Vintela, Virtual DBA, VizionCore, Vizioncore vAutomation Suite, Vizioncore vBackup, Vizioncore vEssentials, Vizioncore vMigrator, Vizioncore vReplicator, Vizioncore vTraffic, Vizioncore vWorkflow, WebDefender, Webthority, Xaffire, and XRT are trademarks and registered trademarks of Quest Software, Inc in the United States of America and other countries. Other trademarks and registered trademarks used in this guide are property of their respective owners.

Disclaimer

The information in this document is provided in connection with Quest products. No license, express or implied, by estoppel or otherwise, to any intellectual property right is granted by this document or in connection with the sale of Quest products. EXCEPT AS SET FORTH IN QUEST'S TERMS AND CONDITIONS AS SPECIFIED IN THE LICENSE AGREEMENT FOR THIS PRODUCT, QUEST ASSUMES NO LIABILITY WHATSOEVER AND DISCLAIMS ANY EXPRESS, IMPLIED OR STATUTORY WARRANTY RELATING TO ITS PRODUCTS INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTY OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE, OR NON-INFRINGEMENT. IN NO EVENT SHALL QUEST BE LIABLE FOR ANY DIRECT, INDIRECT, CONSEQUENTIAL, PUNITIVE, SPECIAL OR INCIDENTAL DAMAGES (INCLUDING, WITHOUT LIMITATION, DAMAGES FOR LOSS OF PROFITS, BUSINESS INTERRUPTION OR LOSS OF INFORMATION) ARISING OUT OF THE USE OR INABILITY TO USE THIS DOCUMENT, EVEN IF QUEST HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. Quest makes no representations or warranties with respect to the accuracy or completeness of the contents of this document and reserves the right to make changes to specifications and product descriptions at any time without notice. Quest does not make any commitment to update the information contained in this document.

Back to Top