Most IT managers and testers agree that functional testing is the most appropriate way to know with certainty that a software application is ready to serve users and consumers. But in our experience most people do not get to functional testing because their testing tools, utilities, and frameworks are not built for today's modern environments, including required protocols, interfaces, platforms, and techniques.
PushToTest TestMaker is a functional, end-to-end testing platform that validates the service code from interface to database and back. TestMaker intelligent test agents drive an application using native service environment protocols to achieve the following:
- Check that functions are working, configured properly, and
the service is correctly implemented and behaves correctly in main and
exceptional cases.
- Simulate real-world production environments to test
scalability under increasing levels of load.
- Prove Service Level Agreement (SLA) service delivery by periodically monitoring a service for proper function and performance.
This flexibility and ease-of-use makes the PushToTest architecture the one platform for:
- Application Testing - Avoid Downtime, Qualify Patches, Updates, Hardware Changes
- Integration Testing - Surface Performance Issues When Services Call Services
- Smoke Tests - Rapidly identify functional problems for new software builds
- Regression Testing - Surface Functionality Issues Before Customers Do
- Tool & Library Testing - Optimize Performance at the Library Level
- XML Optimization - Improve performance and scalability - AJAX, SOAP, REST
- Performance Testing - Better forecast CPU, Network, and Memory needs to meet SLAs
Ready, Set, Test
PushToTest TestMaker provides Record-and-Playback and Wizards to create functional tests of Web applications, SOAP-based Web services, Ajax, Web 2, and REST applications, and desktop applications.
The Recorders and Wizards watch your use of these applications and create a functioning unit test automatically.
TestMaker enhances these recorded unit tests by providing protocol handlers to speak the native Web, SOA, Ajax, Web Service, REST, Email, and custom network protocols of the application or service under test. Additionally TestMaker enhances unit tests with Data Production Libraries (DPLs) to provide test data as input to the unit test and data to validate the test results.
PushToTest TestMaker is a distributed test environment that takes unit tests and wraps them in a TestScenario.
A TestScenario operates the unit tests as a functional test by operating a sequence of unit tests once, as a load test by operating sequences of the unit tests in concurrently running threads, and as service monitors by running the unit tests periodically.
The TestScenario defines which TestNodes will operate the test. Each TestNode is the distributed PushToTest TestMaker environment. When the TestScenario operates the test it moves the unit test and any other resource files to the defined TestNodes. The unit test speaks the native protocols of the application under test. The TestNodes provide the unit test data through the DPL, operates the unit tests, and logs the results.
As the TestScenario operates a monitor watches the application host and logs usage and resource statistics. TestMaker correlates the monitored data to the unit test operation to identify performance bottlenecks and available optimizations.
As an example, TestMaker uses a unit test we recorded using the TestGen4Web recorder in Firefox as a load test in the following TestScenario:
This test tells TestMaker to distribute the PTT_Examples_UnitTest recorded unit test to the TestNode. The TestNode then instantiates 50 concurrently running Threads (crlevel value="50".) Each thread instantiates a PTT_Examples_UnitTest test agent, and then repeatidly calls the recorded business flow for the duration of the test. At the end of the test the TestNode ends the 50 running Threads, and then repeats the process at 100 Threads.<testscenario xmlns="www.pushtotest.com/tm5"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="www.pushtotest.com/tm5"
version="2.0">
<basics>
<name>DPL Test</name>
<defaultdirectory>./dpltest</defaultdirectory>
</basics>
<testnodes>
<node name="localhost"
location="http://localhost:8080/TestNetwork/ws/TestNode"/>
</testnodes>
<resources>
<testgen4web path="./PTT_Examples_UnitTest.testgen4web"/>
</resources>
<loadtest>
<testusecase>
<dimensions>
<!-- The count of sequences the test operates concurrently -->
<crlevels>
<crlevel value="50"/>
<crlevel value="100"/>
<crlevel value="150"/>
</crlevels>
<usecases>
<usecase name="Examples_usecase">
<sequence name="Examples_sequence" proportion="100">
<test>
<run name="MyTest"
testclass="PTT_Examples_UnitTest.testgen4web"
method="testGen4Web"
langtype="testgen4web"/>
</test>
</sequence>
</usecase>
</usecases>...
Answers Right Now
As the test operates, TestMaker consolidates the logged result data and timing values and presents a real-time graph of the throughput of the application under test.
TestMaker consolidates the monitored resource usage of the application server hosting the application under test and correlates the load test activity to the obeservations of the backend system.
TestMaker test results data into actionable knowledge, including charts and graphs that show the scalability index, result timing distribution, and performance timing by operation. TestMaker reports results in PNG graphic file format, comma separated value (CSV) format for import into spreadsheets and other data analysis tools, and logs data to XML and relational database (RDBMS) tables. TestMaker results analysis identifies areas in the application to optimize to resolve performance bottlenecks.
See the PushToTest TestMaker tutorials to learn how to learn more and how to add a DPL to this unit test.
Codeless Test Development
TestMaker provides Recorders and Wizards to watch your use of an application or service and creates a unit test of a Web application, Ajax application, and SOAP-based Web Service automatically.
Use the integrated Firefox TestGen4Web plug-in to record Web application test use cases with no programming experience required.
Use the integrated Eviware soapUI utility to build test use cases for SOAP-based Web services. WSDL goes in, test usecases come out.
Additionally, the included Network Proxy Recorder watches the network-level interactions between Microsoft Internet Explorer browser or desktop applications and creates a new unit test script. This requires no programming effort but does require a familiarty with the Jython language.
Finally, use the TestMaker unit test Wizard to write a script or class that implements a JUnit TestCase in any of the supported languages.
Service Monitoring For Free
A TestScenario operates recorded tests as a functional test by operating a sequence of unit tests once, as a load test by operating sequences of the unit tests in concurrently running threads, and as service monitors by running the unit tests periodically.As a service monitor, a TestScenario periodically runs TestMaker recorded tests, logs the results to prove service levels, provides a Web-based live dashboard of the monitored results, and immediately sends alert email notices when the service fails or responds too slowly.
This TestScenario reuses the recorded test as a service monitor. No additional effort was required.<testscenario xmlns="www.pushtotest.com/tm5"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="www.pushtotest.com/tm5"
version="2.0">
<basics>
<name>DPL Test</name>
<defaultdirectory>./dpltest</defaultdirectory>
</basics>
<testnodes>
<node name="localhost"
location="http://localhost:8080/TestNetwork/ws/TestNode"/>
</testnodes>
<resources>
<testgen4web path="./PTT_Examples_UnitTest.testgen4web"/>
</resources>
<monitor timeBetweenTest="10000">
<until>
<exception type="java.lang.Exception"></exception>
</until>
<testusecase>
<dimensions>
<usecases>
<usecase name="Examples_usecase">
<sequence name="Examples_sequence">
<test>
<run name="MyTest"
testclass="PTT_Examples_UnitTest.testgen4web"
method="testGen4Web"
langtype="testgen4web"/>
</test>
</sequence>
</usecase>
</usecases>...
PushToTest, Form Zero-To-Test in Minutes
PushToTest TestMaker helps you set the requirements for a test automation platform, evaluate, and make recommendations. PushToTest is the fastest way to speed your QA and IT projects.- No Expense,
No Budget, No Fees to Get Started Today - The PushToTest
Company distributes pre-built, tested, and ready-to-run
binary of TestMaker under a free commercial
license. The commercial license is free and authorizes you to
run up to 200 concurrent virtual users and 10 concurrently running
service monitors. Additional virtual users and monitors are available
for purchase from PushToTest. Click
here for details. PushToTest TestMaker source code is free
and distributed under a GPL v2 license.
- 2-Days From
Start-To-Test - PushToTest gets software
developers, architects, QA testers, and IT managers from start to
testing in the span of a 2-Day
training course. The course is taught in your
facilites, at PushToTest's Silicon Valley offices, at Skills
Matter
(our European partner) training facilities in London, or by Web
conference.
- The PushToTest environment is fully extensible to support new protocols, interfaces, encoding styles, and libraries.
Learn More With PushToTest Screencasts
 Screencast
Introduction For TestMaker 4 Users |
| Google
TechTalk on TestMaker |
| Screencast
on Building Load Tests, Functional Tests, Service Monitors |
| Architectural
Goals of TestMaker 5 |
TestMaker is a test automation framework and utility to help you understand and solve functionality, scalability and performance of services. Get started today... download TestMaker.
Get hands-on today... download TestMaker
