Product Catalog

Basemark OS II

Basemark OS II is a system-level All-In-One benchmarking tool designed for measuring overall performance of smartphones and tablets from all platforms, including Android, iOS and Windows phone 8. The benchmark features a comprehensive suite of tests and produces an objective overall score as well as a breakdown of each tested area, including system, internal and external memory, graphics, web browsing, camera, battery and CPU consumption. The benchmark is available as payable full version and as a free version for consumers. Please click here for detailed comparison.

 

Basemark ES 3.0

Basemark® ES 3.0

All high-end embedded devices today utilize OpenGL ES API and hardware acceleration. In the very near future more mobile and tablet devices will be provided with the next-generation OpenGL ES 3.0 support. Basemark® ES 3.0 was created to solve the problem of measuring hardware performance using next-generation OpenGL ES API with the industry’s most reliable test cases and to produce the most accurate data about performance. Basemark® ES 3.0 includes photorealistic graphics game tests to benchmark performance of the graphics hardware. 

Rightware’s OpenGL ES 3.0 benchmark – Basemark® ES 3.0 – is built to benchmark performance of rendering game like visual content on OpenGL ES ES 3.0 enabled devices. Making the benchmark run content which reflects real life use case scenarios gives more useful benchmarking data about hardware than synthetic benchmarks.

Basemark® ES 3.0 includes photorealistic graphics game tests to benchmark performance of the graphics hardware. OpenGL ES 3.0 API enables access to four simultaneous render targets, ability to apply antialiasing to render targets and provides more varied internal data types for render buffers such as floating point color targets. In addition, Basemark® ES 3.0 will utilize features such as 3D textures, instanced rendering, transform feedback and occlusion queries, all of which are provided with OpenGL ES 3.0.

Basemark® ES 3.0 consists of two tests. These tests are scored based on the time required to visualize each benchmark frame including the time spent on CPU and GPU operations. The sequences are run with fixed step time so each rendered frame will contain identical visuals to previous runs.

The first main test – “Rush” – provides an action style sequence taking place on city rooftops. The goal of this test is to give good overview of the platforms performance for character based games with PC-quality rendering.

The second main test – “Racer” – is a car game like sequence. In this sequence Basemark® ES 3.0 visualizes a car racing track, cars and various effects which are common in car games. The goal of this test is to give good overview of the platforms performance for racing games with PC-quality rendering. 

Availability

Basemark® ES 3.0 is available for licensing. Please fill the form to get more information.

Some Key features

  • Instanced rendering. Allows rendering multiple instances of single mesh in one draw call. Useful for rendering things like grass and repeating geometry in scenes.
  • Multiple simultaenous rendertargets. Rendering can be now done on multiple simultaenous render targets at a time. By rendering single set of geometry with this you can render to separate offscreen buffers things like surface material id, surface normals, surface glossyness etc, which can be used to do deferred shading and other similar effects which previously needed multiple passes on same geometry.
  • Render target antialiasing. Now it is possible to do antialiasing when rendering to offscreen buffer.
  • Occlusion queries. Allow querying how many pixels were visible out of a set of rendered objects. Generally used for rendering a lens flare or other similar effects.
  • 3D Textures. 3D textures can be used for reading. 3D textures make it possible to implement various tricks like shadow volumes etc. Not very useful for mobile applications at the moment.
  • Improved shader uniform and varying counts. Shaders can be now more complex and can get more input data from CPU.
  • Vertex shader texture read. Now you can read a texture in a vertex shader.
  • Primitive restart. Makes it possible to render separate sequences of triangle_strips or triangle_fans or other primitives in two different places in the scene.

Basemark® ES 3.0 is developed within the industry’s most impartial and transparent benchmark development program in close cooperation with the world’s leading mobile phone manufacturers, semiconductor companies and operators to ensure the most reliable and objective benchmark product. Basemark® ES 3.0 will support multiple software platforms, enabling its execution on any device supporting OpenGL ES 3.0. Most importantly, Basemark® ES 3.0 will produce objective and comparable results by offering the identical workload on all platforms.

 

Browsermark

Browsermark

Hugely popular Browsermark is a benchmark tool designed to measure browser performance of mobile and embedded devices. Browsermark measures a browser’s performance in JavaScript and HTML rendering. Browsermark was designed to tell an end-user which browser performs the best on their mobile or embedded device.  It is easy to compare scores by running Browsermark again using a different browser. Changing browser to the one that is faster can mean that pages with dynamic content will be more responsive.

HTML5 and WebGL are becoming ever more imporant in smartphones and tablet environments. Web-based gaming and browsing requires efficient browsers, which can support latest standards and features, in order to provide solid user experience, whether it is gaming or user interfaces.

Browsermark introduces

  • WebGL
    • Use-case: More realistic web experiences
  • Canvas
    • Use-case: Visual improvements, personalized visual content
  • HTML5
    • Use-case: New standards for media (video, audio, etc.)
  • CCS3/3D
    • Use-case: Multidimensional browsing experience
  • Advanced JavaScript tests
  • General browsing  functionality tests

Advanced information for licensees

  • Meta-information from browser test
  • Detailed analysis of browser performance

 

Basemark X

Basemark X

Basemark X is a professional performance evaluation tool enabling objective cross platform comparisons of gaming graphics performance between iOS, Android and Windows Phone 8 devices. Basemark X has been developed under rigorous process and scrutiny by virtually every relevant semiconductor and OEM company of the world.

Workloads have been designed to resemble the usage profile of modern and future 3D games, thus pushing the measured device to the limit. It is visually more impressive and incorporates more demanding workloads than our previous OpenGL ES 2.0 benchmarks. The product features game-like content, including particle effects, modern game quality lighting effects and post processing. Basemark X is a unique product in the market place, being the only professionally designed benchmark built on top of a real-world game engine.

 

Basemark GUI

Basemark® GUI

People all around the world use an increasing number of smartphones, tablets and other consumer devices with sophisticated graphics systems, but although each offers many similar features, increasingly it is the graphical user interface (GUI) that differentiates devices. Not only the GUI implementation itself but the performance of it provides users the user experience, in good or bad. Rightware’s Basemark® GUI was created to solve this problem of benchmarking devices reliably and providing with extremely compelling and accurate benchmark data about capabilities of device’s graphical user interface.

Basemark® GUI for OpenGL ES 1.1 and 2.0 is an OpenGL ES benchmark that measures performance of graphical user interfaces in embedded devices. The benchmark tests enabled by Basemark® GUI generate the workloads that tax your graphics system in a realistic and visually stunning way. The Basemark® GUI benchmark product will give hardware manufacturers the necessary tool to analyze platform capability for user interface applications using visually compelling 3D graphics.

Basemark® GUI for OpenGL ES 1.1 and 2.0 executes comprehensive tests for a complete user interface (3D UI) and for more specific techniques (feature tests). The 3D UI test represents a futuristic 3D user interface with main view and three sub-applications. These applications include photo browser, volume controls and music selector. The user interface elements within these screens are made completely in 3D space. The feature tests include, for example, animations, streaming of different assets, blending, different compositions, and so on. 

Usage

Basemark® GUI for OpenGL ES 1.1 and 2.0 is intended for the hardware development in order to assist in product development, design and implementation evaluation and media reviews of hardware of next-generation devices.

Availability

Basemark® GUI for OpenGL ES 1.1 and 2.0 is available for licensing as source code and binary version. Please fill the form to get more information.

Key features

  • Efficient and compelling benchmark test cases
  • Compelling workload tests to stress next-generation hardware with 3D UIs
  • Source code availability – licensing option
  • Visually rich and stunning 3D UI examples
  • OpenGL ES 1.1 and 2.0 3D benchmark application and three sub-applications

Benefits

  • Realistic and extremely reliable test cases to give you confidence of your hardware’s performance
  • Easy measurability and comparison of results – all results presented in clear format
  • Source code availability to enable developers to port the benchmark to their proprietary platform
  • Compelling diagnostic tool and test cases to find out the performance problems at early phase

According to Rightware’s benchmark policy, Basemark® GUI for OpenGL ES 1.1 and 2.0 has been created in cooperation with our BDP members in order to provide you with the best possible and the most reliable set of performance measurement tools.

Basemark® GUI measures User Interface performance in embedded applications. Basemark® GUI Beta build has six tests, one main test and five feature tests, which have been implemented using both OpenGL ES 1.1 and OpenGL ES 2.0.

 

Basemark ES 2.0

Basemark® ES 2.0

All high-end embedded devices today utilize OpenGL ES software and hardware acceleration. In fact, OpenGL ES has provided an excellent industry standard to build games, applications and user interface features for increasingly differentiated embedded devices. In growing world of hardware accelerated user interfaces the performance capabilities of hardware platform become crucial. Rightware’s Basemark® ES 2.0 was created to solve the problem of measuring hardware platform’s OpenGL ES ES 2.0 performance capabilities with the most reliable test cases and to produce the most accurate data about performance.

Basemark® ES 2.0 is an OpenGL ES 2.0 benchmark that tests the 3D graphics performance of future mobile 3D hardware. High detail game content generates workloads that tax OpenGL ES 2.0 3D hardware in a realistic and visually stunning way. In addition to the game content, Basemark® ES 2.0 includes tests for measuring the performance on e.g. shader processing and state changes. Texture filtering tests for seeing the visual quality are also included with the product. Basemark® ES 2.0 enables impartial performance measurement and a comparison between different solutions for OpenGL ES 2.0.

Usage

Basemark® ES 2.0 is intended for use on development hardware to assist in product development, design evaluation and for mobile hardware media reviews of next generation devices, as made available.

Availability

Basemark® ES 2.0 is available for licensing. Please contact us for pricing.

Key Features

  • OpenGL ES 2.0 3D hardware benchmark application
  • Produces workloads designed to stress next generation mobile 3D hardware with a demanding 3D gaming load
  • Source code licensing available for BDP members
  • Includes two high detail game tests, and several feature tests for measuring different features of the hardware.

Benefits

  • Basemark® ES 2.0 is the only product specifically designed to benchmark the next generation OpenGL ES 2.0 programmable hardware with visually stunning and realistic content
  • Source code licensing enables developers to port the benchmark to their platform, to satisfy their development requirements
  • Mobile hardware media reviewers will be able to test next generation hardware as development boards and next generation devices are made available

As with all Rightware benchmarks, Basemark® ES 2.0 has been created in cooperation with our BDP members in order to provide you with the best possible and most reliable set of diagnostic tools.

Rightware’s Basemark® ES 1.x/2.0 benchmarks have been designed to measure the GPU’s performance; however, these benchmarks are not intended to measure a CPU’s performance. Rightware acknowledges that the benchmark statistics which you get out of a CPU by using Basemark® ES 1.x/2.0 are not recommended for CPU performance comparison. These types of CPU numbers are best derived from using our SPMark series of benchmarks which are specifically engineered for CPU performance comparisons.

 

Basemark OS

Basemark® OS

The fundamental purpose of Basemark® OS benchmark is to provide the end-user with an objective way to compare the performance of different hardware platforms running the same operating system. For example, Basemark® OS for Android enables an objective system-wide comparison of Android-based devices with accurate and a reliable suite of benchmark tests for mobile phones, pads, consumer electronics and other embedded devices running Android OS on ARM, MIPS and x86 architectures. Basemark® OS for Android provides a comprehensive set of tests with consumer-friendly, easy-to-understand  reports and comparison.

Basemark® OS for Android is a comprehensive system-wide Android OS benchmark that enables an objective comparison of Android-based devices with accurate and reliable suite of benchmark tests for mobile phones, pads, consumer electronics and other embedded devices running Android OS on ARM and x86 architectures.

Basemark® OS for Android provides a comprehensive set of tests with easy-to-understand test reports: The system tests aimed to stress the standard Android applications, messaging services, Java, file operations, memory IO, databases, zip compression and decompression, as well as the classic Dhrystone ALU and Whetstone FPU tests. The graphic tests featured in Basemark® OS for Android allow accurate measurement of 2D imaging, image scaling, JPEG, PNG and GIF encoding and decoding, and a compelling 3D test set with fillrate, polycount, lighting, texturing and rendering tests. Media decoding tests include H263, H264, MP4 and 3GP video decoding tests as well as AMR, AAC, MP3 and WAV audio decoding tests. In addition, Basemark® OS for Android provides program startup tests for various standard Android applications, Bluetooth and Dialer. 

Usage

Basemark® OS for Android is intended for the hardware and software developers to assist in Android product development, design and implementation of next-generation devices.

Availability

Basemark® OS for Android is available for licensing. Please fill the form to get more information.

Key features

  • System-wide Android OS benchmark tests
  • Graphic tests, Media encoding tests, program startup tests and battery test
  • Standard test suite and freely customizable set of tests
  • Versatile licensing options
  • Runs on top of any Android device and Android versions from 2.1

Benefits

  • Realistic and extremely reliable test cases to give you confidence of your hardware’s performance
  • Easy measurability and comparison of results – all results presented in clear format
  • Compelling diagnostic tool and test cases to find out the performance problems at early phase

According to Rightware’s benchmark policy, Basemark® OS for Android has been created in cooperation with our BDP members in order to provide you with the best possible and the most reliable set of performance measurement tools.

 

Basemark CL

Basemark® CL

OpenCL by Khronos Group is the first open, royalty-free standard for parallel programming of modern processors found in personal computers and embedded devices. Proper use of OpenCL can greatly improve speed and responsiveness of applications in numerous categories from gaming and entertainment to scientific and medical software. Within these applications, OpenCL makes it possible to leverage the processing power of Central Processing Units (CPUs), Graphic Processing Units (GPUs) and other processing units for general purpose computation. Basemark® CL benchmark product provides diverse performance measurement capabilities for device manufacturers, semiconductor companies and their ecosystem to test and optimize the OpenCL implementations within desktop and embedded devices.

Basemark® CL provides a comprehensive OpenCL benchmark that enables an objective comparison of OpenCL implementations with accurate and reliable suite of benchmark tests.

Rightware’s Basemark® CL provides compelling feature set to coordinate parallel computation across heterogeneous processors utilizing OpenCL. Image manipulation tests run filters on image data and produce the filtered output on the screen. The image manipulation filters are applied to video streams as a separate test, which allows benchmarking of bandwidth limitations from moving data from CPU to GPU, providing a solid real-world case for benchmarking. Physic tests enable leveraging of extra computing power that OpenCL brings into different platforms. The feature tests provided by Basemark® CL enable the testing of performance of single or several features on the hardware.

OpenCL by Khronos Group is the first open, royalty-free standard for parallel programming of modern processors found in personal computers, servers and embedded devices. Proper use of OpenCL can greatly improve speed and responsiveness of applications in numerous categories from gaming and entertainment to scientific and medical software. Within these applications, OpenCL makes it possible to leverage the processing power of Central Processing Units (CPUs), Graphic Processing Units (GPUs) and other processing units for general purpose computation. By utilizing an efficient low-level programming interface, OpenCL will form the foundation layer of a parallel computing ecosystem of platform-independent tools, middleware and applications.

Basemark® CL features workloads that stress the OpenCL implementation in a realistic way, therefore yielding performance measurement data that is objective and relevant. With the help of OpenCL, it is possible to improve games, applications and user interfaces for instance by including physics-based animations and game-like elements.

Usage

Basemark® CL is intended for device manufacturers and semiconductor companies that develop their next-generation systems with OpenCL.

Availability

Basemark® CL is available for licensing. Please fill the form to get more information.

According to Rightware’s benchmark policy, Basemark® CL has been created in cooperation with our BDP members in order to provide you with the best possible and the most reliable set of performance measurement tools.

 

 

Other products

History of Mobile Benchmarking

Rightware also offers multiple other products, ranging from OpenVG and automotive testing to system level testing. Please learn more about these products from here.

Basemark® ES 1.1

Basemark® ES 1.1 is a robust OpenGL ES 1.0 and 1.1 benchmark that test the 3D graphics performance of future mobile 3D hardware. High detail game content generates workloads that tax OpenGL ES 3D hardware in a realistic way. Combined with feature tests consisting of pixel processing, vertex processing, and CPU processing, development hardware and prototype device performance can be tested, evaluated and compared, fairly and consistently.

Basemark® VG

Basemark® VG 1.1 the OpenVG Benchmark, is a vector graphics performance gauge for mobile devices. Benchmark measures both hardware accelerated and software implemented OpenVG 1.0 API performance with real world vector graphics workloads. Basemark® VG includes application tests such as user interface and map based navigation. Feature tests such as segment count, fill rate and path count, and image quality tests for rendering, anti-aliasing and image quality are also included.

Mirada

Mirada is an OpenGL ES 2.0 benchmark that tests 3D graphics performance of future in-car graphics implementations. Several high detail automotive in-car graphics tests feature workloads that tax OpenGL ES 2.0 hardware in a realistic and visually stunning way. In addition to realistic workloads, Mirada includes tests for measuring the performance of shader processing with polygon throughput and fillrate tests.

Mirada enables impartial performance measurement and comparison between different OpenGL ES 2.0 solutions that are targeted for automotive industry.

SimulationMark

SimulationMark ES2.0 details the creation of a suite of workload based OpenGL ES 2.0 graphics benchmarks that will allow manufacturers to test and compare mobile 3D hardware performance at the design stage. By combining theoretical and real life workloads, SimulationMark ES 2.0 provides accurate comparisons between graphics hardware designs and produce calculated performance estimates without requiring an actual hardware implementation. With high level shader and parameter descriptions for building theoretical shader performance and practical shader performance tests, and practical game test performance measurements derived via workloads for real world mobile gaming performance, SimulationMark ES 2.0 enables manufacturers to calculate valuable 3D graphics performance data prior to investing in physical silicon based implementations.