Computer Software Benchmarking Task

A Computer Software Benchmarking Task is a Computing System Benchmarking Task that evaluates the performance of a specific software application, program, or tool.

• Context:
  • Task Input: Benchmark Datasets.
  • Task Output: System Performance Score.
  • Task Requirement(s):
    • Benchmark Baseline Systems, and Benchmark Participating System.
    • a Software Programming System or an Application Software Package that can implement and train the Baseline Models on the Benchmark datasets.
    • Computer Software Benchmark Performance Metrics.
• Example(s):
  • a Data Mining System Benchmark Task such as:
    • an Information Retrieval System Benchmark Task,
    • a Knowledge Discovery System Benchmark Task,
    • a Word Processing Software Benchmark,
  • a Machine Learning System Benchmark Task such as:
    • a Natural Language Processing System Benchmark Task,
    • a WikiText Error Correction (WTEC) System Benchmark Task,
    • a Text Error Correction System Benchmark Task,
    • a Optical Character Recognition (OCR) System Benchmark System,
    • a Predictive Modeling System Benchmark Task.
  • …
• Counter-Example(s):
  • a Computer Hardware Benchmarking Task,
  • a Database Management Systems Benchmark Task,
  • an I/O Benchmark Task,
  • a Kernel Benchmark Task,
  • an Online Transaction Processing Benchmark Task,
  • a Parallel Computing Benchmark Task,
  • a Synthetic Benchmark Task,
  • a Supercomputing Benchmark Task,
  • a Test Suite.
• See: Computer Performance, Performance Metric, Performance Indicator, Software Development.

---

---

References

2019

• (Wikipedia, 2019) ⇒ https://en.wikipedia.org/wiki/Benchmark_(computing) Retrieved:2019-11-10.
  • In computing, a benchmark is the act of running a computer program, a set of programs, or other operations, in order to assess the relative performance of an object, normally by running a number of standard tests and trials against it.

    The term benchmark is also commonly utilized for the purposes of elaborately designed benchmarking programs themselves.

    Benchmarking is usually associated with assessing performance characteristics of computer hardware, for example, the floating point operation performance of a CPU, but there are circumstances when the technique is also applicable to software. Software benchmarks are, for example, run against compilers or database management systems (DBMS).

    Benchmarks provide a method of comparing the performance of various subsystems across different chip/system architectures.

     Test suites are a type of system intended to assess the correctness of software.

---