Benchmarking quantum processor quality in the utility era

As quantum processors enter the era of utility, it becomes increasingly important to develop benchmarking suites capable of addressing quality, speed, and scale. With scale increasing rapidly for utility, quality benchmarks are needed that can be run at large scales. In this talk, we report developments towards such benchmarks. We present a device benchmark that captures the generic performance of a quantum processor and is scalable to large systems while still capturing important multi-qubit effects like cross-talk. Further, we show in what sense Clifford circuits can be representative of generic circuit performance, and how this can be extended to benchmark applications and error mitigation schemes.