VOCALIZE.AI

vocalize.ai – a test suite for advancing conversations between humans and computers How well do AI powered virtual assistants hear us when exposed to real-world operating conditions? Work has already started and preliminary results are shared in our report. How do we ensure that the next wave of conversational computing is inclusive across gender, race, age, dialect and accent? This work will leverage initial procedures and algorithms, but with diversified datasets and additional procedures. We introduce the concept of an “inclusivity index” for AI platforms. vocalize.ai is developing test suites, software and the associated data sets to perform black-box evaluations of ASR systems. We will help highlight gaps in performance with measurable, repeatable and shared benchmarks.