2 |
Quality Assurance of Generative Dialog Models in an Evolving Conversational Agent Used for Swedish Language Practice ...
|
|
|
|
Abstract:
Due to the migration megatrend, efficient and effective second-language acquisition is vital. One proposed solution involves AI-enabled conversational agents for person-centered interactive language practice. We present results from ongoing action research targeting quality assurance of proprietary generative dialog models trained for virtual job interviews. The action team elicited a set of 38 requirements for which we designed corresponding automated test cases for 15 of particular interest to the evolving solution. Our results show that six of the test case designs can detect meaningful differences between candidate models. While quality assurance of natural language processing applications is complex, we provide initial steps toward an automated framework for machine learning model selection in the context of an evolving conversational agent. Future work will focus on model selection in an MLOps setting. ... : Accepted for publication in the Proc. of the 1st International Conference on AI Engineering, 2022 ...
|
|
Keyword:
Artificial Intelligence cs.AI; Computation and Language cs.CL; FOS Computer and information sciences; Software Engineering cs.SE
|
|
URL: https://dx.doi.org/10.48550/arxiv.2203.15414 https://arxiv.org/abs/2203.15414
|
|
BASE
|
|
Hide details
|
|
3 |
Sozio-oekonomisches Panel, Daten der Jahre 1984-2020 (SOEP-Core, v37, Teaching Version) ... : Socio-Economic Panel, data from 1984-2020, (SOEP-Core, v37, Teaching Version) ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Sozio-oekonomisches Panel, Daten der Jahre 1984-2020 (SOEP-Core, v37, Add-on: Area Types) ... : Socio-Economic Panel, data from 1984-2020, (SOEP-Core, v37, Add-on: Area Types) ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Sozio-oekonomisches Panel, Daten der Jahre 1984-2020 (SOEP-Core, v37, Onsite Edition) ... : Socio-Economic Panel, data from 1984-2020, (SOEP-Core, v37, Onsite Edition) ...
|
|
|
|
BASE
|
|
Show details
|
|
6 |
Sozio-oekonomisches Panel, Daten der Jahre 1984-2020 (SOEP-Core, v37, Add-on: Planning regions) ... : Socio-Economic Panel, data from 1984-2020, (SOEP-Core, v37, Add-on: Planning regions) ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
Sozio-oekonomisches Panel, Daten der Jahre 1984-2020 (SOEP-Core, v37, EU Edition) ... : Socio-Economic Panel, data from 1984-2020, (SOEP-Core, v37, EU Edition) ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Sozio-oekonomisches Panel, Daten der Jahre 1984-2020 (SOEP-Core, v37, International Edition) ... : Socio-Economic Panel, data from 1984-2020, (SOEP-Core, v37, International Edition) ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Sozio-oekonomisches Panel, Daten der Jahre 1984-2020 (SOEP-Core, v37, Remote Edition) ... : Socio-Economic Panel, data from 1984-2020, (SOEP-Core, v37, Remote Edition) ...
|
|
|
|
BASE
|
|
Show details
|
|
10 |
The Demography of COVID-19 Deaths Database: A gateway to well-documented international data ...
|
|
|
|
BASE
|
|
Show details
|
|
11 |
The Demography of COVID-19 Deaths Database: A gateway to well-documented international data ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Schizotypy and Theory of Mind in a second language: Evidence from German-English bilinguals ...
|
|
|
|
BASE
|
|
Show details
|
|
15 |
A multi-lab replication of Nozaradan et al. (2011) – Lab huettig-mpi
|
|
|
|
BASE
|
|
Show details
|
|
18 |
Language Models Explain Word Reading Times Better Than Empirical Predictability ...
|
|
|
|
BASE
|
|
Show details
|
|
19 |
Individual Perception of Telehealth: Validation of a German Translation of the Telemedicine Perception Questionnaire and a Derived Short Version
|
|
|
|
In: International Journal of Environmental Research and Public Health; Volume 19; Issue 2; Pages: 902 (2022)
|
|
BASE
|
|
Show details
|
|
20 |
Individual Differences in Singing Behavior during Childhood Predicts Language Performance during Adulthood
|
|
|
|
In: Languages; Volume 7; Issue 2; Pages: 72 (2022)
|
|
BASE
|
|
Show details
|
|
|
|