Search

FR-3168282-A1 - METHOD FOR TESTING A LARGE LANGUAGE MODEL IMPLEMENTED WITHIN A CONVERSATIONAL AGENT

FR3168282A1FR 3168282 A1FR3168282 A1FR 3168282A1FR-3168282-A1

Abstract

METHOD FOR TESTING A LARGE LANGUAGE MODEL IMPLEMENTED WITHIN A CONVERSATIONAL AGENT A computer-implemented method for testing the performance of a large language model (LLMt) comprising: Receiving a dataset (ENS1) from at least one data source (Si) over a specified time period; Generating (GEN1) at least one first message (M1) from the received dataset (ENS1) and by applying at least one first large variation language model (LLM1); Generating (GEN2) a plurality of messages (M1) by applying at least one large variation language model; Generating (GEN3) a plurality of message exchanges ({SEQ1 k}k ∈ [1; N]) by applying a large language model to be tested (LLMt); Calculating (TEST1) a first error indicator (IND1); Calculation (TEST2) of a second conformity indicator (IND2). Figure for the summary: Fig. 1

Inventors

  • Kevin MESSIAEN
  • Pierre LE JEUNE
  • Matteo DORA
  • Jean-Marie JOHN MATHEWS

Assignees

  • GISKARD AI

Dates

Publication Date
20260508
Application Date
20241107