
High-quality representative data strengthen
the reliability of applications
In the case of models developed by learning from past
data, one way to make the AI model Trustworthy is
based on the quality and representativeness of the
data used. The more the data is processed and quali-
ed upstream, the better the model. Characterizing
the learning data set also enables to detect in opera-
tion whether a situation is in the scope of the model,
and hence whether the response is reliable or not.
Depending on the application, one can then switch to
a safe default working mode, or warn the user, and
thus not let the system make bad decisions.
“Depending on the subject, i.e., on the signicance and
type of risk to be mitigated, the learning data set must
have specic characteristics to avoid imbalance. Spe-
cic checks must be performed, with clearly dened
responsibilities upstream. The quality of input data is
closely correlated with the methods and tools put in
place. Governments and certication bodies have under-
stood the potential impact of drifts and errors related to
a non-responsible approach to AI. Assuming the level
of effort and corresponding cost remain proportionate
to the risks to be covered, regulation and clear deni-
tion of standards to be respected will globally improve
AI development practices and reassure our customers
about the quality standards of AI solutions,“ conrms
Claude Le Pape-Gardeux, Data and Articial Intelli-
gence Domain Leader at Schneider Electric.
Ethics and data privacy as development principles
Data protection, regulated since 2018 by the GDPR,
is inherent in all data projects. In this sense, privacy
applies fully to AI projects, thus creating a customer
relationship based on trust. Some use cases focused
on customer behavioral analysis can integrate a robust
ethical dimension. Even in less sensitive use cases,
privacy must always be considered, as Kering does.
“The sales prediction solutions we are working on do
not integrate a strong dimension of Trustworthy AI.
However, we are very sensitive to the subject inter-
nally. We always ask ourselves if potential biases can
affect our use cases. Moreover, we carefully control
access to data to ensure data privacy,“ explains Imen
El Karoui, Data Intelligence Director at Kering.
Explainability, a guarantee of adoption
Whatever the use case developed, whatever the com-
pany, and whatever the associated risks, AI cannot be
trusted entirely without user support. On this point,
industrial AI has a denite advantage over consum-
er AI: it is often less complex and much more explai-
nable. This is evidenced by the approach implemen-
ted by Sébastien Gourvénec, DataScience & AI R&D
Manager at TotalEnergies.
“I try not to work on models that are too complicated.
We often work on simple models based, for instance,
and when possible, on decision trees. And we always go
from simple to complex when developing models. The
explainability of models facilitates their acceptability. In
the industrial world, we must consider cause-and-effect
relationships. When developing an AI model, it is, there-
fore, necessary to ask what is the cause of the industrial
problem that the solution must address. The answer is
not always obvious, as the number of variables can be
signicantly high. But by integrating this parameter into
the design of algorithms, we then obtain an AI that is
easier to explain and, consequently, to accept.“
Research and trustworthy AI
Founded in 2012, Quantmetry, a consulting rm spe-
cializing in AI, places R&D at the heart of its model. Its
scientic director, Nicolas Brunel, is himself a teacher-
researcher. Its Quant Lab thus animates a whole
research ecosystem around AI themes and hosts
several theses, including one dedicated to robustness
in computer vision. The consulting rm, ranked 5th
most innovative company in France by Les Échos in
May 2023, thus devotes 4,500 person-days each
year to research and innovation in all areas of AI. This
represents a fundamental knowledge of the state of
the art of research.
“We had the intuition as early as 2018 that algorithms
would lack explainability, which pushed us to invest
in the subject. We have published white papers, writ-
ten scientic articles, and launched an open-source
approach. Among our 150 employees, we have about
ten researchers, but 20% of our payroll contributes
permanently to an AI project,“ says Jérémy Harroch.
41