{"id":9180,"date":"2023-12-18T12:04:06","date_gmt":"2023-12-18T11:04:06","guid":{"rendered":"https:\/\/sparkle.consulting\/?p=9180"},"modified":"2024-02-19T15:41:39","modified_gmt":"2024-02-19T14:41:39","slug":"eu-ai-act-interview-professor-nunez-castellar","status":"publish","type":"post","link":"https:\/\/sparkle.consulting\/fr\/eu-ai-act-interview-professor-nunez-castellar\/","title":{"rendered":"Se conformer \u00e0 l'AI Act de l'UE tout en acc\u00e9l\u00e9rant l'innovation : une interview de l'AI translator Elena Nu\u00f1ez Castellar"},"content":{"rendered":"\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Before becoming an AI lead, AI translator, and Innovation Consultant<\/b> for Sparkle, Elena <\/a><\/span>Nu\u00f1ez<\/span> Castellar held the position of AI innovation manager at R&D center <\/span>imec<\/a> (independent Flemish R&D hub for nano and digital technology)<\/span>. Her dedication to innovation and interdisciplinary approaches are reflected in her overall perspective on AI. In this interview, Elena discusses the EU AI Act, the importance of an Ethics Board, and what sets Sparkle\u2019s approach to AI apart.<\/b><\/span><\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Can you provide a brief overview of the EU AI Act? What is its purpose? <\/h4>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Before I can answer this question, I need to take a step back and delve into the origins of the EU AI Act<\/b>. Before there was any regulatory framework, discussions were held on the potential of AI on the one hand and the threats posed by AI on the other. In 2018, the European Commission <\/b><\/span>established<\/b><\/span> the Artificial Intelligence High-Level Expert Group (AI HLEG), which published the influential white paper:<\/b> \u2018<\/span><\/span>A definition of AI: main capabilities and disciplines<\/span><\/span><\/a>\u2019. In this white paper, the group proposed a definition to guide the development of AI ethics guidelines and policy recommendations. Additionally, in 2019, the expert group presented its <\/span><\/span>Ethics guidelines for trustworthy AI<\/span><\/span><\/a>.<\/span><\/span>\u00a0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

These Ethics guidelines outline key requirements that AI systems must meet to be considered trustworthy. However, as guidelines, they do not carry legal consequences for non-compliance. They function more like a code of conduct. So, in 2019, the European Commission took a step forward in introducing legislation that applies to <\/span>any organization or company that puts into service<\/span> AI tools within the European Union, including fines for non-compliance.<\/span><\/span>\u00a0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

So, in 2021, to ensure the safe, responsible, and reliable development and deployment of AI, the European Commission proposed the first EU regulatory framework for AI across Europe: the <\/a><\/strong><\/span><\/span>AI Act<\/span><\/span><\/strong><\/a>.<\/strong> This framework is currently in the final phase of the European legislative procedure, and its enactment is expected in early 2024.<\/strong> Of course, a transition period will be <\/span>provided<\/span> to allow organizations sufficient time to comply.<\/span><\/span>\u00a0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

What impact will the AI Act have on organizations? <\/h4>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Any organization that offers AI-related products or services in the EU market, regardless of its headquarters\u2019 location, must ensure compliance with the EU AI Act. The fines for non-compliance are <\/span>substantial<\/span>, surpassing those stipulated by the GDPR (General Data Protection Regulation). <\/span>It\u2019s<\/span> important to note that the EU AI Act imposes obligations not only on providers of AI systems, but also on users and third parties, such as distributors.<\/span><\/span>\u00a0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

The AI Act also classifies AI systems according to their level of risk, with different rules and regulations applying depending on the risk level. Furthermore, certain activities are expressly prohibited if an AI system poses an unacceptable risk to the safety or fundamental rights of individuals. For example, manipulation of human behavior, exploitation of vulnerable individuals, or social scoring for employment decisions are prohibited.<\/span><\/span>\u00a0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Why is an Ethics Board crucial for organizations working with AI?<\/h4>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Often, an organization\u2019s management primarily focuses on the benefits of AI in relation to business capabilities. However, <\/span>it\u2019s<\/span> essential to recognize that AI also brings risks. An Ethics Board plays a vital role for reflecting on these risks, <\/span>identifying<\/span> the responsibilities the organization has, and addressing other crucial points. The requirements for trustworthy AI outlined by the Artificial Intelligence High-Level Expert Group <\/span>serves<\/span> as an important guideline in these discussions. For example, <\/span>regardin<\/span>g<\/span> transparency, <\/span>it\u2019s<\/span> important that people are aware when <\/span>they\u2019re<\/span> interacting with a Chatbot. Additionally, the Ethics Board must ensure that AI systems <\/span>don\u2019t<\/span> compromise on diversity, non-discrimination, and fairness. For example, due to insufficient training data<\/span>, AI models can amplify human biases and pose a risk for minorities.<\/span><\/span>\u00a0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Who should be involved in an Ethics Board? <\/h4>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

The practice of having an Ethics Board is still relatively new. When the VDAB (<\/span>Vlaamse<\/span> Dienst<\/span> voor<\/span> Arbeidsbemiddeling<\/span> en<\/span> Beroepsopleiding<\/span>) launched its Ethics Board in 2022 to oversee its use of AI, it became the first organization in Belgium to <\/span>initiate<\/span> such an effort. We were involved with their initiative, and if you examine its Ethics Board, <\/span>you\u2019ll<\/span> see that half of its members are internal representatives, while the other half come from outside the organization. The internal members encompass a combination of business and technical <\/span>expertise<\/span>, <\/span>whereas<\/span> the external members consist o<\/span>f individuals from areas such as business, industry, law, and ethics, including both academic and industry backgrounds. <\/span>It\u2019s<\/span> crucial to have this diverse and interdisciplinary mix of profiles to comprehensively address the ethical issues surrounding AI.<\/span><\/span>\u00a0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

How does an Ethics Board influence decision-making in an organization? <\/h4>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

It depends on the mandate that the organization gives to the Ethics Board. In many cases, an Ethics Board will investigate a particular issue, explore<\/span> potential options, and reach<\/span> a consensus on the advice to be provided. <\/span>It\u2019<\/span>s<\/span> th<\/span>en up to the established governance mechanisms within the organization, such as the Board of Directors, to <\/span>det<\/span>ermine<\/span> th<\/span>e actions based on this advice. <\/span>It\u2019<\/span>s<\/span> im<\/span>portant to note that the role of an Ethics Board is to inform, not to make final decisions.<\/span><\/span>\u00a0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

Are there tools available to assist organizations in evaluating their AI systems? <\/h4>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Yes, there are several tools available. One particularly noteworthy tool is <\/span><\/span>capAI<\/span><\/span><\/a>, which was developed by researchers at the University of Oxford<\/span> to provide an independent, comparable, quantifiable, and accountable assessment of AI systems that conforms with the proposed EU AI Act regulation<\/span>. <\/span>Many other tools, created solely by ethicists, offer rigid advice without considering the complexity of issues. <\/span>CapAI<\/span>, though, distinguishes itself by having an <\/span>interdisciplinary team behind it. <\/span>As a result, it <\/span>maintains<\/span> a balanced approach that <\/span>take<\/span>s int<\/span>o account<\/span> ethical<\/span>, technical, and<\/span> business <\/span>aspects<\/span>.<\/span> It\u2019s<\/span> a pragmat<\/span>ic t<\/span>ool developed in collaboration with business schools, and <\/span>it\u2019s<\/span> explained<\/span> in <\/span>plain language for individuals with varying levels of technical<\/span> exp<\/span>ertise<\/span>.<\/span><\/span>\u00a0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

When designing an AI system, <\/span>it\u2019s<\/span> also essential to raise questions at each stage of its life cycle. There are five key stages in the AI <\/span>tools <\/span>life cycle: design, development, evaluation, operation, and retirement. <\/span>CapAI<\/span> ensures adherence to the principles <\/span>set forth in<\/span> the AI Act throughout each of these stages, incorporating input from all stakeholders, including the business owner, the technical lead, and end users.<\/span><\/span>\u00a0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

How can Sparkle assist companies with AI systems, and what sets them apart? <\/h4>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Sparkle offers an EU AI Act (AIA) readiness track, which guides your organization to achieve compliance with your AI systems.<\/strong> We analyze the associated risks and <\/span>determine<\/span> your obligations based on the AI systems within your portfolio. We also <\/span>provide<\/span> a final report that includes recommendations. This includes technical considerations, such as which logs you need to store, because <\/span>organizations<\/span> remain<\/span> r<\/span>espons<\/span>ible for<\/span> post-log monitoring once<\/span> AI <\/span>tools<\/span> are<\/span> deploy<\/span>ed<\/span>.<\/span><\/span>\u00a0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Our approach stands out due to our pragmatic and <\/span>holistic approach<\/span> on<\/span><\/strong> AI.<\/strong> We <\/span>firmly believe<\/span> in an interdisciplinary approach. We combine our technical <\/strong><\/span>expertise<\/span><\/strong> in data and AI with a comprehensive understanding of the EU AI Act and substantial experience in innovation management.<\/strong> The latter is particularly important in this domain. Many people erroneously assume that the EU AI Act will slow down innovation in AI. However, this misconception arises from viewing the AI Act merely from a legal perspective, per<\/span>ceiving it as a set of restrictions. At Sparkle, we strive to develop AI solutions that align with the innovation cycle, from <\/span>initial<\/span> experimentation to production and deployment. As AI translators, <\/span>we\u2019re<\/span> able to build bridges between various stakeholders, translating business needs into practical AI solutions.<\/span><\/span>\u00a0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t\t\t

Curious about the impact of the AI Act on your business?<\/span><\/b> Contact us<\/span><\/a> or directly Koen Mathijs<\/a> (our EU AI Act Manager) to find out more.<\/span>\u00a0<\/span><\/p>\t\t\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t

ABOUT THE INTERVIEWER<\/h3>\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t
\n\t\t\t\t\t\t\t\n\t\t\t\t\t\"Picture\n\t\t\t\t<\/a>\n\t\t\t\n\t\t\t
\n\t\t\t\t\t\t\t\t\t\n\t\t\t\t\t\t

\n\t\t\t\t\t\t\tJens Meijen \t\t\t\t\t\t<\/h4>\n\t\t\t\t\t<\/a>\n\t\t\t\t\n\t\t\t\t\t\t\t\t\t
\n\t\t\t\t\t\t

Consultant at Sparkle & PhD at KU Leuven <\/p>\n\t\t\t\t\t<\/div>\n\t\t\t\t\n\t\t\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t<\/section>\n\t\t\t\t

\n\t\t\t\t\t\t
\n\t\t\t\t\t
\n\t\t\t
\n\t\t\t\t\t\t
\n\t\t\t\t
\n\t\t\t\t\t\t\t