AIA 2025

Overview

AI systems are increasingly interacting with users who are not experts in AI. This has led to growing calls for better safety assessment and regulation of AI systems. However, broad questions remain on the processes and technical approaches that would be required to conceptualize, express, manage, and enforce such regulations for adaptive AI systems, which by nature, are expected to exhibit different behaviors while adapting to evolving user requirements and deployment environments.

This workshop will foster research and development of new paradigms for assessment and design of AI systems that are not only efficient according to a task-based performance measure, but also safe to use by diverse groups of users and compliant with the relevant regulatory frameworks. It will highlight and engender research on new paradigms and algorithms for assessing AI systems' compliance with a variety of evolving safety and regulatory requirements, along with methods for expressing such requirements.

We also expect that the workshop will lead to a productive exchange of ideas across two highly active fields of research, viz., AI and formal methods. The organization team includes active researchers from both fields and our pool of invited speakers features prominent researchers from both areas.

The workshop will cover topics such as:

Assessment of AI system capabilities.
Algorithmic paradigms for assessment of safety and/or compliance of AI systems with evolving regulations.
Learning predictive models of agent behavior.
Self-assessment and monitoring.
Differential assessment of AI systems following system updates or learning.
Assessment of black-box AI systems.
Types of assessment frameworks and ecosystems.
Specification languages and representations for specifying requirements on AI systems.
Assessment of LLM-based agents.
Specification and assessment of compliance w.r.t. ethics/ethical properties.
Regulation, management, and enforcement of AI assessment paradigms.