Meetween

My Personal AI Mediator for Virtual MEETtings BetWEEN People

In a world of increasing preoccupation with artefacts, interacting with our fellow human beings remains one of our most enjoyable, but also one of our practically most critical activities. We derive inspiration from each other, solve problems and chart our future together. Yet our interaction with fellow humans is far from seamless or frictionless: despite much greater world-wide reach, we suffer (perhaps more than ever) from isolation, barriers and separation due to language, culture, physical distances, time-zones, scheduling conflicts, and distractions to our attention. With greater freedom, reach and flexibility, our isolation and complexities also appear to increase. In our proposed project “Meetween”, we aim to find solutions to these problems. Rather than artificial intelligence (AI) getting in the way of the human experience, we harness its power to make human-human interaction more seamless and natural, eliminate language barriers, replace the techno-clutter with support. The project aims to 1) build the science-based technology solutions needed to power the next generation of videoconferencing platforms for Europe, to support smooth, engaging, barrier-free collaboration across languages; 2) exploit the all-round, integrated algorithmic capabilities offered by foundation models and self-supervised training on large datasets to nimbly adapt to participant context, cultural and regional specificities, including linguistic ones; 3) foster and facilitate business collaboration throughout the European Union by providing real-time machine-learning-powered speech-to-speech translation, summarization and virtual assistant services for online meetings; 4) defend a European vision for AI with regard to safety, privacy, social and ethical approaches, anchored in our regulations, data standards and shared initiatives and resources.

Project domains

Interaction & Enabling Technologies
AI / ML
Standards
Sectors
Arts & culture
Educational
Entertainment
Purposes
Learning
Data Processing and IPR
Personal data

Publications

Title Type of output
Prepending or Cross-Attention for Speech-to-Text? An Empirical Comparison Conference proceedings
What the Harm? Quantifying the Tangible Impact of Gender Bias in Machine Translation with a Human-centered Study Conference proceedings
Findings of the Quality Estimation Shared Task at WMT 2024: Are LLMs Closing the Gap in QE? Conference proceedings
FINDINGS OF THE IWSLT 2024 EVALUATION CAMPAIGN Conference proceedings
NUTSHELL: A Dataset for Abstract Generation from Scientific Talks Conference proceedings
StreamAtt: Direct Streaming Speech-to-Text Translation with Attention-based Audio History Selection Conference proceedings
Decoupled Vocabulary Learning Enables Zero-Shot Translation from Unseen Languages Conference proceedings
FBK@IWSLT Test Suites Task: Gender Bias evaluation with MuST-SHE Conference proceedings
Speech Translation with Speech Foundation Models and Large Language Models: What is There and What is Missing? Conference proceedings
SimulSeamless: FBK at IWSLT 2024 Simultaneous Speech Translation Conference proceedings
Quality Estimation with $k$-nearest Neighbors and Automatic Evaluation for Model-specific Quality Estimation Conference proceedings
From Speech to Summary: A Comprehensive Survey of Speech Summarization Conference proceedings
Factorized-VITS: Decoupling Prosody and Text in End-to-End Speech Synthesis without External or Secondary Aligner Conference proceedings
MOSEL: 950,000 Hours of Speech Data for Open-Source Speech Foundation Model Training on EU Languages Conference proceedings
Optimizing Rare Word Accuracy in Direct Speech Translation with a Retrieval-and-Demonstration Approach Conference proceedings
A decade of gender bias in machine translation Peer reviewed articles
How “Real” is Your Real-Time Simultaneous Speech-to-Text Translation System? Peer reviewed articles
Facial Attribute Based Text Guided Face Anonymization Other

Do you want to learn more or discuss about this project?
Visit the Openverse Wiki page for Meetween

Disclaimer and intellectual property acknowledgement: the materials showcased on this page have been produced by third parties, and the OPENVERSE consortium accepts no liability for any inaccuracies therein. Responsibility for the content of each asset rests solely with its original creator. The inclusion of these outputs on this page does not, in any way, constitute an endorsement on the part of the OPENVERSE consortium. All intellectual property rights relating to the content published here remain vested in their respective owners. This page should be understood simply as a practical point of access.