Chasing the wrong benchmarks in Machine Learning – How it will fail in production

Info

AI Startup Rising is launching its AI Academy with a talk by Nils Reimers, NLP researcher at Hugging Face on March 22, 2022 at 5pm. He will present his view on chasing wrong benchmarks in ML and how they will fail in production.

About the speaker

Nils Reimers is a NLP researcher at Hugging Face and his research focus is on representation learning & neural search. During his post-doc at the UKP Lab at TU Darmstadt, he authored Sentence-BERT, which later resulted in the popular sentence-transformers library that allows to compute state-of-the-art text and image embeddings. In his research, he focuses on making text embeddings & neural search more widely accessible with a focus on domain adaptation und multilinguality. In May 2021, Nils joined Hugging Face to lead the research team on Neural Search where he focusses on how to adapt neural search models to new domains without the availability of labeled data. Nils has authored several popular papers on how to evaluate machine learning models and the pitfalls that can happen there. In his well-received medium.com article early this year he investigated how well GPT-3 based embeddings would work and if they really are a new state of art.

AI Startup Rising

AI Startup Rising channels the startup activities of hessian.AI, the Hessian Center for Artifical Intelligence. The goal is to aggregate and expand existing competencies in Hesse and to build an internationally visible AI innovation ecosystem that understands the region’s cutting-edge AI research as a source of sustainable high-tech and deep-tech startups, produces successful startups, and acts as a point of attraction for talent, investors, and companies.

→ Further information on hessian.AI

K.I.E.Z.

K.I.E.Z. is an initiative dedicated to facilitate entrepreneurs in AI with scientific expertise as well as access to capital, industry partners and hiring talent. From the first idea to the successful business, K.I.E.Z provides science-based AI startups with everything they need to grow fast and sustainably.

→ Further information on K.I.E.Z.

AI Campus

Initiated by Merantix, the AI Campus is a not-for-profit space where research, startups and corporates come together and collaborate on Artificial Intelligence.

→ Further information on AI Campus

Go to Registration »