By combining theoretical abstraction with practical impact, Stéphane Mallat has left a lasting mark on mathematics and computer science. From the JPEG 2000 image compression standard to the mathematical foundations of artificial intelligence, he has shaped tools that have become essential. He is the 2025 recipient of the CNRS Gold Medal.
“We often imagine mathematics as a collection of abstract concepts that apply ‘from above’ onto reality. But more often than not, it works the other way around: real-world problems push us to invent new mathematical tools. And to shape them, one has to ‘get one’s hands dirty,’ building bridges between abstract theory and concrete questions from the world. That frontier, between the two, is precisely where I feel comfortable.”
The scientific work of the 62-year-old researcher – broad forehead topped with unruly hair, gentle blue eyes, and a warm smile – makes the point. His contributions have profoundly influenced the field of applied mathematics to signal processing. He is best known as the inventor of a key algorithm behind the JPEG 2000 compression format, and for pioneering the mathematical insights that help us understand deep learning models at the heart of modern artificial intelligence.
Stéphane Mallat, holder of the Chair of Data Science at the Collège de France and researcher at the École Normale Supérieure, member of the French Academy of Sciences and of the U.S. National Academy of Engineering, co-signatory of ten patents, and recipient of the CNRS Innovation Medal along with numerous other prestigious distinctions, has now been awarded France’s highest scientific distinction: the CNRS Gold Medal.
From an early age, Stéphane showed a passion for mathematics – “a bubble in which I felt at ease” – yet to him, they seemed too ethereal to imagine as a future career. As a child, he loved “building things, giving shape to ideas, like an engineer,” through woodworking.
"If I returned to mathematics, it was thanks to intuitions sparked by practical applications. That's when I realised the extraordinary power and beauty of abstract concepts, their ability to capture the essence of realities that, on the surface, look completely different.”
After excelling at École Polytechnique, he left for the University of Pennsylvania in the United States. There, in 1988, he completed a PhD in mathematics applied to image processing under the guidance of Ruzena Bajcsy – “a pioneer in the field” – at a time when digital technology was booming.
An image of 1000x1000 pixels contains a million numerical values; each pixel is a number between 0 (black) and 255 (white). How to extract information from such an avalanche of bytes? His PhD supervisor proposed trying to do so by changing image resolution.
Throughout his PhD, and during the subsequent eight years at the prestigious Courant Institute in New York, he focused on uncovering the principles governing the extraction of information from various types of digital data – images, sounds, electrocardiograms – with a central objective: to represent large-scale data as a superposition of a minimal number of elementary structures.
“This is somewhat akin to constructing a house from Lego blocks, using the fewest possible bricks while retaining the ability to define the shape of these elementary components,” he explains. The question of sparse representation, reminiscent of the principle of simplicity underlying Ockham’s razor in philosophy, arises across all fields.
For instance in music, a polyphonic melody consists of a succession of elementary blocks that are the notes, each with its own pitch and duration. “With an image, being sparse means focusing on significant variations, such as a contour or abrupt change in colour. In mathematics, the goal is to capture the essence of the problem – the pursuit of sparsity – while freeing oneself from the context of specific applications, in order to discover general solutions that can later have a wide range of applications." From the very beginning of his career, Stéphane Mallat set out in search of these fundamental structures capable of representing any type of data sparsely. Serendipity would eventually guide him toward these elementary building blocks.

One summer, while on the beach, a friend mentioned the work of the mathematician Yves Meyer on “wavelets.” In mathematics, a wavelet is a curve that oscillates over a small domain and then vanishes. Intrigued, Mallat obtained Meyer’s paper, which showed, among other things, that any complex curve can be represented as a superposition of very particular wavelets. The mathematical problem raised by Yves Meyer was to determine whether it was possible to construct other types of wavelets capable of producing sparser decompositions^[1]^.
“I found a solution to this mathematical question based on the image processing problem posed by Ruzena Bajcsy,” explains Stéphane Mallat. “In image processing, wavelets can be interpreted as details that progressively increase the resolution of an image. Following this approach, I introduced the theory of multiresolution analyses, which provides a framework for constructing all mathematical wavelets. In this way, the intuition derived from image processing led me to the solution of the mathematical problem, but it was the mathematical abstraction that enabled me to understand how to compute the ‘wavelet transform.’” This is a fast algorithm, known as the Mallat's algorithm, capable of rewriting any digital data – such as an image composed of millions of pixels – as a superposition of a much smaller number of wavelets, each representing a local variation within the image.
“While Bajcsy was my mentor on the applications side, Meyer was undoubtedly the one on abstraction, and I move back and forth from one to the other.”
Mallat’s powerful algorithm, which is capable of rapidly compressing images without any no loss of information, was central to the many applications that emerged around the turn of the millennium, including the JPEG 2000 image compression standard. Under Mallat’s leadership, the mathematical language of wavelets generated a global standard used not only in software, but also in numerous medical, meteorological, and astronomical databases.

Already celebrated and recognised worldwide as a scientist whose work commands attention, the bridge-builder continues his rapid ascent. He aims to further advance the sparsity in data representation of which he is the architect. “In writing, using a limited vocabulary, one can certainly express complex ideas, but this comes with the risk of resorting to long circumlocutions and, ultimately, producing approximations. To create shorter, more impactful sentences, one must enrich the vocabulary. This is why I introduced the concept of a ‘mathematical dictionary,’ comprising a large number of elementary building blocks, more specialised than wavelets.”
Back in France, where he served as the Director of the Mathematics Department at Polytechnique beginning in 1998, he applied these results by building dictionaries of bandlets, to more effectively represent images and the geometry of contours. This work ultimately prompted him to make a significant change in his professional life.
In 2001, he founded the start-up Let It Wave with three of his former doctoral students. “Almost overnight, I went from being an academic to a CEO, and I discovered an entirely new world: marketing, negotiating funding rounds, concern that the venture would abruptly stop for lack of subsidies… It was exhilarating, and in some ways similar to research: entrepreneurs also need to be excited like children about an idea they believe will revolutionise the world, even if it might collapse in a fortnight. They have a vision and are never jaded, which, in my view is an essential quality. But by moving into this world, I realised how much I missed research and teaching.” Too much concreteness, not enough abstraction.

So after profitably selling Let It Wave, he returned to Polytechnique in 2007, where he introduced entrepreneurship classes for students, a way of passing the torch of the builder. “Yet as a researcher, I went through a dry spell. I had no desire to repeat what I had done before, all the ideas I had in mind seemed already explored. I was in doubt, wondering whether at 45 years of age I was too old to take up research again, to invent new mathematics or algorithms.” And then the horizon brightened. In 2008, he discovered Yann LeCun’s results on deep neural networks. “I knew enough about image processing applications to realise that these computer programs inspired by the human brain, did not merely represent incremental progress, but they constituted a genuine paradigm shift.”
Mallat plunged headfirst into the world of artificial intelligence, with a clear objective: to develop mathematical models to understand the remarkable performance of neural networks. These networks learn to answer a question by analysing data, for example identifying the animal in an image. During their training, they are provided with millions of examples, each paired with the correct answer – the name of the animal corresponding to each image. Much like a student practicing exercises, the network learns by adjusting its internal parameters to make fewer mistakes. “But how does it manage to provide so many correct answers for new images it has never seen? It’s a mystery, because these problems are highly complex. What type of information has it learned to extract from the data? I observed that these neural networks initially compute a ‘wavelet transform’. This reminded me of the results of neurophysiologists, who have also identified ‘wavelet transforms’ in the primary areas of our visual cortex, as well as in the cochlea in the ear.”

Building on his expertise and interdisciplinary vision, Mallat showed that a neural network builds hierarchical representations. It separates the largest structures, for example the coarse outline of a face in an image, and represents finer components relative to the broader ones. For instance, the eyes relative to the face, and the pupil relative to the eye. “The wavelet transform is a first step in constructing this hierarchy,” he explains.
By elucidating this mechanism, he laid the mathematical foundations for deep learning models, which underpin many AI systems today. “But the deeper one goes into the network layers, the more sophisticated the structures the network detects. Certain neurons activate for very specific features, such as a melody or a face. It is as if these deep layers represented data with very rich and highly specialised ‘mathematical dictionaries,’ whose properties remain poorly understood by scientists.” All these results, he emphasizes, were achieved collectively: “In science, one almost never moves forward alone. Throughout my career, I have worked extensively with my doctoral students and numerous collaborators. They have supported me in formulating the right questions, sharing both successes and setbacks. Each, in their own way, has brought fundamental contributions.”
Do these artificial intelligences, which Mallat is still studying today, pose a threat to our societies? “They bring remarkable advances, for example in medicine, but like any technology, they also carry risks – for privacy, and because of their potential military use,” he points out. "It is therefore crucial to control and regulate them, but that is not solely the responsibilityof governments. Each of us is confronted with this revolution, and will need to adapt to take advantage of the best it offers, while avoiding the pitfalls. This requires understanding AI, and not mythologizing it. It is with this goal in mind that I created MathAData^[2]^, a high school teaching programme for mathematics directly linked to solving practical AI problems. We can see that middle and high school students are much more motivated to learn maths when they understand it lies at heart of major issues and the tools of their everyday lives.”
How do you, Stéphane Mallat, spend your time when not navigating oceans of data, or building bridges between great ideas and reality? “I love to dance. Tango, rock-and roll… sometimes on the banks of the Seine. When I dance, I’m in another world, that of the music and my partner. I disconnect.” After all, don’t builders sometimes need to take a breather?