HomeOVERVIEWOn a Neural Implementation of Brenier's Polar Factorization

On a Neural Implementation of Brenier’s Polar Factorization

In 1991, Brenier proved a theorem that generalizes the polar decomposition for square matrices — factored as PSD ×\times× unitary — to any vector field F:Rd→RdF:\mathbb{R}^d\rightarrow \mathbb{R}^dF:Rd→Rd. The theorem, known as the polar factorization theorem, states that any field FFF can be recovered as the composition of the gradient of a convex function uuu with a measure-preserving map MMM, namely F=∇u∘MF=\nabla u \circ MF=∇u∘M. We propose a practical implementation of this far-reaching theoretical result, and explore possible uses within machine learning. The theorem is closely related to optimal transport (OT) theory, and we borrow from recent advances in the field of neural optimal transport to parameterize the potential uuu as an input convex neural network. The map MMM can be either evaluated pointwise using u∗u^*u∗, the convex conjugate of uuu, through the identity M=∇u∗∘FM=\nabla u^* \circ FM=∇u∗∘F, or learned as an auxiliary network. Because MMM is, in general, not injective, we consider the additional task of estimating the ill-posed inverse map that can approximate the pre-image measure M−1M^{-1}M−1 using a stochastic generator. We illustrate possible applications of Brenier’s polar factorization to non-convex optimization problems, as well as sampling of densities that are not log-concave.

Latest articles

Newbury BS cuts resi, expat, landlord rates by up to 30bps  – Mortgage Strategy

Newbury Building Society has cut fixed-rate offers by up to 30 basis points...

Rate and Term Refinances Are Up a Whopping 300% from a Year Ago

What a difference a year makes.While the mortgage industry has been purchase loan-heavy for...

Goldman Sachs loses profit after hits from GreenSky, real estate

Second-quarter profit fell 58% to $1.22 billion, or $3.08 a share, due to steep...

Why Do AIs Lie?

Zeroth Principles can clarify many issues in the ML/AI domain. As discussed in a...

More like this

Data Structures: Fundamental Building Blocks in Computer Science

Within this tutorial, we explore the differences between the many data structures in computer...

Goldman Sachs loses profit after hits from GreenSky, real estate

Second-quarter profit fell 58% to $1.22 billion, or $3.08 a share, due to steep...

2024 BAIR Graduate Directory – The Berkeley Artificial Intelligence Research Blog

Every year, the Berkeley Artificial Intelligence Research (BAIR) Lab graduates some of...