EF3 – Model-Based Imaging



Deformation Based Regularization of Inverse Problems in Manifolds

Project Heads

Gabriele Steidl

Project Members

Arian Berdellima, Gabriele Steidl

Project Duration

01.09.2020 – 31.08.2022

Located at

TU Berlin


The aim of this project is the modeling, analysis and application of dynamic imaging with a focus on functions defined on special non-Euclidean geometries as well as vector- and manifold-valued functions. A challenge consists in utilizing template based approaches including learning techniques. We will start with dynamic tomography problems related to Radon-type transforms on special geometries appearing in certain applications and consider vector-and manifold-valued images in a long term.

Depending on the concrete application, there are quite different (variational) approaches to model dynamics in imaging as i) optical flow, ii) dynamic optimal transport, iii) large deformation diffeomorphic mapping (LDDMM), and iv) metamorphosis. On the one hand, we intend to enlarge our research from iii) and vi) to a larger class of operators than the classical Radon transform which will require to deal with functions on special manifolds
and to investigate the question how to incorporate multiple prior information into the model. On the other hand, we will deal with inverse problems for vector- and manifold-valued problems, superesolution and compression, segmentation in time evolving frames of images.

The project can be seen as a long term one which merges dynamic inverse problems with manifold structures as well as prior knowledge on the data. We intend to establish new models for solving problems in this emerging eld, to provide a mathematical analysis of the models and ecient minimization algorithms with convergence guarantees. The questions arising in this project come from certain applications related to novel imaging modalities and acquisition techniques as prescribed above. However, the mathematical methods will not be restricted to these applications, but will be of interest on their own.

Project Webpages

Selected Publications

  1. S. Neumayer, J. Persch, and G. Steidl. Regularization of inverse problems via time discrete geodesics
    in image spaces. Inverse Problems, 35(5):055005, 28, 2019.
  2. J. H. Fitschen, F. Laus, and G. Steidl. Transport between RGB images motivated by dynamic
    optimal transport. Journal of Mathematical Imaging and Vision, 56(3):409-429, 2016.
  3. J. Yuan, Ch. Schnörr, and G. Steidl. Simultaneous higher order optical flow estimation and decomposition.
    SIAM Journal of Scienti c Computing, 29(6):2283-2304, 2007.
  4. S. Neumayer, J. Persch and G. Steidl, Morphing of manifold-values images inspired by discrete geodesics in image spaces, SIAM Journal of Imaging Sciences, vol. 11, no. 3, pp. 1898–1930, 2018.

Selected Pictures

Morphing path between a part of the YZ-slices 49 and 51 of the Camino dataset

Please insert any kind of pictures (photos, diagramms, simulations, graphics) related to the project in the above right field (Image with Text), by choosing the green plus image on top of the text editor. (You will be directed to the media library where you can add new files.)
(We need pictures for a lot of purposes in different contexts, like posters, scientific reports, flyers, website,…
Please upload pictures that might be just nice to look at, illustrate, explain or summarize your work.)

As Title in the above form please add a copyright.

And please give a short description of the picture and the context in the above textbox.

Don’t forget to press the “Save changes” button at the bottom of the box.

If you want to add more pictures, please use the “clone”-button at the right top of the above grey box.