Researchers in Poland and the UK have developed MiraGe, a system that uses Gaussian Splatting to edit images by interpreting selected parts into 3D space. The process involves moving the selected section into 3D space through Gaussian Splatting, manipulating it, and then applying the modification to the image. The system infers geometry by creating a mirror image of the selection and approximating 3D coordinates embodied in a Splat. MiraGe offers high-quality reconstructions and applies soft-body physics to the temporarily-3D selection. The system has outperformed previous approaches, providing state-of-the-art performance in image editing tasks. No generative AI like LDMs is involved, making it a unique approach.
https://www.unite.ai/image-editing-with-gaussian-splatting/