Nvidia Research Introduces DiffUHaul, an AI Tool That Allows Object Relocation in Images

The DIffUHaul is a training-free technique, meaning the tool is not required to be pre-trained on any datasets.

Advertisement
Written by Akash Dutta, Edited by Manas Mitul | Updated: 2 December 2024 18:59 IST
Highlights
  • Nvidia researchers published a paper on DiffUHaul
  • The AI tool works on the principle of text-to-image diffusion
  • Nvidia’s DiffUHaul uses BlogGEN model for spatial understanding
Nvidia Research Introduces DiffUHaul, an AI Tool That Allows Object Relocation in Images

The researchers highlighted that existing AI models struggle with object relocation

Photo Credit: Nvidia

Nvidia researchers introduced a new artificial intelligence (AI) model Monday that can relocate objects in an image. Dubbed DiffUHaul, the tool can spatially understand the context of an image to move an object from one place to another without impacting the background or the shape of the image. The unique aspect of this technique is that it is training-free, meaning no pre-training data was used to build this tool. The new technology was showcased by the company at the Special Interest Group on Computer Graphics and Interactive Techniques (SIGGRAPH) Asia 2024 conference.

Nvidia Researchers Introduce DiffUHaul AI Tool

In a research paper, Nvidia researchers detailed the new AI tool. The technology was developed in collaboration with The Hebrew University of Jerusalem, Tel Aviv University, and Reichman University. With the new tool, the researchers aimed to solve a prominent issue with AI image generation models – the problem of relocating objects in an image with spatial awareness.

The paper highlights that this particular editing task has remained a bottleneck for AI scientists due to AI models lacking spatial reasoning. Existing visual models can understand the context of an image, but are unable to move objects as they do not understand how a movement in a 2D environment would be perceived spatially.

With DiffUHaul, Nvidia claims this issue can be solved. Based on image diffusion architecture, the tool uses attention masking in the denoising step. This is done to preserve the high-level object appearance. The AI tool uses BlobGEN, a new technique that integrates spatial understanding into the AI tool. Further, new techniques were used to reconstruct real images with the localised model in the designated place.

Advertisement

On the front end, users will be able to type a text prompt highlighting the object they want changed and the AI can spatially readjust the object while adjusting the background accordingly. In demonstrations shown by the company, it could not be determined if the AI editing tool can understand the shape changes that come with spatial movement. For instance, if an air-borne balloon is moved to the ground, its shape is also changed. However, the AI might not be able to capture that due to a lack of training.

 

For the latest tech news and reviews, follow Gadgets 360 on X, Facebook, WhatsApp, Threads and Google News. For the latest videos on gadgets and tech, subscribe to our YouTube channel. If you want to know everything about top influencers, follow our in-house Who'sThat360 on Instagram and YouTube.

Advertisement

Related Stories

Popular Mobile Brands
  1. Nothing Phone 3 Price, Colour Options Tipped Ahead of Global Debut
  2. Realme C71 With 6,300mAh Battery Goes Official: Price, Specifications
  3. NxtQuantum's AI+ Nova 2 5G Alleged Live Image Surfaces Online
  4. Google Pixel 10 Series Reportedly Set to Launch on August 20
  5. WhatsApp May Soon Let You Copy Specific Parts of a Message
  6. Vivo Y19s Pro With 6,000mAh Battery, 50-Megapixel Main Camera Launched
  7. NxtQuantum to Launch AI+ Smartphones in India By the End of June
  8. Microsoft Lets EU Users Uninstall Store, Disables Prompts to Use Edge
  1. Samsung Galaxy Z Fold 7 Spotted on WPC Database With Qi 2 Charging Support Like the Galaxy S25 Series
  2. OnePlus Ace 6, OnePlus Ace 6 Pro Tipped to Debut With Snapdragon 8 Series Chips
  3. Vivo Y19s Pro With 6,000mAh Battery, 50-Megapixel Rear Camera Launched: Price, Features
  4. Samsung Galaxy Ring 2 Reportedly in Development, but 2025 Launch Unlikely
  5. Redmi Pad 2 Launch Date Announced; Confirmed to Feature 9,000mAh Battery
  6. NxtQuantum's AI+ Nova 2 5G Alleged Live Images Surfaces Online; Shows Dual Rear Camer Unit
  7. Meta Said to Be Aiming to Fully Automate Advertising With AI by 2026
  8. Robinhood Acquires Bitstamp for $200 Million, Adds Over 50 Licences to Network
  9. Microsoft Windows Users in Europe Can Now Uninstall Microsoft Store, Disable Microsoft Edge Default Prompts
  10. Microsoft Cuts Hundreds More Jobs After Firing 6,000 Last Month
Gadgets 360 is available in
Download Our Apps
Available in Hindi
© Copyright Red Pixels Ventures Limited 2025. All rights reserved.