Careful With That Scalpel: Improving Gradient Surgery With an EMA

Beyond minimizing a single training loss, many deep learning estimation pipelines rely on an auxiliary objective to quantify and encourage desirable properties of the model (e.g. performance on another dataset, robustness, agreement with a prior). Although the simplest approach to incorporating an auxiliary loss is to sum it with the training loss as a regularizer, …

ConsiStory

Mile-High AI: NVIDIA Research to Present Advancements in Simulation and Gen AI at SIGGRAPH

NVIDIA is taking an array of advancements in rendering, simulation and generative AI to SIGGRAPH 2024, the premier computer graphics conference, which will take place July 28 – Aug. 1 in Denver. More than 20 papers from NVIDIA Research introduce innovations advancing synthetic data generators and inverse rendering tools that can help train next-generation models. …

Stories written with AI assistance found to be more creative, better written and more enjoyable

A study published in the journal Science Advances finds that AI enhances creativity by boosting the novelty of story ideas as well as the ‘usefulness’ of stories—their ability to engage the target audience and potential for publication. The paper is titled “Generative AI enhances individual creativity but reduces the collective diversity of novel content.”