GPT detectors can be biased against non-native English writers

Researchers show that computer programs commonly used to determine if a text was written by artificial intelligence tend to falsely label articles written by non-native language speakers as AI-generated. The researchers caution against the use of such AI text detectors for their unreliability, which could have negative impacts on individuals including students and those applying …

ssl blogpost fig2

On the Stepwise Nature of Self-Supervised Learning

Figure 1: stepwise behavior in self-supervised learning. When training common SSL algorithms, we find that the loss descends in a stepwise fashion (top left) and the learned embeddings iteratively increase in dimensionality (bottom left). Direct visualization of embeddings (right; top three PCA directions shown) confirms that embeddings are initially collapsed to a point, which then …

What is a knowledge worker and what do they do?

Knowledge workers, typically those with advanced training and years of experience, have become a valuable asset for companies worldwide. Businesses lean on these people who “think for a living” to drive innovation, solve problems and manage personnel. Yet, empowering knowledge workers to stay productive can be a constant challenge. Too often, these skilled workers get …

hero

Modular visual question answering via code generation

Posted by Sanjay Subramanian, PhD student, UC Berkeley, and Arsha Nagrani, Research Scientist, Google Research, Perception Team Visual question answering (VQA) is a machine learning task that requires a model to answer a question about an image or a set of images. Conventional VQA approaches need a large amount of labeled training data consisting of …