Categories: FAANG

Generalization on the Unseen, Logic Reasoning and Degree Curriculum

This paper considers the learning of logical (Boolean) functions with focus on the generalization on the unseen (GOTU) setting, a strong case of out-of-distribution generalization. This is motivated by the fact that the rich combinatorial nature of data in certain reasoning tasks (e.g., arithmetic/logic) makes representative data sampling challenging, and learning successfully under GOTU gives a first vignette of an ‘extrapolating’ or ‘reasoning’ learner. We then study how different network architectures trained by (S)GD perform under GOTU and provide both theoretical and experimental evidence…
AI Generated Robotic Content

Recent Posts

Omnigen 2 is out

It's actually been out for a few days but since I haven't found any discussion…

5 hours ago

From fear to fluency: Why empathy is the missing ingredient in AI rollouts

Empathy and trust are not optional. They are essential for scaling change and encouraging innovation,…

6 hours ago

What Satellite Images Reveal About the US Bombing of Iran’s Nuclear Sites

The US concentrated its attack on Fordow, an enrichment plant built hundreds of feet underground.…

6 hours ago

Half of today’s jobs could vanish—Here’s how smart countries are future-proofing workers

AI is revolutionizing the job landscape, prompting nations worldwide to prepare their workforces for dramatic…

6 hours ago

Spline Path Control v2 – Control the motion of anything without extra prompting! Free and Open Source

Here's v2 of a project I started a few days ago. This will probably be…

1 day ago

STARFlow: Scaling Latent Normalizing Flows for High-resolution Image Synthesis

We present STARFlow, a scalable generative model based on normalizing flows that achieves strong performance…

1 day ago