Categories: FAANG

Evaluating social and ethical risks from generative AI

Generative AI systems are already being used to write books, create graphic designs, assist medical practitioners, and are becoming increasingly capable. To ensure these systems are developed and deployed responsibly requires carefully evaluating the potential ethical and social risks they may pose.In our paper, we propose a three-layered framework for evaluating the social and ethical risks of AI systems. This framework includes evaluations of AI system capability, human interaction, and systemic impacts.We also map the current state of safety evaluations and find three main gaps: context, specific risks, and multimodality. To help close these gaps, we call for repurposing existing evaluation methods for generative AI and for implementing a comprehensive approach to evaluation, as in our case study on misinformation. This approach integrates findings like how likely the AI system is to provide factually incorrect information, with insights on how people use that system, and in what context. Multi-layered evaluations can draw conclusions beyond model capability and indicate whether harm — in this case, misinformation — actually occurs and spreads. To make any technology work as intended, both social and technical challenges must be solved. So to better assess AI system safety, these different layers of context must be taken into account. Here, we build upon earlier research identifying the potential risks of large-scale language models, such as privacy leaks, job automation, misinformation, and more — and introduce a way of comprehensively evaluating these risks going forward.
AI Generated Robotic Content

Recent Posts

Chroma needs to ne more supported and publicised

Sorry for my English in advance, but I feel like a disinterest for Chroma in…

15 hours ago

Model Context Protocol: A promising AI integration layer, but not a standard (yet)

Enterprises should experiment with MCP where it adds value, isolate dependencies and prepare for a…

16 hours ago

Are there any open source alternatives to this?

I know there are models available that can fill in or edit parts, but I'm…

2 days ago

The future of engineering belongs to those who build with AI, not without it

As we look ahead, the relationship between engineers and AI systems will likely evolve from…

2 days ago

The 8 Best Handheld Vacuums, Tested and Reviewed (2025)

Lightweight, powerful, and generally inexpensive, the handheld vacuum is the perfect household helper.

2 days ago

I really miss the SD 1.5 days

submitted by /u/Dwanvea [link] [comments]

3 days ago