Deep-learning model extracts important data from health records to assist with personalized medicine

Electronic health records (EHRs) need a new public relations manager. Ten years ago, the U.S. government passed a law that required hospitals to digitize their health records with the intent of improving and streamlining care. The enormous amount of information in these now-digital records could be used to answer very specific questions beyond the scope …

Impact of Language Characteristics on Multi-Lingual Text-to-Text Transfer

In this work, we analyze a pre-trained mT5 to discover the attributes of cross-lingual connections learned by this model. Through a statistical interpretation framework over 90 language pairs across three tasks, we show that transfer performance can be modeled by a few linguistic and data-derived features. These observations enable us to interpret cross-lingual understanding of …

Beyond CAGE: Investigating Generalization of Learned Autonomous Network Defense Policies

This paper was accepted at “Reinforcement Learning for Real Life” workshop at NeurIPS 2022. Advancements in reinforcement learning (RL) have inspired new directions in intelligent automation of network defense. However, many of these advancements have either outpaced their application to network security or have not considered the challenges associated with implementing them in the real-world. …

Rewards Encoding Environment Dynamics Improves Preference-based Reinforcement Learning

This paper was accepted at the workshop at “Human-in-the-Loop Learning Workshop” at NeurIPS 2022. Preference-based reinforcement learning (RL) algorithms help avoid the pitfalls of hand-crafted reward functions by distilling them from human preference feedback, but they remain impractical due to the burdensome number of labels required from the human, even for relatively simple tasks. In …

ChatGPT

ChatGPT: Optimizing Language Models for Dialogue

We’ve trained a model called ChatGPT which interacts in a conversational way. The dialogue format makes it possible for ChatGPT to answer followup questions, admit its mistakes, challenge incorrect premises, and reject inappropriate requests. ChatGPT is a sibling model to InstructGPT, which is trained to follow an instruction in a prompt and provide a detailed …

Embeddable AI saves time building powerful AI applications

Just a few weeks ago, IBM announced an expansion to their embeddable AI software portfolio with the release of three containerized Watson libraries. This expansion allows our partners to embed popular IBM Watson capabilities, including natural language processing, speech-to-text, and text-to-speech into their applications and solutions. But what is embeddable AI, and what are its uses? Embeddable …