Categories: AI/ML Research

Fine-Tuning a BERT Model

This article is divided into two parts; they are: • Fine-tuning a BERT Model for GLUE Tasks • Fine-tuning a BERT Model for SQuAD Tasks GLUE is a benchmark for evaluating natural language understanding (NLU) tasks.

Reduce inference time for BERT models using neural architecture search and SageMaker Automated Model Tuning

January 20, 2024

In "FAANG"

AWS performs fine-tuning on a Large Language Model (LLM) to classify toxic speech for a large gaming company

August 8, 2023

In "FAANG"

Combining Compressions for Multiplicative Size Scaling on Natural Language Tasks

Quantization, knowledge distillation, and magnitude pruning are among the most popular methods for neural network compression in NLP. Independently, these methods reduce model size and can accelerate inference, but their relative benefit and combinatorial inter- actions have not been rigorously studied. For each of the eight possible subsets of these…

September 3, 2022

In "FAANG"

AI Generated Robotic Content