<!-- Copyright (c) 2021 Graphcore Ltd. All rights reserved. -->
# Code Used in Blogs

This directory contains code used in Graphcore blogs

## Contents
- The [packedBERT](packedBERT) folder contains supporting code for: ["Packing: Towards 2x NLP BERT Acceleration"](https://arxiv.org/abs/2107.02027) and for the corresponding blog post: ["Introducing Packed BERT for 2x Training Speed-up in Natural Language Processing"](https://towardsdatascience.com/introducing-packed-bert-for-2x-faster-training-in-natural-language-processing-eadb749962b1).
- The [finetuning-packedBERT](finetuning-packedBERT) folder contains a supporting deep-dive walkthrough for the "Accelerating fine-tuning and inference with PackedBERT" article and the [Paperspace fine-tuning packedBERT notebooks](https://console.paperspace.com/github/gradient-ai/Graphcore-HuggingFace?file=%2Fpacked-bert).
