# Optimizing Memory Usage with Custom Ops: A Case Study with FlashAttention

Demo using the `flash-attention-ipu` library with nanoGPT.

# License
Copyright (c) 2023 Graphcore Ltd. Licensed under the MIT License.

This repository includes [nanoGPT](https://github.com/karpathy/nanoGPT) as a submodule, Copyright (c) 2022 Andrej Karpathy.