xFormers:一个模块化和可编程的Transformer建模

2023-02-24  本文已影响0人  Valar_Morghulis

xFormers: A modular and hackable Transformer modelling library

https://github.com/facebookresearch/xformers

https://facebookresearch.github.io/xformers/components/ops.html#xformers.ops.memory_efficient_attention

Self-attention Does Not Need O(n^2) Memory

https://arxiv.org/abs/2112.05682

上一篇下一篇

猜你喜欢

热点阅读