API

This section contains the information on the api. The primary library is found in Attention. Auxilary functions are found in Glimpses, Loss, and Linear

• Attention
  • Standard
    • Feedforward
    • MultiheadedAttention
  • Parameter Injection
    • Parameter Injected Memory Unit
    • Parameter Injected Summary Unit
  • Context Splitting
    • Local Context Self Attention
    • Global Strategic Processing Unit
  • Ensembles and Specialization
    • Ensemble Exchange Self Attention
• Glimpses
  • view
  • reshape
  • local
  • dilocal
• Loss
  • CrossEntropyEnsembleBoost
  • CrossEntropyAdditiveBoost
• Linear