victor tsaran

1 year ago

victor tsaran
1 year ago

What is Flash Attention huggingface.co/docs/text-gener… #llm #ai #ollama

Flash Attention

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

^{huggingface.co}

Unknown parent

victor tsaran

Unknown parent 1 year ago

@chikim I'm sure it will come! :)

@Chi Kim

Unknown parent

victor tsaran

Unknown parent 1 year ago

@chikim Aren't they now talking about double-flash-attention, or something like that? I came across it yesterday, but didn't dig too deep into it just yet.

@Chi Kim

⇧

victor tsaran

victor tsaran 1 year ago • •

Flash Attention

victor tsaran

victor tsaran

victor tsaran
1 year ago