Latest

Dec
01
Arxiv Dives - Vision Transformers (ViT)

Arxiv Dives - Vision Transformers (ViT)

With all of the hype around Transformers for natural language processing and text, the authors of this paper beg the
13 min read
Nov
26
Reading List For Andrej Karpathy’s “Intro to Large Language Models” Video

Reading List For Andrej Karpathy’s “Intro to Large Language Models” Video

Andrej Karpathy recently released an hour long talk on “The busy person’s intro to large language models” that had
11 min read
Nov
21
Arxiv Dives - A Mathematical Framework for Transformer Circuits - Part 2

Arxiv Dives - A Mathematical Framework for Transformer Circuits - Part 2

Every Friday at Oxen.ai we host a paper club called "Arxiv Dives" to make us smarter Oxen
16 min read
Nov
11
Arxiv Dives - A Mathematical Framework for Transformer Circuits - Part 1

Arxiv Dives - A Mathematical Framework for Transformer Circuits - Part 1

Every Friday at Oxen.ai we host a paper club called "Arxiv Dives" to make us smarter Oxen
13 min read
Nov
09
Data Version Control 101 with Oxen

Data Version Control 101 with Oxen

This intro tutorial from Oxen.ai shows how Oxen can make versioning your data as easy as versioning your code.
12 min read
Nov
05
Arxiv Dive Manifesto

Arxiv Dive Manifesto

Every Friday the team at Oxen.ai gets together and goes over research papers, blog posts, or books that help
4 min read
Nov
04
Arxiv Dives - Attention Is All You Need

Arxiv Dives - Attention Is All You Need

Every Friday at Oxen.ai we host a paper club called "Arxiv Dives" to make us smarter Oxen
17 min read
Oct
27
Arxiv Dives - How LoRA fine-tuning works

Arxiv Dives - How LoRA fine-tuning works

Every Friday at Oxen.ai we host a paper club called "Arxiv Dives" to make us smarter Oxen
10 min read
Oct
23
How to run Llama-2 on CPU after fine-tuning with LoRA

How to run Llama-2 on CPU after fine-tuning with LoRA

Running Large Language Models (LLMs) on the edge is a fascinating area of research, and opens up many use cases
10 min read
Oct
20
Arxiv Dives - Generating Speech from Text with Fast Speech-2

Arxiv Dives - Generating Speech from Text with Fast Speech-2

Every Friday at Oxen.ai we host a public paper club called "Arxiv Dives" to make us smarter
11 min read