Sign in Subscribe
Arxiv Dives

Arxiv Dives

Each week we dive deep into a topic in machine learning, data management, or general artificial intelligence research. These are notes from a live reading group we do every Friday. Captured for future reference. Join the community here: https://lu.ma/oxenbookclub
Dec
23
Arxiv Dives - How Mistral 7B works

Arxiv Dives - How Mistral 7B works

What is Mistral 7B? Mistral 7B is an open weights large language model by Mistral.ai that was build for
10 min read
Dec
15
Mamba: Linear-Time Sequence Modeling with Selective State Spaces - Arxiv Dives

Mamba: Linear-Time Sequence Modeling with Selective State Spaces - Arxiv Dives

What is Mamba 🐍? Mamba at it's core is a recurrent neural network architecture, that outperforms Transformers with faster
15 min read
Dec
13
Practical ML Dive - How to customize a Vision Transformer on your own data

Practical ML Dive - How to customize a Vision Transformer on your own data

Welcome to Practical ML Dives, a series spin off of Arxiv Dives. In Arxiv Dives, we cover state of the
20 min read
Dec
08
Arxiv Dives - Zero-shot Image Classification with CLIP

Arxiv Dives - Zero-shot Image Classification with CLIP

CLIP explores the efficacy of learning image representations from scratch with 400 million image-text pairs, showcasing zero-shot transfer capabilities across
14 min read
Dec
01
Arxiv Dives - Vision Transformers (ViT)

Arxiv Dives - Vision Transformers (ViT)

With all of the hype around Transformers for natural language processing and text, the authors of this paper beg the
13 min read
Nov
21
Arxiv Dives - A Mathematical Framework for Transformer Circuits - Part 2

Arxiv Dives - A Mathematical Framework for Transformer Circuits - Part 2

Every Friday at Oxen.ai we host a paper club called "Arxiv Dives" to make us smarter Oxen
16 min read
Nov
11
Arxiv Dives - A Mathematical Framework for Transformer Circuits - Part 1

Arxiv Dives - A Mathematical Framework for Transformer Circuits - Part 1

Every Friday at Oxen.ai we host a paper club called "Arxiv Dives" to make us smarter Oxen
13 min read
Nov
05
Arxiv Dive Manifesto

Arxiv Dive Manifesto

Every Friday the team at Oxen.ai gets together and goes over research papers, blog posts, or books that help
4 min read
Nov
04
Arxiv Dives - Attention Is All You Need

Arxiv Dives - Attention Is All You Need

Every Friday at Oxen.ai we host a paper club called "Arxiv Dives" to make us smarter Oxen
17 min read
Oct
27
Arxiv Dives - How LoRA fine-tuning works

Arxiv Dives - How LoRA fine-tuning works

Every Friday at Oxen.ai we host a paper club called "Arxiv Dives" to make us smarter Oxen
10 min read