[NeurIPS 2025] Beyond Masked and Unmasked: Discrete Diffusion Models via Partial Masking
-
Updated
Jun 15, 2026 - Python
#
openwebtext
Here are 6 public repositories matching this topic...
[ICLR 2026] Polynomial, trigonometric, and tropical activations
machine-learning ai deep-learning mapping transformers pytorch artificial-intelligence polynomials basis neural-networks imagenet convolutional-neural-networks fourier-series activations trigonometric-functions tropical-geometry orthogonal gpt-2 openwebtext kolmogorov-arnold-networks
-
Updated
Feb 23, 2026 - Jupyter Notebook
nanoGPT model from scratch
-
Updated
Apr 4, 2025 - Python
nanoGPT for Diffusion Language Models
-
Updated
Jun 5, 2026 - Python
WiggleGPT is an language model that integrates bio-inspired neural architectures into a GPT-2-style transformer.
transformers pytorch open-science gpt language-model activation-functions openwebtext nanogpt bio-inspired-deep-learning
-
Updated
Dec 8, 2025 - Python
A compact decoder-only Transformer implemented in PyTorch and trained on streamed OpenWebText.
-
Updated
Aug 12, 2026
Add this topic to your repo
To associate your repository with the openwebtext topic, visit your repo's landing page and select "manage topics."