Abstract: Generative artificial intelligence (GenAI), specifically, Large Language Models (LLMs), have shown tremendous potential in automating several tasks and improving human productivity. Recent ...
This repository contains the implementation of Constrained Decoding of Diffusion LLMs with Context-Free Grammars, including techniques for multi-region constrained generation. Our method guarantees ...
The main framework of our code is based on bigcode-project. Here is an example demonstrating how to apply Fuzzy-Assisted Contrastive Decoding to a code generation dataset.