Publications

Below is a list of recent publications I have written or contributed to. For a complete list, please visit Google Scholar.

UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models

Let's unify all structured-knowledge grounded tasks into the same text-to-text framework!

Towards Neural Functional Program Evaluation

Are neural models bad at interpreting programs? For the AIPLANS NeurIPS workshop in 2021, we created a dataset of functional programs, and trained T5 to reduce them to their normal forms. Turns out it works even for challenging data splits!

PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models

Introducing PICARD - a simple and effective constrained beam search algorithm for any language model. PICARD helps to generate valid code, which is useful for program synthesis and semantic parsing. We achieve SoTA on both Spider and CoSQL.

DuoRAT: Towards Simpler Text-to-SQL Models

It's like RAT-SQL, but simpler and faster.