Lectures & Presentations

While large language models can match or exceed human performance, they do so with memory and energy costs orders of magnitude greater than biological cognition. We investigate sparsity as a brain-inspired computational principle to address both. We first establish a framework for evaluating small language model construction methods, using the next-token logit distribution as a […]

A ubiquitous task in statistical practice is that of variable selection, identifying which of a large set of features are the relevant ones. As data sets with a large number of observations have become increasingly common, new theoretical and computational challenges for model selection have emerged. We consider the variable selection problem for linear models […]