BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Events - ECPv6.17.2//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-WR-CALNAME:Events
X-ORIGINAL-URL:https://events.ucsc.edu
X-WR-CALDESC:Events for Events
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:America/Los_Angeles
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:20250309T100000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:20251102T090000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:20260308T100000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:20261101T090000
END:STANDARD
BEGIN:DAYLIGHT
TZOFFSETFROM:-0800
TZOFFSETTO:-0700
TZNAME:PDT
DTSTART:20270314T100000
END:DAYLIGHT
BEGIN:STANDARD
TZOFFSETFROM:-0700
TZOFFSETTO:-0800
TZNAME:PST
DTSTART:20271107T090000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20260724T140000
DTEND;TZID=America/Los_Angeles:20260724T160000
DTSTAMP:20260716T222234Z
CREATED:20260716T222234Z
LAST-MODIFIED:20260716T222234Z
UID:10015099-1784901600-1784908800@events.ucsc.edu
SUMMARY:Gholami\, K. (ECE) - Efficient Language Model Construction and Inference via Sparsity
DESCRIPTION:While large language models can match or exceed human performance\, they do so with memory and energy costs orders of magnitude greater than biological cognition. We investigate sparsity as a brain-inspired computational principle to address both. We first establish a framework for evaluating small language model construction methods\, using the next-token logit distribution as a behavioral fingerprint. Then\, we introduce a semi-structured correlation-aware weight sparsity (CWS) method that uses the full activation covariance to identify and prune correlated weights whose combined removal cost is lower than any individual score predicts. CWS\, improves perplexity over existing criteria up to 70% sparsity. To extend this gain to extreme sparsity\, we propose a hierarchical ADMM framework that optimizes pruning directly against cross-entropy and distillation loss\, first layer-wise for efficiency and then globally for cross-layer coordination. This research establishes brain-inspired principles as a foundation for efficient language models that remain accurate even under extreme compression. \nEvent Host: Kimia Gholami\, Ph.D. Student\, Electrical & Computer Engineering \nAdvisor: Jason Eshraghian \nZoom: https://ucsc.zoom.us/j/9827512398?pwd=SGpDWGtVVG81dkgyTHhjbG81dEVUZz09&omn=98349793611 \nPasscode: 8398
URL:https://events.ucsc.edu/event/gholami-k-ece-efficient-language-model-construction-and-inference-via-sparsity/
LOCATION:Engineering 2\, Engineering 2 1156 High Street\, Santa Cruz\, CA\, 95064
CATEGORIES:Ph.D. Presentations
ATTACH;FMTTYPE=image/png:https://events.ucsc.edu/wp-content/uploads/2026/04/ph.d.-presentation-graphic-option-3.png
GEO:37.0009723;-122.0632371
X-APPLE-STRUCTURED-LOCATION;VALUE=URI;X-ADDRESS=Engineering 2 Engineering 2 1156 High Street Santa Cruz CA 95064;X-APPLE-RADIUS=500;X-TITLE=Engineering 2 1156 High Street:geo:-122.0632371,37.0009723
END:VEVENT
BEGIN:VEVENT
DTSTART;TZID=America/Los_Angeles:20260724T140000
DTEND;TZID=America/Los_Angeles:20260724T170000
DTSTAMP:20260720T162132Z
CREATED:20260720T162049Z
LAST-MODIFIED:20260720T162132Z
UID:10015109-1784901600-1784912400@events.ucsc.edu
SUMMARY:Fontana\, J. (STAT) - When We're Always Wrong: Scalable Variable Selection in M-Open Settings
DESCRIPTION:A ubiquitous task in statistical practice is that of variable selection\, identifying which of a large set of features are the relevant ones. As data sets with a large number of observations have become increasingly common\, new theoretical and computational challenges for model selection have emerged. We consider the variable selection problem for linear models in the M-open setting\, where the data generating process is outside the model space. We focus on the novel problem of “model superinduction”\, which refers to the tendency of model selection procedures to select larger models at an exponential rate as the sample size grows\, resulting in overparametrized models which collapse model interpretability and induce severe computational difficulties. For a set of popular frequentist information criteria and the Bayesian case of mixtures of g-priors\, we prove that when comparing nested models\, the larger model will always be asymptotically selected. We seek to minimize this effect for large n while preserving variable selection consistency.We propose utilizing a mixture of g-priors\, where the hyper-prior on g has hyper-parameters chosen to result in a slowly diminishing rate of prior influence on the posterior\, which favors simpler models while preserving consistency. We also propose a model space prior which induces stronger model complexity penalization for large sample sizes. The posterior model probabilities under our prior choices further provide an alternative information criterion that is resistant to the effects of model superinduction. \nNext\, we extend our results to other classes of popular variable selection priors\, the family of spike and slab priors\, the non-local priors\, and selection procedures that correspond to posterior modes such as the LASSO. We show that these procedures are all afflicted with model superinduction\, except for the continuous spike and slab priors when a Student-t distribution is used for both the spike and the slab. \nFinally\, we address existing bottlenecks in the computation efficacy of spike and slab based variable selection. We demonstrate that Gibbs samplers scale poorly to large sample sizes\, and the proposed alternatives in the literature result in posterior surrogates that are afflicted with superinduction. Instead\, we propose a search strategy based off easy to compute approximations of the posterior model probabilities. We show this procedure\, Fast Approximate Stochastic Search (FASS)\, coupled with post-hoc inference on parameters via either a Block-Variational Bayes approach or an Expectation Propagation approach\, results in competitive performance. We demonstrate the aforementioned phenomena\, and the efficacy of our proposed solutions\, via synthetic data examples and case studies using albedo data from GOES satellites and LCA application data. \nEvent Host: Jacob Fontana\, Ph.D. Candidate\, Statistical Science \nAdvisor: Bruno Sansó \nZoom: https://ucsc.zoom.us/j/99965109575?pwd=uGkOwWM3Rl3zP66aL1RecoOfB8Yat0.1 \nPasscode: 879019
URL:https://events.ucsc.edu/event/fontana-j-stat-when-were-always-wrong-scalable-variable-selection-in-m-open-settings/
LOCATION:Engineering 2\, Engineering 2 1156 High Street\, Santa Cruz\, CA\, 95064
CATEGORIES:Ph.D. Presentations
ATTACH;FMTTYPE=image/jpeg:https://events.ucsc.edu/wp-content/uploads/2026/04/ph.d.-presentation-graphic-option2.jpg
GEO:37.0009723;-122.0632371
X-APPLE-STRUCTURED-LOCATION;VALUE=URI;X-ADDRESS=Engineering 2 Engineering 2 1156 High Street Santa Cruz CA 95064;X-APPLE-RADIUS=500;X-TITLE=Engineering 2 1156 High Street:geo:-122.0632371,37.0009723
END:VEVENT
END:VCALENDAR