Plex: Towards Reliability Using Pretrained Large Model Extensions
Do 1-layer changes to improve model robustness still help?
Yes, and one-layer changes can be stacked to provide benefits across multiple domains (vision, language) with models up to 1 billion parameters.
Dustin Tran, Jeremiah Liu, Michael W. Dusenberry, Du Phan, Mark Collier, Jie Ren, Kehang Han, Zi Wang, Zelda Mariet, Huiyi Hu, Neil Band, Tim G. J. Rudner, Karan Singhal , Zachary Nado, Joost van Amersfoort, Andreas Kirsch, Rodolphe Jenatton, Nithum Thain, Honglin Yuan, Kelly Buchanan, Kevin Murphy, D. Sculley, Yarin Gal, Zoubin Ghahramani, Jasper Snoek, Balaji Lakshminarayanan.
Reliability benchmarks for image segmentation
Do 1-layer changes to improve model robustness still help when in tasks beyond classification?
Yes, for tasks such as image segmentation, one-layer changes can be stacked to provide benefits even when we have multiple distribution shifts at the same time.
E. Kelly Buchanan, Michael W Dusenberry, Jie Ren, Kevin Patrick Murphy, Balaji Lakshminarayanan, Dustin Tran
Deep Ensembles Work, But Are They Necessary?
Are the gains from deep ensembles unique to deep ensembles?
No. While ensembles are usually compared with their components, in this work we compare ensembles with another single model with similar InD performance.
We show that ensembling gains are not unique.
Taiga Abe*, E. Kelly Buchanan*, Geoff Pleiss, Rich Zemel, John Cunningham
Some behavioral features, such as chewing or grimacing, cannot be easily tracked. In this work we disentangle such behaviors in video data by incorporating the other features which can be easily tracked.
Matthew R Whiteway, Dan Biderman, Yoni Friedman, Mario Dipoppa, E. Kelly Buchanan, Anqi Wu, John Zhou, Jean-Paul R Noel, John Cunningham, Liam Paninski
Deep Graph Pose: a semi-supervised deep graphical model for improved animal pose tracking
Can we track poses with much less data?
Yes, by exploiting the spatial and temporal structure inherent in videos.
Anqi Wu*, E. Kelly Buchanan*, Matthew Whiteway, Michael Schartner, Guido Meijer, Jean-Paul Noel, Erica Rodriguez, Claire Everett, Amy Norovich, Evan Schaffer, Neeli Mishra, C. Daniel Salzman, Dora Angelaki, Andrés Bendesky, The International Brain Laboratory, John Cunningham, Liam Paninski
Penalized matrix decomposition for denoising, compression, and improved demixing of funcational imaging data
This paper shows that we can efficiently separate activity from different neurons through a rank-1 penalized matrix decomposition.
E. Kelly Buchanan*, Ian Kinsella*, Ding Zhou*, Rong Zhu, Pengcheng Zhou, Felipe Gerhard, John Ferrante, Ying Ma, Sharon Kim, Mohammed Shaik, Yajie Liang, Rongwen Lu, Jacob Reimer, Paul Fahey, Taliah Muhammad, Graham Dempsey, Elizabeth Hillman, Na Ji, Andreas Tolias, Liam Paninski
Quantifying the behavioral dynamics of C. elegans with autoregressive hidden Markov models
In this paper we extract interpretable behavioral syllables of C. elegans using a class of switching linear dynamical systems (Spotlight presentation)
E. Kelly Buchanan, Akiva Lipshitz, Scott Linderman, Liam Paninski