Page Not Found
Page not found. Your pixels are in another canvas.
Sitemap
A list of all the posts and pages found on the site. For you robots out there is an XML version available for digesting as well.
Pages
How to Join
Contact Us
Page not in menu
This is a page not in th emain menu
People
Sprocket Lab Team Members
Posts
Tabby: Tabular Data Synthesis With Large Language Models
Published:
Authors: Sonia Cromp
While impressive examples of AI-generated art and dialogue have captured the public’s attention in recent years, one of the most fundamental data formats–tabular data–still lacks specialized, high-performing models. Tables are ubiquitous in modern life, but are not modeled well by off-the-shelf models intended for other datatypes. Given the central role of tabular data in everything from global economic forecasts and astronomical observations to classroom gradebooks and household budgets, the lack of deep learning methods tailored for tables is quite surprising. To address the table synthesis gap, we introduce Tabby: a foundation model designed specifically for tabular data. Tabby introduces the inductive biases necessary to represent tabular data into a pre-trained large language model, avoiding the costly process of training a foundation model from scratch. Read on to discover how Tabby generates synthetic data that is nearly indistinguishable from real-world datasets!
The ALCHEmist: Automated Labeling 500x CHEaper Than LLM Data Annotators
Published:
Authors: Tzu-Heng Huang
Large pretrained models like GPT-4, Gemini, and Claude 3 are fantastic at labeling data—-whether it’s spam detection in YouTube comments or classifying topics in medical documents. But there’s a drawback: querying these models for every single data point via API calls gets expensive fast.
Alignment, Simplified: Steering LLMs with Self-Generated Preferences
Published:
Authors: Dyah Adila
Efficient LLM alignment without the data and compute expense of traditional methods.
Weak-to-Strong Generalization Through a Data-Centric Lens
Published:
Authors: Changho Shin
Exploring how overlap density drives weak-to-strong generalization and its applications in data source selection.
OTTER: Effortless Label Distribution Adaptation of Zero-shot Models
Published:
Authors: Changho Shin
OTTER offers a tuning-free, inference-time label distribution adaptation of zero-shot models by leveraging optimal transport.
RoboShot: Zero-Shot Robustification of Zero-Shot Models
Published:
Authors: Dyah Adila
Effortlessly robustify CLIP-based models to handle spurious currelations– no xtra data, no xtra training!
Aggregating Foundation Model Objects
Published:
Authors: Harit Vishwakarma
portfolio
Portfolio item number 1
Short description of portfolio item number 1
Portfolio item number 2
Short description of portfolio item number 2
publications
Universalizing weak supervision
Published in ICLR 2022, 2022
Authors: Changho Shin, Winfred Li, Harit Vishwakarma, Nicholas Roberts, Frederic Sala
AutoWS-Bench-101: Benchmarking Automated Weak Supervision with 100 Labels
Published in NeurIPS 2022, 2022
Authors: Nicholas Roberts*, Xintong Li*, Tzu-Heng Huang, Dyah Adila, Spencer Schoenberg, Cheng-Yu Liu, Lauren Pick, Haotian Ma, Aws Albarghouthi, Frederic Sala
Lifting Weak Supervision To Structured Prediction
Published in NeurIPS 2022, 2022
Authors: Harit Vishwakarma, Nicholas Roberts, Frederic Sala
NAS-Bench-360: Benchmarking Neural Architecture Search on Diverse Tasks
Published in NeurIPS 2022, 2022
Authors: Renbo Tu*, Nicholas Roberts*, Mikhail Khodak, Junhong Shen, Frederic Sala, Ameet Talwalkar
Ask Me Anything: A simple strategy for prompting language models
Published in ICLR 2023, 2023
Authors: Simran Arora, Avanika Narayan, Mayee F. Chen, Laurel Orr, Neel Guha, Kush Bhatia, Ines Chami, Frederic Sala, Christopher Ré
Multimodal Data Curation Via Object Detection And Filter Ensembles
Published in ICCV Workshop: Towards the Next Generation of Computer Vision Datasets (TNGCV) 2023, 2023
Authors: Tzu-Heng Huang, Changho Shin, Sui Jiet Tay, Dyah Adila, Frederic Sala
Resonant anomaly detection with multiple reference datasets
Published in Journal of High Energy Physics 2023, 2023
Authors: Mayee F. Chen, Benjamin Nachman, Frederic Sala
ScriptoriumWS: A Code Generation Assistant for Weak Supervision
Published in DL4C Workshop at ICLR 2023, 2023
Authors: Tzu-Heng Huang, Catherine Cao, Spencer Schoenberg, Harit Vishwakarma, Nicholas Roberts, Frederic Sala
Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Models
Published in NeurIPS 2023, 2023
Authors: Mayee F. Chen, Nicholas Roberts, Kush Bhatia, Jue Wang, Ce Zhang, Frederic Sala, Christopher Ré
Mitigating Source Bias for Fairer Weak Supervision
Published in NeurIPS 2023, 2023
Authors: Changho Shin, Sonia Cromp, Dyah Adila, Frederic Sala
The Cost of Compression: Investigating the Impact of Compression on Parametric Knowledge in Language Models
Published in EMNLP Findings 2023, 2023
Authors: Srinath Namburi, Makesh Narsimhan Sreedhar, Srinath Srinivasan, Frederic Sala
Domain Generalization via Nuclear Norm Regularization
Published in CPAL 2023, 2023
Authors: Zhenmei Shi, Yifei Ming, Ying Fan, Frederic Sala, Yingyu Liang
Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
Published in NeurIPS 2023, 2023
Authors: Neel Guha, Mayee F Chen, Kush Bhatia, Azalia Mirhoseini, Frederic Sala, Christopher Ré
Geometry-Aware Adaptation for Pretrained Models
Published in NeurIPS 2023, 2023
Authors: Nicholas Roberts, Xintong Li, Dyah Adila, Sonia Cromp, Tzu-Heng Huang, Jitian Zhao, Frederic Sala
Product Manifold Representations for Learning on Biological Pathways
Published in ICML Workshop for Computational Biology 2023, 2023
Authors: Daniel McNeela, Frederic Sala, Anthony Gitter
Promises and Pitfalls of Threshold-based Auto-labeling
Published in NeurIPS 2023, 2023
Authors: Harit Vishwakarma, Heguang Lin, Frederic Sala, Ramya Korlakai Vinayak
Train `n Trade: Foundations of Parameter Markets
Published in NeurIPS 2023, 2023
Authors: Tzu-Heng Huang, Harit Vishwakarma, Frederic Sala
Generative Modeling Helps Weak Supervision (and Vice Versa)
Published in ICLR 2023, 2023
Authors: Benedikt Boecking, Nicholas Roberts, Willie Neiswanger, Stefano Ermon, Frederic Sala, Artur Dubrawski
The Credential is Not Enough: Combining Honeypots and Fake Credentials for Cyber-Defense
Published in GameSec-23 2023, 2023
Authors: Sonia Cromp, Mark Bilinski, Ryan Gabrys, Frederic Sala
Stronger Than You Think: Benchmarking Weak Supervision on Realistic Tasks
Published in NeurIPS 2024, 2024
Authors: Tianyi Zhang, Linrong Cai, Jeffrey Li, Nicholas Roberts, Neel Guha, Frederic Sala
The AlCHEmist: Automated Labeling 500x CHEaper than LLM Data Annotators
Published in NeurIPS 2024 (Spotlight), 2024
Authors: Tzu-Heng Huang, Catherine Cao, Vaishnavi Bhargava, Frederic Sala
Pearls from Pebbles: Improved Confidence Functions for Auto-labeling
Published in NeurIPS 2024, 2024
Authors: Harit Vishwakarma, Sui Jiet Tay, Satya Sai Srinath Namburi, Frederic Sala, Ramya Korlakai Vinayak
Pretrained Hybrids with MAD Skills
Published in Preprint, 2024
Authors: Nicholas Roberts, Samuel Guo, Zhiqi Gao, Satya Sai Srinath Namburi, Sonia Cromp, Chengjun Wu, Chengyu Duan, Frederic Sala
Zero-Shot Robustification of Zero-Shot Models
Published in ICLR 2024, 2024
Authors: Dyah Adila, Changho Shin, Linrong Cai, Frederic Sala
Look Who’s Talking Now: Covert Channels From Biased LLMs
Published in EMNLP Findings 2024, 2024
Authors: Daniel Silva, Frederic Sala, Ryan Gabrys
OTTER: Effortless Label Distribution Adaptation of Zero-shot Models
Published in NeurIPS 2024, 2024
Authors: Changho Shin, Jitian Zhao, Sonia Cromp, Harit Vishwakarma, Frederic Sala
Personalize Your LLM: Fake it then Align It
Published in NAACL Findings, 2025
Authors: Yijing Zhang, Dyah Adila, Changho Shin, Frederic Sala
Theoretical Physics Benchmark (TPBench) – a Dataset and Study of AI Reasoning Capabilities in Theoretical Physics
Published in Preprint, 2025
Authors: Daniel J.H. Chung, Zhiqi Gao, Yurii Kvasiuk, Tianyi Li, Moritz Münchmeyer, Maja Rudolph, Frederic Sala, Sai Chaitanya Tadepalli
Alignment, Simplified: Steering LLMs with Self-Generated Preferences
Published in Preprint, 2025
Authors: Dyah Adila, Changho Shin, Yijing Zhang, Frederic Sala
Weak-to-strong generalization through the data-centric lens
Published in ICLR 2025, 2025
Authors: Changho Shin, John Cooper, Frederic Sala
talks
Talk 1 on Relevant Topic in Your Field
Published:
This is a description of your talk, which is a markdown files that can be all markdown-ified like any other post. Yay markdown!
Conference Proceeding talk 3 on Relevant Topic in Your Field
Published:
This is a description of your conference proceedings talk, note the different field in type. You can put anything in this field.
teaching
Teaching experience 1
Undergraduate course, University 1, Department, 2014
This is a description of a teaching experience. You can use markdown like any other post.
Teaching experience 2
Workshop, University 1, Department, 2015
This is a description of a teaching experience. You can use markdown like any other post.