BigCodeArena: Unveiling More Reliable Human Preferences in Code Generation via Execution
Paper โข 2510.08697 โข Published โข 40
Hugging Face Code Research
Team
non-profit
AI & ML interests
Exploring code models and datasets
lvwerraย
authored a
paper 9 months ago
lvwerraย
authored a
paper about 1 year ago
loubnabnlย
authored a
paper about 1 year ago
Post
7770
SmolVLM is now available on PocketPal โ you can run it offline on your smartphone to interpret the world around you. ๐๐ฑ
And check out this real-time camera demo by @ngxson , powered by llama.cpp:
https://github.com/ngxson/smolvlm-realtime-webcam
https://x.com/pocketpal_ai
And check out this real-time camera demo by @ngxson , powered by llama.cpp:
https://github.com/ngxson/smolvlm-realtime-webcam
https://x.com/pocketpal_ai
- 5 replies
anton-lย
authored a
paper over 1 year ago
lvwerraย
authored a
paper over 1 year ago
loubnabnlย
authored 2
papers over 1 year ago
anton-lย
authored a
paper over 1 year ago
lvwerraย
authored 2
papers over 1 year ago
lhoestqย
authored a
paper over 1 year ago
Post
4101
Introducing ๐๐
๐ข๐ง๐๐๐๐ญ๐ก: the best public math pre-training dataset with 50B+ tokens!
HuggingFaceTB/finemath
Math remains challenging for LLMs and by training on FineMath we see considerable gains over other math datasets, especially on GSM8K and MATH.
We build the dataset by:
๐ ๏ธ carefully extracting math data from Common Crawl;
๐ iteratively filtering and recalling high quality math pages using a classifier trained on synthetic annotations to identify math reasoning and deduction.
We conducted a series of ablations comparing the performance of Llama-3.2-3B-Base after continued pre-training on FineMath and observe notable gains compared to the baseline model and other public math datasets.
We hope this helps advance the performance of LLMs on math and reasoning! ๐
Weโre also releasing all the ablation models as well as the evaluation code.
HuggingFaceTB/finemath-6763fb8f71b6439b653482c2
HuggingFaceTB/finemath
Math remains challenging for LLMs and by training on FineMath we see considerable gains over other math datasets, especially on GSM8K and MATH.
We build the dataset by:
๐ ๏ธ carefully extracting math data from Common Crawl;
๐ iteratively filtering and recalling high quality math pages using a classifier trained on synthetic annotations to identify math reasoning and deduction.
We conducted a series of ablations comparing the performance of Llama-3.2-3B-Base after continued pre-training on FineMath and observe notable gains compared to the baseline model and other public math datasets.
We hope this helps advance the performance of LLMs on math and reasoning! ๐
Weโre also releasing all the ablation models as well as the evaluation code.
HuggingFaceTB/finemath-6763fb8f71b6439b653482c2
Post
3494
Made a HF Dataset editor a la gg sheets here: lhoestq/dataset-spreadsheets
With Dataset Spreadsheets:
โ๏ธ Edit datasets in the UI
๐ Share link with collaborators
๐ Use locally in DuckDB or Python
Available for the 100,000+ parquet datasets on HF :)
With Dataset Spreadsheets:
โ๏ธ Edit datasets in the UI
๐ Share link with collaborators
๐ Use locally in DuckDB or Python
Available for the 100,000+ parquet datasets on HF :)
Post
3760
Making SmolLM2 reproducible: open-sourcing our training & evaluation toolkit ๐ ๏ธ https://github.com/huggingface/smollm/
- Pre-training code with nanotron
- Evaluation suite with lighteval
- Synthetic data generation using distilabel (powers our new SFT dataset HuggingFaceTB/smoltalk)
- Post-training scripts with TRL & the alignment handbook
- On-device tools with llama.cpp for summarization, rewriting & agents
Apache 2.0 licensed. V2 pre-training data mix coming soon!
Which other tools should we add next?
- Pre-training code with nanotron
- Evaluation suite with lighteval
- Synthetic data generation using distilabel (powers our new SFT dataset HuggingFaceTB/smoltalk)
- Post-training scripts with TRL & the alignment handbook
- On-device tools with llama.cpp for summarization, rewriting & agents
Apache 2.0 licensed. V2 pre-training data mix coming soon!
Which other tools should we add next?
lvwerraย
authored a
paper over 1 year ago
Post
4205
Hey ! I'm working on a 100% synthetic Dataset Hub here (you can search for any kind of datasets an the app invents them). The link is here: infinite-dataset-hub/infinite-dataset-hub
Question for the Community:
Which models should I use to generate images and audio samples for those datasets ? ๐ค
Question for the Community:
Which models should I use to generate images and audio samples for those datasets ? ๐ค
- 4 replies
lvwerraย
authored a
paper about 2 years ago
anton-lย
authored a
paper about 2 years ago
loubnabnlย
authored a
paper about 2 years ago