🔄 In a Training Loop
Daniel Gallagher
DanielGallagherIRE
AI & ML interests
NLP at the Institute for Applied Informatics in Leipzig, Germany.
Recent Activity
updated a model about 11 hours ago
DanielGallagherIRE/ModernBERT-20BTok published a model about 11 hours ago
DanielGallagherIRE/ModernBERT-20BTok updated a model 5 days ago
DanielGallagherIRE/mb-base-1BTok-2EPOrganizations
Models pretrained on various obfuscated versions of the same dataset to analyse how the obfuscation affects downstream performance.
Encoder models trained on obfuscated versions of the fineweb-edu-1B dataset, as part of the InfAI CORAL project.
-
DanielGallagherIRE/obfuscated-bert-fineweb-1B-original
0.1B • Updated • 36 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-scramble-reverse-head
0.1B • Updated • 1 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-noun-pos
0.1B • Updated -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-noun-propn
0.1B • Updated
A collection of obfuscated version of a 20B-token sample of the FineWeb Edu dataset.
-
DanielGallagherIRE/fineweb-edu-20B-obfuscation
Viewer • Updated • 19.4M • 59 -
DanielGallagherIRE/FineWeb-Edu-20B-E1-POS-Removal
Viewer • Updated • 9.71M • 684 -
DanielGallagherIRE/FineWeb-Edu-20B-E1-Bag-of-Words
Preview • Updated • 516 -
DanielGallagherIRE/FineWeb-Edu-20B-E1-Mutual-Information
Viewer • Updated • 9.71M • 2.43k
A collection of obfuscated version of a 20B-token sample of the FineWeb Edu dataset.
-
DanielGallagherIRE/fineweb-edu-20B-obfuscation
Viewer • Updated • 19.4M • 59 -
DanielGallagherIRE/FineWeb-Edu-20B-E1-POS-Removal
Viewer • Updated • 9.71M • 684 -
DanielGallagherIRE/FineWeb-Edu-20B-E1-Bag-of-Words
Preview • Updated • 516 -
DanielGallagherIRE/FineWeb-Edu-20B-E1-Mutual-Information
Viewer • Updated • 9.71M • 2.43k
Models pretrained on various obfuscated versions of the same dataset to analyse how the obfuscation affects downstream performance.
Encoder models trained on obfuscated versions of the fineweb-edu-1B dataset, as part of the InfAI CORAL project.
-
DanielGallagherIRE/obfuscated-bert-fineweb-1B-original
0.1B • Updated • 36 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-scramble-reverse-head
0.1B • Updated • 1 -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-noun-pos
0.1B • Updated -
DanielGallagherIRE/obfuscated-bert-fineweb-1B-noun-propn
0.1B • Updated