An Albanian Edge LLM - Part 1: The Vision
Albanian is a low-resource language with around 7.5M speakers.
ReadThe whole archive
Things I had to find out.
Experiments, tools, and essays. The unfinished ones stay in.
Experiments
Open experimentsBuilds, tests, failures, and whatever survived contact with reality.
An Albanian Edge LLM - Part 2: Sourcing the Data
I ended up building 22,369 training pairs from scratch using multiple AI models.
ReadBuilding an Albanian Edge LLM - Part 3: The Roast
I tried a bunch of different approaches. Most failed!
ReadBuilding an Albanian LLM - Part 4: The Pour: Quantization & iOS Deployment
I got a 7GB model down to 934MB using 4-bit quantization. Then I used Apple's MLX framework to run it on iPhone.
ReadBuilding an Albanian AI - Part 5: Results and Future Plans
69.2% accuracy on my tiny 13-phrase test set. Basic phrases work. Proverbs mostly fail.
ReadTools
Open toolsSmall systems I built because I wanted them to exist.
Essays
Open essaysIdeas that needed more room than a note and less certainty than a manifesto.
Go Evergreen.
Go Evergreen lives in the private archive.
View accessExamples > Instruction
Examples > Instruction lives in the private archive.
View accessAsymmetric Damages
Asymmetric Damages lives in the private archive.
View accessDon't Make Change, Make Alternatives.
Don't Make Change, Make Alternatives lives in the private archive.
View accessSize * Agility = Advantage
Size * Agility = Advantage lives in the private archive.
View accessLow Price. High Volume.
Low Price. High Volume lives in the private archive.
View accessStop Planning
Stop Planning lives in the private archive.
View accessWearables
Open wearablesDevices and the places they meet the body.
Explore the wearable body atlas