Little written data
Dialects are spoken far more than they are written, so the text large models learn from barely includes them.
Technology
Most language models learn from standard, edited text. Nobody talks like that. Linguini runs on Lebanese.ai’s patent-pending technology: one engine that understands a dialect however it’s typed or spoken, and answers the same way, even in three languages in one sentence.
Move your cursor to turn the engine
The problem
Dialects are low-resource languages. Four things make them hard, and Linguini is built around all four.
Dialects are spoken far more than they are written, so the text large models learn from barely includes them.
The same word is spelled many ways, in two scripts, with numbers standing in for sounds.
Arabic, English and French switch inside one sentence. Most models break on the switch.
Much of the dialect lives in voice notes and calls, not in typed text.
Step by step
Watch the approved demo sentence go through the engine. The Arabizi is read word by word, its numbers become the sounds they stand for, and the meaning comes back in four forms.
1 · Typed in Arabizi
2 · Numbers read as sounds
3 · One form the model reasons over
4 · Answers in the form you need
How it works
Text or audio, exactly as people type it or say it: Arabic script, Arabizi, a mix, or speech.
Spellings, scripts and sounds are mapped to one form the model can reason over.
The model applies what it knows about how the dialect is really used, so answers stay in the user’s dialect.
The answer comes back in dialect, Modern Standard Arabic, English or French, or all three languages in one sentence, as text or voice.
What the engine does
Everything here works today in Lebanese, the first live dialect. Other dialects are on the roadmap.
Arabizi and Arabic script are read as the same words, so you never have to guess which one a user will type.
It follows Arabic, English and French as they switch mid-sentence, and it can answer the same way.
It understands spoken dialect and answers out loud, in dialect, as well as in writing.
Knowledge of how the dialect is really used keeps answers natural, not translated.
The same message can come back in dialect, Modern Standard Arabic, English or French.
Built so the next dialect runs on the same engine. Gulf, Egyptian and Moroccan are on the roadmap.
Hear it
Two recordings from a voice assistant built on the engine, taking a shop order. Listen to it switch between Lebanese and English inside one sentence, the way people here talk.
Recording 1 · confirming an order
Okay، بدّك ٣ تي شيرتات size medium، بس عم لخّصلك طلبك وما رح أعمل طلبية.
“Okay, you want 3 T-shirts, size medium. I’m just summarising your order, I won’t place it yet.”
Recording 2 · checking before ordering
شفت إنّك بدّك ٣ تي شيرتات... المقاس medium، وما عملت أي طلبية.
“I see you want 3 T-shirts… size medium, and I haven’t placed any order.”
Intellectual property
The engine is Lebanese.ai’s patent-pending technology, invented and built by Code-X in Beirut by people who speak the dialect every day.
One API for text and audio, in developer preview.