Lmst

Avi Chawla (@_avichawla)

RULER의 핵심 통찰은 절대 점수 부여보다 상대적 스코어링이 더 쉽다는 점입니다. LLM 심판이 각각에 절대 점수를 매기기보다 '궤적 A가 B보다 낫다'처럼 상대 비교를 통해 판단하는 것이 보상 평가에서 더 간단하다는 설명을 담고 있습니다.

https://x.com/_avichawla/status/2016502643032748415

#ruler #rewardmodeling #rl #llm

Sumanth (@Sumanth_077)

튜토리얼을 시도해본 후 RULER(Relative Universal LLM-Elicited Rewards)이 에이전트 행동에 자동으로 보상을 할당해 수작업 보상 설계(핸드크래프트 리워드 엔지니어링)를 제거해 준다는 점을 긍정적으로 평가한 코멘트입니다. RULER 기반 자동 보상 할당의 실사용 경험을 공유합니다.

https://x.com/Sumanth_077/status/2016515340776456276

#ruler #rewardlearning #llm #aiagents

Strictly Overdue

https://spanklit.com/strictly-overdue

Антипаттерн LLM-приложений: когда модель игнорирует контекст. Часть 2

Всем привет! В первой части мы разобрали теорию : почему LLM «забывают» информацию в середине промпта, как на это влияет архитектура внимания и при чём здесь ротационные кодирования (RoPE). Мы выяснили, что эффект Lost in the Middle — это закономерное следствие того, как устроены современные трансформеры и как они обучаются. Но насколько всё плохо на практике? Если разработчик модели заявляет контекстное окно в 128k или даже 1M токенов — можем ли мы на него рассчитывать в реальном продакшене? Во второй части мы переходим от теории к цифрам на бенчмарках. Мы разберём, почему стандартные тесты "иголка в стоге сена" (NIAH) безнадёжно устарели и как новые метрики вроде RULER и NoLiMa показывают реальное «рабочее» окно моделей, которое иногда в 60 раз меньше заявленного. В финале этой статьи я соберу практические архитектурные принципы, которые помогают проектировать LLM-системы так, чтобы длинный контекст действительно повышал качество, а не превращался в источник ошибок.

https://habr.com/ru/articles/972626/

#llm #nlp #ruler #nolima #длинный_контекст #lost_in_the_middle #архитектура_llmприложений #rag

Использование библиотеки spaCy для поиска сущностей в тексте

Снова приветствую всех читателей Хабр. В предыдущей статье был приведен пример создания кода проекта для задачи автоматизации обработки данных, в результате чего получилось подготовить нужную информацию по модели данных ЛОЦМАН: PLM. Эти данные планируется использовать для построения механизмов обработки поисковых запросов пользователей к базе ЛОЦМАН:PLM — в частности, для распознавания сущностей в тексте запроса. Это позволит понимать, на какие объекты модели данных ссылается пользователь: изделия, их параметры, типы документов и так далее. Для решения новой задачи я решил опробовать возможности библиотеки spaCy , в которой сущности можно распознавать на основе заранее заданных паттернов. В ходе экспериментов с библиотекой и её модулями EntityRuler и SpanRuler я столкнулся с рядом особенностей, и в данной статье делюсь накопленным опытом и наработками — надеюсь, они окажутся полезными и для вас.

https://habr.com/ru/articles/976600/

#nlp #spacy #ruler #python

Finally I got my printed xmas cards from the printing shop. Still not having the text I am aiming for, but I am pretty confident to have all ready by tomorrow, so that I can send them out. It's about time. ;)

#Basteln #Schneidematte #Lineal #Cuttermesser #Papier #crafting #cuttingmat #ruler #utilityknife #paper #xmas #greetings #weihnachten #Grüße #Druck #print

The image shows crafting supplies laid out on a grid-patterned cutting mat. There is a ruler with measurement markings, a pen, a utility knife, and various pieces of paper, including some with red and black designs.

Das Bild zeigt Bastelutensilien, die auf einer gerasterten Schneidematte ausgelegt sind. Dazu gehören ein Lineal mit Messmarkierungen, ein Stift, ein Cuttermesser und verschiedene Papierstücke, darunter einige mit roten und schwarzen Designs.

Been awhile since I last used the #Phase #Ruler
#DoodlesAlcea

The surprisingly connected origins of "Donald" and "dip".

#etymology #wordnerd #linguistics #HistoricalLinguistics #language #words #lingcomm #donald #dip #ruler #hollow

https://youtube.com/shorts/AcZh1Tt3-1g

Take This Down, Miss Lacey

https://spanklit.com/take-this-down-miss-lacey

#ruler #terminal #tmux #ded

I've had this idea of having a ruler in the terminal. Such a ruler would allow me to see how far across the terminal a character or word is.

Why? Not sure yet, I just liked the idea of it. You know, this is one of those solutions looking for a problem. ;). Still, it was fun.

What I came up was this:

(ruler1.png)

This is achieved using tmux, where it's possible to create a split where the output is taken from stdin (rather than spawning a shell):

% ruler | tmux splitw -dI -l2 -b &

Here, this creates a split window two lines high (-l2), puts on the top (-b), and puts the output from the`ruler` command in the window.

Then I can use text using whatever against the ruler to see where on the screen it is.

We can take this a step further though and make use of tmux's `popup-display` command to have a ruler floating on the screen:

(ruler2.png)

... and even make it borderless:

(ruler3.png)

This can be moved using the mouse, by holding Alt down and dragging with mouse-1.

It turns out that using a ruler in an application isn't new.

Thomas Dickey (of #xterm fame) wrote #ded (https://invisible-island.net/ded/ded.html) which has a ruler on it:

(ruler4.png)

#ded is an interesting program of itself and I had to tweak it slightly to make ot use ncursesw to display nicely in tmux (ACS fallback for drawing the ruler), which I might discuss in a separate thread on here.

I'll have to email Thomas to find out what the "workspace ruler" (as it's called) does, and what it's useful for.

As for my ruler, well, I think I have the measure of it now, so I think I'll re-write the quick shell script into something with bells-and-whistles.

Maybe I'll give it conversion options to display inches, feet, cubits, etc... ;)

A terminal window, running tmux.

The top of the window has a horizontal split of three lines. The first line shows numbers:

|---1--|--2--|---3---|

The second line counts from 01234567 repeatedly to denote the number of spaces in a tab character.

This show a terminal running a program called `ded` -- the top half shows a file listing in the terminal, and the lower half has a ruler in the terminal showing how many tabs there are.

A quotation from Robert Herrick

’Twixt kings and tyrants there’s this difference known:
Kings seek their subjects’ good; tyrants their own.

Robert Herrick (1591-1674) English poet
“Kings and Tyrants,” Hesperides, # 861 (1648)

Sourcing, notes: wist.info/herrick-robert/78445…

#quote #quotes #quotation #qotd #robertherrick #despot #dictator #king #leader #leadership #ruler #selfaggrandizement #selfinterest #socialcontract #tyranny #tyrant

Titanium Multifunctional EDC Foldable Measuring Ruler

👉link in bio

Gr5 Titanium.All-in-1.CNC machining dimension line.Multi-purpose measurement.

#survival #kickstarter #ruler #EDC #multitool #camping #outdoor #crowdfunding

#PadthaduThaadu Song #Ruler Movie #Shorts

Watch & Enjoy Padthadu Thaadu Song Short from the Moive Ruler. Movie Name : Ruler Director : KS Ravi Kumar Music Director : Chirantann Bhatt Singers : Simha, Chandni Vijaykumar Shah Lyrics - Bhaskarbhatla Starring : Nandamuri Balakrishna & Sonal Chauhan Producer : C.Kalyan Banner : Happy Movies Music programming : Som Riggs Mixing and Mastering : Vinod Verma Audio Label : Aditya Music…

https://chutneymusic.com/padthaduthaadu-song-ruler-movie-shorts/

RULER – Easily apply RL to any agent

https://openpipe.ai/blog/ruler

#HackerNews #RULER #RL #agents #ReinforcementLearning #OpenAI #AItools

A quotation from Josh Billings

“Happy as a king,” iz a libel on happiness, and on the king to.

[“Happy as a king,” is a libel on happiness, and on the king, too.]

Josh Billings (1818-1885) American humorist, aphorist [pseud. of Henry Wheeler Shaw]
Everybody’s Friend, Or; Josh Billing’s Encyclopedia and Proverbial Philosophy of Wit and Humor, ch. 156 “Affurisms: Embers on the Harth” (1874)

Sourcing, notes: wist.info/billings-josh/77058/

#quote #quotes #quotation #qotd #joshbillings #appearance #facade #happiness #king #monarch #ruler #seeming #unhappiness #power

A quotation from John Adams

Rulers are no more than attorneys, agents and trustees for the people; and if the cause, the interest and trust is insidiously betray’d, or wantonly trifled away, the people have a right to revoke the authority, that they themselves have deputed, and to constitute abler and better agents, attorneys and trustees.

John Adams (1735-1826) American lawyer, Founding Father, statesman, US President (1797-1801)
Essay (1765-09-30), “A Dissertation on the Canon and the Feudal Law,” No. 3, Boston Gazette

Sourcing, notes: wist.info/adams-john/74851/

#quote #quotes #quotation #authority #citizenry #election #government #people #politicalpower #power #regime #regimechange #representation #ruler

A quotation from Carlyle

Tell me what kind of man governs a People, you tell me, with much exactness, what the net sum-total of social worth in that People has for some time been.

Thomas Carlyle (1795-1881) Scottish essayist and historian
Essay (1850-04-01), “Downing Street,” Latter-Day Pamphlets, No. 3

Sourcing, notes: wist.info/carlyle-thomas/74601…

#quote #quotes #quotation #dictator #governance #government #governor #leader #meme #monarch #nation #people #president #ruler #society