Yoav Goldberg
@yoavgo.bsky.social
6.5K followers 930 following 1.2K posts
Posts Media Videos Starter Packs
Pinned
yoavgo.bsky.social
my current belief is that while thinking of DL in the lens of NLP was expanding, thinking of LLMs with the lens of NLP is mostly limiting.
yoavgo.bsky.social
כן, לכן אנחנו עדיין מלמדים את זה, אבל לא טוענים שזה שימושי
yoavgo.bsky.social
אני לא יודע אבל כנראה שאנסה לעבוד ישרות על התרגום, בלי לנסות לעבור דרך התחביר, כי אני לא רואה מה אני יכול ריאלית להרוויח מהתחביר
yoavgo.bsky.social
מודלי השפה מנצחים כל דבר אחר ודי בקלות...
yoavgo.bsky.social
הם דלי מקורות אבל אני בכל זאת יכול לקבל עליהם ניתוח תחבירי אוטומטי באיכות טובה? למה שזה יהיה המצב?
yoavgo.bsky.social
הגיוני. הם עדיין מנסים לשכנע את עצמם שזה מועיל.
yoavgo.bsky.social
מופתע שעוד מפרקים עצים, וטוענים שזה שימושי. אנחנו גם מלמדים עדיין על הקונספט, וכן גם בוחנים עליו כי אני מאמין שיש טעם לדעת שהוא קיים ואת הבסיס של מבנה תחבירי, אבל זה לא שימושי לדבר יותר (מלבד אולי לניתוחי מודלים)
yoavgo.bsky.social
זה אכן מתאים לנושא, אבל.. כבר לא עושים ככה יותר. מפתיע אותי שעוד מלמדים.
yoavgo.bsky.social
מה? למה מלמדים את זה
yoavgo.bsky.social
the issue is that in a very common case you tried to add something around existing code and now you have this extra } or ) you have to get rid off, and when you do the editor is acting smart again and deleting also the opening paren for you because surely that's what you wanted...
yoavgo.bsky.social
"no no, you don't understand, the editor is smart so if you just type this same character it will not insert another one but skip over it!"
yoavgo.bsky.social
this "feature" in code editors where you type an opening character and it immediately inserts the closing one for you as well -- why?? at the very very best case, you will have to skip over this character with an arrow. so why?
yoavgo.bsky.social
this last one is exactly the "hide keys" scenario right? because otherwise the client could also read/write from s3.
yoavgo.bsky.social
got it. i guess it can be done with views / stored procedures, but maybe people will prefer using a non-db language.
yoavgo.bsky.social
but in the early days the PHP/CGI did also the rendering. now the rendering is done on the client, so why not call the SQL from the client as well?
yoavgo.bsky.social
i guess i also don't understand the majority of the "backend" thing, assuming it is stateless and only orchestrates calls to other services.
yoavgo.bsky.social
i guess i also don't understand the majority of the "backend" thing, assuming it is stateless and only orchestrates calls to other services.
yoavgo.bsky.social
how do you ensure it happens in a serverless function? always call some authentication server before calling the other server(s)? if so, why can't a token-based solution work just as well? (the auth servers gives the client a token which is then used with the other servers)?
yoavgo.bsky.social
wdym by "maintain code on the client"? its a browser and it runs whatever code you put in your static html/js files.
yoavgo.bsky.social
can someone explain "serverless backends" to me? it seems that they run functions on demand. but if these functions cannot access any persistent state, why not run them on the client? the only reason I see is to hide DBs/APIs tokens/secrets from the client, but is that really all there is to it?
yoavgo.bsky.social
its perhaps THE most fascinating thing about LLMs in my view.
yoavgo.bsky.social
how do you know the ground truth for human steps?
yoavgo.bsky.social
(or we can see it as a metaphor maybe)
yoavgo.bsky.social
yup, happened to me too.. thats a bug. will attempt to fix tonight.
yoavgo.bsky.social
not early - but i did get both balls on the same side after a day+, a bug on my part which should be fixed at some point...