What's the problem with that, anyway? I object to training a machine to take/change my job [building them, telling them what to do]. What's more, they want me to pay? Hah. This isn't a charity. I either strike fortune, retire while the getting is good, or simply work harder for nothing. Hmm. I think I'll keep not displacing people, actually. Myself included.
To GP: not all of us who automate go for low hanging fruit, I guess.
To the peer calling this illegitimate [or anyone, really]: without the assistance of an LLM, please break down the foul nature of... let me check my notes, gainful employment.
'Principal' engineer here, looking to perfect being the idiot! Knowing how to do things, and being known for it, has been an endless source of heartburn. All to say, I think there's wisdom at play. Even there.
Having 'innovated and taken risk', juice is rarely worth the squeeze. Watercooler is too crowded and layoffs too arbitrary. A middling job rewards exactly as well. Reliably.
That's great (unironically) for you and the shareholders. I've lost the joy of learning things, honestly. After two decades of skill-building and 98% of it being utterly useless, I have a certain complex.
Said another way: the job needs 2+2, rewards poorly, and I'm too tired for Calculus.
No shareholders. I'm retired, after a long career, doing stuff I found meaningful, but never really earned me huge piles of money. Being retired has been wonderful. I get to learn whatever the heck I want. I still make stuff that is meaningful, but I don't make money at it (which isn't actually a bad thing).
I guess finding a meaningful life has always been more important to me, than being rewarded in money. I know that makes me a mutant, around these parts, but that's how I roll.
That's great for you. Sarcastic this time. I truly meant well, now I don't care. To be clear: 'shareholders' was a quip at the industry, not you.
Well, you see, life has demanded I trade a certain meaning for value creation. Hence my attitude. There's that complex I told you about. Ghoulishly wanting reciprocation, or day I say, a payoff.
I'd trade half my salary/effort to live in my home town and closer to meaning... yet, I don't. Not an option. Can't avoid RTO forever or pay bills with back-pats.
Nice implication on my life meaning, bro. Sorry, sir. I lower the rim and you dunk. Well played.
Learn for yourself then. I run my own company and learning new stuff so I can use it in my business is one of the few joys of being the owner. No permission required to try the new hotness (And if you screw up -- you have only yourself to blame.)
I think we have to enjoy what we learn. I have no motivation at all, to learn stuff I don't like doing.
In my case, I really enjoy coding, and making stuff that people use.
Part of the impediments that I have encountered, is other people's attitudes. As long as co-workers and technical peers thought of me as "competition," they would deliberately make it difficult for me to access the stuff I needed to learn.
LLMs have absolutely no fear of me, and gladly give me exactly what I need (sometimes, too much).
I'm glad to hear LLMs help you out. They don't, here. Learning isn't the issue: I already have a wealth of information I can't put to use, or perhaps more accurately: won't be sufficiently rewarded for.
Perhaps I could use them for the parts I don't enjoy. Or I could... not.
It's all a wash, I guess is my point. While we're out here working, leagues are idling. I aspire to be more like them.
Several Bitcoin I had earned by mining as a stability test. I could have skipped the rat race and kept my soul... if only teenage-me wasn't astronomically stupid and unlucky
Heck, I'll lower the bar! I'm (mid-30s American) not so worried about 'safe'. A certain amount of danger is fine. Desirable, even, if it meant I could live in my home town, not in an unfamiliar city.
I could buy half of a house, right now, cash. I don't, because the moment I do, I'll be forced to sell/move/whatever. Again. Where I am [for work] and where I want to be are forever at odds. Leaders have found it fashionable to bundle us all together. Spin the wheel and see if we hit RTO, let's bid against each other [again].
All to say, I'd give half my salary to never negotiate it or my location, again. Clearly not an option, so what to do? Endure and save. You won't see me buying toys or status symbols, that's for sure. At Will employment, meet At Will spending.
Not sure if I'd use the same descriptions so pointedly, but I can see what they mean.
It's perfectly fine to link for convenience, but it does feel a little disrespectful/SEO-y to not 'continue the conversation'. A summary in the very least, how exactly it pertains. Sell us.
In a sense, link-dropping [alone] is saying: "go read this and establish my rhetorical/social position, I'm done here"
Imagine meeting an author/producer/whatever you liked. You'd want to talk about their work, how they created it, the impact it had, and so on. Now imagine if they did that... or if they waved their hand vaguely at a catalog.
I've genuinely been answering the question "what if the labs are training on your pelican benchmark" 3-4 times a week for several months at this point. I wrote that piece precisely so I didn't have to copy and paste the same arguments into dozens of different conversations.
Oh, no. Does this policing job pay well? /s Seriously: less is more, trust the process, any number of platitudes work here. Who are you defending against? Readers, right? You wrote your thing, defended it with more of the thing. It'll permeate. Or it won't. Does it matter?
You could be done, nothing is making you defend this (sorry) asinine benchmark across the internet. Not trying to (m|y)uck your yum, or whatever.
Remember, I did say linking for convenience is fine. We're belaboring the worst reading in comments. Inconsequential, unnecessary heartburn. Link the blog posts together and call it good enough.
Surprised to see snark re: what I thought was a standard practice (linking FAQs, essentially).
I hadn’t seen the post. It was relevant. I just read it. Lucky Ten Thousand can read it next time even though I won’t.
Simon has never seemed annoying so unlike other comments that might worry me (even “Opus made this” even though it’s cool but I’m concerned someone astroturfed), that comment would’ve never raised my eyebrows. He’s also dedicated and I love he devotes his time to a new field like this where it’s great to have attempts at benchmarks, folks cutting through chaff, etc.
The specific 'question' is a promise to catch training on more publicly available data, and to expect more blog links copied 'into dozens of different conversations'... Jump for joy. Stop the presses. Oops, snarky again :)
Yes, the LLM people will train on this. They will train on absolutely everything [as they have]. The comments/links prioritize engagement over awareness. My point, I suppose, if I had one is that this blogosphere can add to the chaff. I'm glad to see Simon here often/interested.
Aside: all this concern about over-fitting just reinforces my belief these things won't take the profession any time soon. Maybe the job.
Having read the followup post being linked, I'm even more confused. Commenting or, really, anything seems even less worthwhile. That's my point.
You bring the benchmark and anticipated their... cheesing, with a promise to catch them on it. Cool announcement of an announcement. Just do that [or don't]. In a hippy sense, this is no longer yours. It's out there. Like everything else anyone wrote.
Let the LLM people train on your test. Catch them as claimed. Publish again. Huzzah, industry without overtime in the comments. It makes sense/cents to position yourself this way :)
Obviously they're going to train on anything they can get. They did. Mouse, meet cat. Some of us in the house would love it if y'all would keep it down! This is 90s rap beef all over again
It is SEO-y and I’m sure no small impulse is to drive traffic to his website since he’s primarily an AI influencer.
However, there are always people who are “native” to a platform and field. Pieter Levels is native to Twitter and the nomad community. Swyx is native to Twitter/HN and the devtools community. And simonw is native to at least HN and the LLM-interest community. And various streamers and onlyfans creators do the same with theirs.
Through some degree of releasing things that whatever that community values they build a relationship that allows them greater freedom in participating there. It does create a positive feedback cycle for them (and hopefully the community) that most of them will try to parlay into something else: Levels and the OnlyFans creators are probably best at this monetization of reputation but each of them is doing this. One success step for simonw would be “Creator of Pelican LLM benchmark”.
Once you’ve breached some stable point in the community the norms are somewhat relaxed. But it’s not easy to do that. You have to produce some extraordinary volume of things that people value.
I think, tbh, tptacek here could most effectively monetize if he decided to. But he doesn’t appear to want to so he’s just a participant not an influencer so to speak. Whereas someone like Levels or simonw is both.
It’s just creator economy stuff. Meta discussions like this always pop up. But ultimately simonw is past the threshold of trust. There are people who say “wtf? Why is levels making $50k/mo on a stupid vibe-coded flying game?”
It ain’t the game. It’s the following before the game. The resource is the audience.
Not so much leaving money on the table as you have a valuable resource you are underutilizing in this respect. You’d have to cross-cultivate your audience and expand to fill some niche.
That means that instead of dropping facts here you should post it on Substack and link to it here. You’ll be fine with it because you’re trusted here so people will be like “oh it’s fine”.
And then once you have the newsletter going and you have a following there you can do paid placements etc. that don't have to be done by you.
I think you have the highest potential on this front but that doesn't mean there's comparative advantage. It may not be worth it to you. For instance, I would never do it. To keep that wheel spinning you have to keep putting energy into it. And I have other ways of making money, so even with your account it would be a waste.
Hell, I would consider myself graced that simonw, yes, THAT simonw, the LLM whisperer, took time out of his busy schedule to send me to a discussion I might have expressed interest in.
... and my point remains: he's fine. Could be better. If he does grace us, he can choose to bait the hook more effectively. Or not. The stakes are silly-low.
This interaction is, effectively, a link dropped with an announcement of an announcement. For what has already occurred. Over-fitting, training? You don't say.
If I wanted to be more of an ass, I'd look to argue about hype generation. But I don't, I appreciate any honest effort, which I believe for Simon.
the date has been changing for years now. one day someone will actually define what bubble we are waiting to burst and then will poke it to burst and many will say “hey, see I was right all along” ;)
reply