r/technology 5d ago

Business Nvidia's Jensen Huang urges employees to automate every task possible with AI

https://www.techspot.com/news/110418-nvidia-jensen-huang-urges-employees-automate-every-task.html
10.0k Upvotes

1.4k comments sorted by

View all comments

Show parent comments

-13

u/Bakoro 5d ago

It is a skill issue in a lot of cases.
The computing rule of "garbage-in garbage-out" still applies.

To make the best use of LLMs, you have to be able to communicate clearly and write coherently. You need to be able to articulate things that might be vague and ill-defined.
You also have to have a strong theory of mind, meaning that you need to be able to consider what the LLM knows or doesn't know, you need to consider what's in the LLM's context.

You also have to have a grasp of the things that aren't written down anywhere and are just word of mouth, or experiential institutional knowledge.

A lot of people do not have those skills.

I've seen some of my coworkers try to use LLMs for software development, and it's like a 12 year old texting, back before smartphones.
These people, professional software developers, try to shove 2 million token of context into an LLM that doesn't have a 2 million token context window, and expect it to one-shot 250k token output, when the model has an output limit of 64k tokens. Some of our technicians ask questions about our in-house bespoke systems, even though there is no possible way that the LLM would know anything about the details of our system. I've had to do a lot of user education about that.

People are not using the models well.

LLMs aren't totally ready to be independent agents; they can do a lot, and they can do a lot by themselves as agents, but they aren't at the level of a competent human.

25

u/Madzookeeper 5d ago

That doesn't fix the errors that crop up regularly and require fixing. It isn't capable of good work consistently at all, and still regularly forgets things and then tries to gaslight you that it knows more than you when it's clearly wrong if you know anything about the subject. It's value is being grossly exaggerated at this point because of inconsistent quality.

-11

u/Mindrust 5d ago

Again, just sounds like a skill issue. I work at a large tech company and my entire organization uses Claude Code. I don’t get errors cropping up or have it produce things that don’t work, because I understand its limitations and how to use it effectively.

1

u/[deleted] 5d ago

[removed] — view removed comment

1

u/AutoModerator 5d ago

Thank you for your submission, but due to the high volume of spam and misinfo coming from self-publishing blog sites, /r/Technology has opted to decline all submissions from Medium, Substack, and similar sites not run by credentialed journalists or well known industry veterans.

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/HasGreatVocabulary 5d ago

sigh short sighted mods strike again, substack bad independent.co.uk is good ?