Comment by demirbey05

Comment by demirbey05 3 days ago

5 replies

View on Hacker News

Yesterday, I was asked to scrape data from a website. My friend used ChatGPT to scrape data but didn't succeded even spent 3h+. I looked website code and understand with my web knowledge and do some research with LLM. Then I described how to scrape data to LLM it took 30 minutes overall. The LLM cant create best way but you can create with using LLM. Everything is same, at the end of the day you need someone who can really think.

jvm___ 3 days ago

LLM's can do anything, but the decision tree for what you can do in life is almost infinite. LLM's still need a coherent designer to make progress towards a goal.

Reply View 1 reply
  • demirbey05 3 days ago

    LLMs can do small things well, but you must use small parts to form big picture.

    Reply View 0 replies
isatty 3 days ago

Or you could’ve used xpath and bs4 and have been done in an hour or two and have more understandable code.

Reply View 1 reply
  • demirbey05 3 days ago

    it is not that easy, there is lazy loading in the page that is triggered by scroll of specific sections. You need to find clever way, no way to scrape with bs4, so tough with even selenium.

    Reply View 0 replies