Arun Shah™@lemmy.world to Technology@lemmy.ml · 6 days agoTop 10 website in the world ( July 2025 )lemmy.mlimagemessage-square31fedilinkarrow-up196arrow-down19
arrow-up187arrow-down1imageTop 10 website in the world ( July 2025 )lemmy.mlArun Shah™@lemmy.world to Technology@lemmy.ml · 6 days agomessage-square31fedilink
minus-squarePechente@feddit.orglinkfedilinkarrow-up1·6 days agoMy comment was based on a podcast I listened to (Tech won’t save us, I think?). My guess is they also wanna crawl all the edits, discussion etc. which is usually not included in the complete dumps.
minus-squareclb92@feddit.dklinkfedilinkarrow-up3·5 days agoDumps with complete page edit history can be downloaded too, as far as I can see, so no need to crawl that.
My comment was based on a podcast I listened to (Tech won’t save us, I think?). My guess is they also wanna crawl all the edits, discussion etc. which is usually not included in the complete dumps.
Dumps with complete page edit history can be downloaded too, as far as I can see, so no need to crawl that.
Good pod cast