Development > PC, Mac & Vintage Computers

Rule34 image downloader

(1/2) > >>

gameblabla:
So i met a guy on Discord and he made this image file scrapper in Python :
https://github.com/sunx2/r34py

Unfortunately, reading the source code was like trying to de-obfuscate it.
Plus, i had to use proxychains to make it work over Tor.

Hence why i decided as an exercise to re-implement it in C.
The main issues i had were to implement a function to crawl over the html files and find the image links.
This was the first time i did something like this so i took me a few more hours.
I eventually decided i should look for a pattern that would allow me to find them links fairly easily.

--- Code: ---<a href="http:///....>

--- End code ---

I eventually shortened the code so it only looks at  "<", ":" and if it is preceded by "r" two characters before the link.
Believe or not it works and i can now download all of my pr0n goodness from the command line.

Then, i extended it so it downloads it from all the pages (just a loop really) and here are the results :
https://github.com/gameblabla/r34downloader_curl

It uses curl for downloading things. Once i work on the SDL gui interface, it could be ported to other platforms too.

Lemme now what you think about it. You must compile it from source.

xlibman:
Is the only content allowed rule 34/pr0n material? :P

_iPhoenix_:
It's really easy to do it manually, too. Most OS's provide an option to download a webpage and it's assets, and you can filter by image type.

gameblabla:

--- Quote from: xlibman on January 23, 2018, 09:12:54 pm ---Is the only content allowed rule 34/pr0n material? :P

--- End quote ---
Well the website itself only allows that so yeah. But this could be adapted to other websites but most don't post direct links
to the full pictures so yeah...


--- Quote from: _iPhoenix_ on January 24, 2018, 12:08:05 am ---It's really easy to do it manually, too. Most OS's provide an option to download a webpage and it's assets, and you can filter by image type.

--- End quote ---
Well yes, that is true but the point was to only download what i wanted, namely just the images themselves and not the thumbnails, ads or other random s***. I doubt the OSes allow that very easily.

gameblabla:
Well, i tried it with some other tags like Mario and i realized it would not pick up some images properly.
So i fixed that and it works properly now.

Navigation

[0] Message Index

[#] Next page

Go to full version