Bulk image downloader linux

Bulk image downloader linux

Python package for downloading a collection of images from a list of urls. It comes with the following features:

• Downloads are multithreaded using concurrent.futures .
• Relies on a persistent cache. Already downloaded images are not downloaded again, unless you force imgdl to do so.
• Can hide requests behind proxies
• It can be used as a command line utility or as a python library.
• Normalizes images to JPG format + RGB mode after download.
• Generates thumbnails of varying sizes automatically.
• Can space downloads with a random timeout drawn from an uniform distribution.

Or, from the root project directory:

Here is a simple example using the default configurations:

Images will be downloaded to

/.datasets/images using 50 threads. The function returns the list of paths to each image. Paths are constructed as / . If for any reason a download fails, imgdl returns a None as path.

Notice that if you invoke download again with the same urls, it will not download them again as it will check first that they are already downloaded.

Download was instantaneous! and imgdl is clever enough to return the image paths.

Here is the complete list of parameters taken by download :

• iterator : The only mandatory parameter. Usually a list of urls, but can be any kind of iterator.
• store_path : Root path where images should be stored
• n_workers : Number of simultaneous threads to use
• timeout : Timeout that the url request should tolerate
• thumbs : If True, create thumbnails of sizes according to thumbs_size
• thumbs_size : Dictionary of the kind indicating the thumbnail sizes to be created.
• min_wait : Minimum wait time between image downloads
• max_wait : Maximum wait time between image downloads
• proxies : Proxy or list of proxies to use for the requests
• headers : headers to be given to requests
• user_agent : User agent to be used for the requests
• notebook : If True, use the notebook version of tqdm progress bar
• debug If True, imgdl logs urls that could not be downloaded
• force : download checks first if the image already exists on store_path in order to avoid double downloads. If you want to force downloads, set this to True.

Most of these parameters can also be set on a config.yaml file found on the directory where the Python process was launched. See config.yaml.example

Command Line Interface

It can also be used as a command line utility:

Download images from google

This is an example of how we can use imgdl to download images from a google image search. I currently use this to quickly build up image datasets. I took inspiration from this blog post by pyimagesearch.

Install imgdl with the [google] extra requirements:

Download the webdriver for Chrome here and make sure it’s in your PATH, e. g., place it in /usr/bin or /usr/local/bin.

Clone this repository, or simply download the google.py script.

You are ready to download images from a google images search. Here is an example of usage:

The first argument is the query to be sent to google. With -n 600 you are asking for at least 600 images. By default, a google image query page has only 100 images and requires you to scroll down if you want more. What the script is doing is using selenium to simulate a browsing session and scroll down on google search. With the —interactive flag, chrome will open and you will be able to see how it scrolls down in order to get more images. Here is the full list of the command line options:

Images used for tests are from the wikimedia commons

Источник

RipMe – Bulk image downloader for Linux

RipMe can be used to download images in bulk from all major image-hosting websites. Among others, these include Imgur, Reddit, Twitter, Tumblr, Flickr, Instagram, etc. Read on more details.

T here are instances when you need to download quite a bulk of pictures at once. Be it for project work, or photos of something that you love.

In any case, downloading many photos one by one is great pain, and extremely time-consuming. Another option could be to download an already compiled album, but honestly, there are not a whole lot of albums available to download on every occasion. Any easy solution?

We have a solution to offer here: a bulk image downloader, RipMe.

Features

RipMe can be used to download images in bulk from all major image-hosting websites. Among others, these include Imgur (most importantly), Reddit (yes, you can download pictures of a full sub-Reddit), Twitter, Tumblr, Flickr, Instagram, etc. A complete list can be found here.

Interface

The interface, although quite easy to use and straightforward, is a little cramped. There is no harm to the functionality, and all the configurations and options are easy to reach. There are four significant tabs for logs, history, queue, and settings. There is a bar on the top to provide an album link, and simple buttons, saying ‘Rip,’ which starts the downloading process, and ‘Stop,’ which halts it. There is also a small status bar, indicating the activity of the program.

Interface

Network and hardware

Users can configure the maximum number of download threads. The timeout duration can also be changed, and also, the number of retries, if there is some error while downloading an image/album, can also be configured.

Hardware and network configurations

Download links and location

There are several configurations available for downloading the images. Users can add either a single link to an album or provide several links in a text file (separated by new-lines) and use that file as in input. This option can be accessed using the option “Download url list.” One more interesting option available is to be able to get URLs directly from the clipboard. This can be used by checking ‘Autorip from the clipboard.’

The default location for the downloads is a directory named ‘rips‘ in the same directory as that of the location of the application file. This can be easily changed using the available option of ‘Select Save Directory.’

Downloaded images configuration options

There is a beneficial option to be able to preserve the order of the images just as they are at the given link. The latest uploaded image on the webpage will appear foremost in the directory that has the downloaded files. All that needs to be done is to check the box that says ‘Preserve order.’

Users can even save the captions or the image descriptions as given on the website. The option ‘Save descriptions‘ needs to be checked for this.

RipMe configurations

Other features

Other than what is mentioned above, some more useful features are:

• Extensive language support
• Notification configurations
• Toggling whether to, or not save the logs and URLs
• Option to prefer MP4 over GIF while downloading
• Overwriting existing files, if the album that has been downloaded before
• If unchecked, RipMe will skip the image that is already present

RipMe configurations

Installation

There are not any prerequisites for this program, except for one, the Java Runtime. This is usually installed in most operating systems by default (including Ubuntu), but in case not, use the following commands for installation:

For systems that use APT package management (including Ubuntu, its derivatives, and Debian based systems):

On Arch (as of now, because the package name changes according to the version), use the command:

For Fedora, first issue the command:

Install the most appropriate version available using:

Follow this article for better guidance.

You can easily find the installation command on the internet for the rest of the distributions. Here’s the official installation page.

Now that the prerequisites are done, we can go ahead and download the program itself. You can find the latest release here. Go ahead and download the .jar file of the newest version.

Now, to run the program, use the following commands:

These instructions are to move to the downloads directory, assuming the downloaded .jar file is there. If you have it downloaded in a different directory, please proceed to that directory.

This will start up the program.

There might find something that users won’t like, that to keep the program running, you also have to keep the Terminal window open through which you launched the program. To avoid that, use this command instead:

You can close the Terminal window after the launching of the program in this case. In case you want to make a launcher for RipMe that you can access from the application launcher, you can refer to the program Arronax, which lets you do just that.

Conclusion

RipMe is a quite useful utility program to save you a lot of time. Even though the GUI looks a bit messy, it is still fully functional and easy to navigate. The significant configurations available makes it easy for the users to make the most out of RipMe.

The extensive list of websites that the images can be downloaded from is a significant plus point. If you want support for some other site too, you can even contact the developers and ask them to add it right here. If you have any questions, feel free to ask them in the comments section.

Источник

Download Bulk Image Downloader

64 bit Windows 10, 8, 7

32 bit Windows 10, 8, 7

Try Before You Buy

You can download and install BID without purchasing a registration code. Go ahead and try it for free!

Try BID for Free

• Download full sized images from web galleries
• Max of 100 images per gallery
• Max of 2 simultaneous download threads
• Max of 2 jobs in the Queue Manager
• No more than 2 instances of BID
• Nag messages
• Timed delays
• Limited support

Unlock Full Functionality

• Download full sized images from web galleries
• Unlimited images per gallery
• Up to 50 simultaneous download threads
• Unlimited jobs in the Queue Manager
• Unlimited instances of BID
• No nag messages or delays
• Free upgrades for one year
• Priority support

Updates / Upgrades

To update/upgrade your existing version of BID, simply download and run the installer at the top of this page — you don’t need to uninstall the older version first.

If you install a version of BID that is outside of your free upgrade period then BID will prompt you to purchase an upgrade code when it starts.

Note that many of the existing BID translations require updating. If you see that the translation for your language is out of date and you are willing to update it please contact us with your details and the language you want to update.

Источник

Bulk Image Downloader

С Bulk Image Downloader вы можете загружать полноразмерные изображения практически из любой веб-галереи.

С Bulk Image Downloader вы можете загружать полноразмерные изображения практически из любой веб-галереи. Поддерживает Flickr, Imagevenue, Imagefap и большинство других популярных сайтов изображений.

Ссылки на официальные сайты

Категории

Альтернативы для Bulk Image Downloader

JDownloader

JDownloader — это бесплатный менеджер загрузок с открытым исходным кодом. Это упрощает и улучшает процесс загрузки файлов с веб-сайтов, провайдеров облачных хранилищ, социальных сетей и файловых хостингов. JDownloader предлагает загрузку в несколько…

Открытый исходный код Бесплатно Linux Windows Mac

DownThemAll

DownThemAll (или просто dTa) — это мощное, но простое в использовании расширение Mozilla Firefox, которое добавляет новые расширенные возможности загрузки в ваш браузер. DownThemAll позволяет загружать все ссылки или изображения, содержащиеся на веб…

Открытый исходный код Бесплатно Firefox Pale Moon BSD Linux Windows Mac

ImageHost Grabber

Многие форумы и блоги не имеют возможности хранить изображения на своих собственных серверах. Вместо этого, постеры должны использовать сторонний хост для обмена изображениями. Существует много бесплатных хостов изображений, таких как imagevenue, im…

Условно бесплатно Firefox Linux Windows Mac

NeoDownloader

Как вы знаете, существует множество сайтов с множеством картинок, музыки и фильмов. И, конечно, это занимает много времени, чтобы сохранить каждый файл вручную. But now you can forget about this frustrating process! NeoDownloader will help you to do…

Условно бесплатно Windows

Multithreaded Download Manager

This is an experimental Firefox 57 download manager with multithreading support. It can download files with multiple connections to the server. Depending on the network condition, this may increase the download speed. Click the toolbar button to ope…

Открытый исходный код Бесплатно Firefox Android Linux Windows Mac

Image Cyborg

Загрузите и сохраните все изображения на веб-странице с помощью Image Cyborg. Процесс очень быстрый и очень простой, просто введите URL-адрес и нажмите кнопку, чтобы получить упакованный пакет изображений.

RipMe

Скачивает альбомы оптом. RipMe App — это программа для автоматической загрузки полных альбомов изображений в режиме онлайн с постоянно растущего списка сайтов, включая Imgur, Twitter, Reddit, Instagram и многие другие, включая многочисленные хосты и…

Открытый исходный код Бесплатно Java Linux Windows Mac

Extreme Picture Finder

Extreme Picture Finder — это мощный пакетный загрузчик изображений. Скачать все изображения с любого сайта автоматически и очень быстро. Но не только изображения! Он позволяет загружать музыку, видео или любые другие файлы — просто введите адрес веб…

Ant Download Manager

Ant Download Manager — это быстрый и простой загрузчик любых интернет-файлов. Расширенная поддержка видеоуслуг (YouTube, FB, ВКонтакте, Rutube и др . ). — Бесплатная версия с функциональными ограничениями Простой, удобный, интуитивно понятный интер…

Условно бесплатно Firefox Brave Opera Yandex.Browser Chrome Vivaldi Browser Internet Explorer Windows

Bazzacuda

Пакетное сохранение изображений, открытых во вкладках.

Бесплатно Firefox Linux Windows Mac

Image Downloader

Просматривайте и загружайте изображения на веб-странице с помощью Image Downloader for Chrome. ФУНКЦИИ — Смотрите изображения, которые содержит страница и ссылки на — Отфильтруйте их по ширине, высоте и URL; поддерживает подстановочные знаки и регул…

Бесплатно Chrome Linux Windows Mac

Download Links

Плагин по умолчанию поддерживает загрузку наиболее распространенных типов файлов. Если у вас есть любой другой тип файла, укажите это расширение, и вы сможете просматривать, фильтровать и загружать файлы в соответствии с вашими требованиями!

Бесплатно Firefox Linux Windows Mac

Google Images Download

Это программа Python для командной строки, которая выполняет поиск по ключевым словам / фразам в Google Images и при необходимости загружает изображения на ваш компьютер. Вы также можете вызвать этот скрипт из другого файла Python. Это небольшая и г…

Открытый исходный код Бесплатно Python Linux Windows Mac

Источник