Pip update all packages linux

Python: Update All Packages with pip-review

Introduction

Updating Python packages can be a hassle. There are many of them — it’s hard to keep track of all the newest versions, and even when you decide what to update, you still have to update each of them manually.

To address this issue, pip-review was created. It lets you smoothly manage all available PyPi updates with simple commands.

Originally a part of the pip-tools package, it now lives on as a standalone convenience wrapper around pip . In this tutorial, we’ll be covering how to update all packages with pip-review.

Install pip-review

You can install pip-review in a virtual environment, if you’d like to contain it, or system-wide. Naturally, installing pip-review is done via pip :

Help Page of pip-review

If you forget any of these commands or you simply want an overview of the command options:

Check All Package Versions with pip-review

Sometimes, you’d just want to check if there are any updates, before commiting to a potentially long update list. To check all package versions, you simply run:

This gives you a report that lists all available package updates. Essentially, it calls pip list – outdated . This has the advantage of allowing you decide which packages you’d like to update, if any at all.

Update All Packages with pip-review

Once you’ve identified if you’d like to update your packages, you can update them all, automatically, using:

Running just this command alone — you’re set to go. It’s that simple.

Update All Packages Interactively with pip-review

If you perhaps don’t wish to update some specific packages, you don’t need to run the —auto updater. If you launch the process as —interactive , you can choose for each individual package whether you’d like to update it or no:

For each package, you have four options available, “Yes”, “No”, “All” and “Quit”.

Selecting “Yes” indicates you want that particular package added to the «to-be-updated-list». At the end every package on this list gets updated.

If you end up selecting “No” it would mean the package won’t get updated. Selecting “All” means all packages moving forward will be added to the list. Finally, selecting “Quit” would mean pip-review will skip all remaining packages and update only the ones you selected “Yes” to.

Prevent pip-review from Updating Certain Packages

In some situations, you might want to prevent certain packages from automatically updating when running pip-review —auto . This could be perhaps to avoid dependencies issues, a common problem.

Free eBook: Git Essentials

Check out our hands-on, practical guide to learning Git, with best-practices, industry-accepted standards, and included cheat sheet. Stop Googling Git commands and actually learn it!

In these cases, you’d want to pin the specific packages you don’t want to update. You can do this via a constraint file. A constraint file is a requirement file that only controls which version of a requirement is installed, not whether it is installed or not.

Its syntax and contents are identical to that of requirement files. There is one key difference:

Including a package in a constraints file doesn’t trigger installation of the package.

Let’s make a constraints.txt file:

And now within it, we’ll insert:

Conclusion

Updating packages using pip can be tedious and time-consuming. And as as expected in the computer science world, a tool was born to automate this. In this article, we’ve gone over the pip-review utility — how to install it, as well as how to use it to update packages in Python.

Источник

enable pip to upgrade all outdated packages #3819

Comments

walchko commented Jun 26, 2016

Pip version: all Python version: all Operating System: all

Description:

I would like pip to upgrade all outdated packages identified by pip list —outdated in one simple command. It would also be nice to have pip outdated show the outdated package too.

What I’ve run:

this works for me (so far), but from a usability stand point, people shouldn’t have to do this just to keep their packages up to date:

The text was updated successfully, but these errors were encountered:

picibucor commented Aug 23, 2016

It does not work for Windows 7

OskarCarl commented Sep 8, 2016 •

Well, cut and xargs are linux command line tools so it can’t be expected to simply work on Windows. You would need Windows equivalents of those or maybe something like cygwin. Ignore this.

RonnyPfannschmidt commented Sep 8, 2016

note that this is completely broken for pip style installers

unlike a linux distribution where a set of packages goes trough release and maintenance processes, with QA

pypi is a package index, not a quality assured distribution

please dont pretend it can be used like one

OskarCarl commented Sep 8, 2016

Sorry, I had no idea. I’ve edited my original comment.

xavfernandez commented Sep 28, 2016

Closing as duplicate of the requested upgrade-all command (cf #59)

its0x08 commented Dec 6, 2016 •

pip freeze > requirements.txt && pip install —upgrade -r requirements.txt && rm requirements.txt
super easy !

picibucor commented Dec 6, 2016 •

on win:
pip freeze > requirements.txt && pip install —upgrade -r requirements.txt && del requirements.txt

its0x08 commented Dec 6, 2016

@picibucor : i see -r if u dont is ur problem!

picibucor commented Dec 6, 2016

gwerbin commented Feb 16, 2017 •

@its0x08 you can do this in a Bash-flavored shell without creating a temporary file using «process substitution»:

Under the hood, this creates a temporary «named pipe» and then deletes it immediately after.

pfmoore commented Feb 16, 2017

1. pip freeze includes exact versions, so it won’t upgrade as written (you’d need to add a step to strip out the version constraints).
2. Doing this will upgrade everything to the latest versions, which won’t necessarily respect dependencies. For example, bleach depends on html5lib (>=0.999,!=0.9999,!=0.99999, , but pip install —upgrade bleach html5lib will install html5lib-0.999999999 . This is the «pip needs a dependency resolver» issue.

nschloe commented Mar 15, 2017 •

For anyone who’s tired googling that command line, I’ve added a command line tool to pipdate. Simply

Источник

How to Update All Python Packages

With Python, the best practice of pinning all the packages in an environment at a specific version ensures that the environment can be reproduced months or even years later.

• Pinned packages in a requirements.txt file are denoted by ==. For example, requests==2.21.0. Pinned packages should never be updated except for a very good reason, such as to fix a critical bug or vulnerability.
• Conversely, unpinned packages are typically denoted by >=, which indicates that the package can be replaced by a later version. Unpinned packages are more common in development environments, where the latest version can offer bug fixes, security patches and even new functionality.

As packages age, many of them are likely to have vulnerabilities and bugs logged against them. In order to maintain the security and performance of your application, you’ll need to update these packages to a newer version that fixes the issue.

The pip package manager can be used to update one or more packages system-wide. However, if your deployment is located in a virtual environment, you should use the Pipenv package manager to update all Python packages.

NOTE: be aware that upgrading packages can break your environment by installing incompatible dependencies. This is because pip and pipenv do not resolve dependencies, unlike the ActiveState Platform. To ensure your environment doesn’t break on upgrade, you can sign up for a free ActiveState Platform account and import your current requirements.txt, ready to be upgraded.

Python Package Upgrade Checklist

In general, you can use the following steps to perform a package upgrade:

1. Check that Python is installed

Before packages can be updated, ensure that a Python installation containing the necessary files needed for updating packages is in place by following the steps outlined in Installation Requirements >

2. Get a list of all the outdated packages

To generate a list of all outdated packages:

3. Upgrade outdated packages

Depending on your operating system or virtual environment, refer to the following sections.

Update all Python Packages on Windows

The easiest way to update all packages in a Windows environment is to use pip in conjunction with Windows PowerShell:

1. Open a command shell by typing ‘powershell’ in the Search Box of the Task bar
2. Enter:

This will upgrade all packages system-wide to the latest version available in the Python Package Index (PyPI).

Update all Python Packages on Linux

Linux provides a number of ways to use pip in order to upgrade Python packages, including grep and awk.

To upgrade all packages using pip with grep on Ubuntu Linux:

To upgrade all packages using pip with awk on Ubuntu Linux:

Updating Python Packages on Windows or Linux

Pip can be used to upgrade all packages on either Windows or Linux:

1. Output a list of installed packages into a requirements file (requirements.txt):

1. Edit requirements.txt, and replace all ‘==’ with ‘>=’. Use the ‘Replace All’ command in the editor.
2. Upgrade all outdated packages:

Updating all Packages in a Virtual Environment

The easiest way to update unpinned packages (i.e., packages that do not require a specific version) in a virtual environment is to run the following Python script that makes use of pip:

Updating all Packages in a Pipenv Environment

The simplest way to update all the unpinned packages in a specific virtual environment created with pipenv is to do the following steps:

1. Activate the Pipenv shell that contains the packages to be upgraded:

1. Upgrade all packages:

Modern way to manage Python packages – ActiveState Platform

The ActiveState Platform is a cloud-based build automation and dependency management tool for Python. It provides dependency resolution for:

• Python language cores, including Python 2.7 and Python 3.5+
• Python packages and their dependencies, including:
  • Transitive dependencies (ie., dependencies of dependencies)
  • Linked C and Fortran libraries, so you can build data science packages
  • Operating system-level dependencies for Windows, Linux, and macOS
  • Shared dependencies (ie., OpenSSL)

The ActiveState Platform is the only Python package management solution that not only resolves dependencies but also provides workarounds for dependency conflicts.

Simply following the instruction prompts will resolve the conflict, eliminating dependency hell.

You can try the ActiveState Platform for free by creating an account using your email or your GitHub credentials. Start by creating a new Python project, pick the latest version that applies to your project, your OS and start to add packages. Or start by simply importing your requirements.txt file and creating a Python version with all the packages you need. The Platform will automatically pick the right package versions for your environment to ensure security and reproducibility.

Watch this tutorial to learn how to use the ActiveState Platform to create a Python 3.9 environment, and then use the Platform’s Command-Line Interface (State Tool) to install and manage it.

Ready to see for yourself? You can try the ActiveState Platform by signing up for a free account using your email or GitHub credentials.

Just run the following command to install Python 3.9 and our package manager, the State Tool:

Windows

Linux

Now you can run state install

. Learn more about how to use the State Tool to manage your Python environment. Or sign up for a free demo and let us show you how it can help improve your dev team’s workflow by compiling Python packages and resolve dependencies in minutes.

Источник

Upgrade all packages in Python using pip

In this article, we will learn to upgrade all Python packages using pip manager. We will use some built-in functions, pip Python manager available in Python to upgrade all packages available in Python. Let’s first have a quick look over what is a pip in Python.

The Pip Python Package Manager

Programmers generally use virtual environments and pip package while working with the Python programming language. When working with projects in Python, users have packages versions being used are defined, which starts growing with time and some packages start to be outdated. pip Python manager is designed to upgrade the python packages system-wide. Let us look at different ways to use pip to upgrade packages from older versions to newer or latest versions.

Update all packages using pip on Windows

This is the easier way to upgrade packages by using pip in conjunction with Windows PowerShell. Open your command shell and enter the below command. This will upgrade all packages system-wide to the latest or newer version available in the Python Package Index (PyPI) .

Update all packages using pip on Linux

Linux provides a number of ways to use pip in order to upgrade python packages. This includes two ways using grep and awk.

• Use grep to upgrade packages — The grep is to skip editable («-e») package definitions, and the -n1 flag for xargs that prevents stopping everything, if updating one package fails.

• Use awk to upgrade packages — The below command first lists all outdated packages, then fetches the first column and converts the multiline result from cut into a single-line, and forms a space-separated list. It then skips header lines, fetches the first column and takes 1 argument from the pipe left of it, and at last passes it to the command to upgrade the list of packages.

Command for either Windows or Linux for updating packages

pip freeze first outputs a list of installed packages into a requirements file (requirements.txt). Then the user needs to edit requirements.txt, and replace all ‘ == ’ with ‘ >= ’. Use the ‘Replace All’ command in the editor. It then upgrades all outdated packages.

Updating all packages in a Virtual Environment

The easiest way to update unpinned packages (i.e., packages that do not require a specific version) in a virtual environment is to run the following Python script that uses pip. Unlike pip freeze , this command will not print warnings and FIXME errors.

For pip = 10.0.1

Updating all Local Packages using pip-review

This command updates only local Python packages. However, this command may not be feasible because it might sometimes generate errors and pip.review may or may not support Python 3 version. pip-review is a fork of pip-tools . pip-review package works but pip-tools package no longer works in the latest versions of Python.

Conclusion

In this article, we learned different commands to upgrade or update all Python packages using pip manager in Python. We saw two main methods such as pip freeze and pip review to update packages.

Источник