Best practices
There are a number of good and bad practices that may not be immediately obvious when developing a plugin. This page covers some known practices that could affect the ability to install or use your plugin effectively.
Don’t include PySide2
or PyQt5
in your plugin’s dependencies.¶
This is important!
Napari supports both PyQt and PySide backends for Qt. It is up to the
end-user to choose which one they want. If they installed napari with pip install napari[all]
, then the [all]
extra will (currently) install PyQt5
for them from pypi. If they installed via conda install napari
, then they’ll
have PyQt5
, but via anaconda cloud instead of pypi. Lastly, they may have
installed napari with PySide2.
Here’s what can go wrong if you also declare one of these backends in the
install_requires
section of your plugin metadata:
If they installed via
conda install napari
and then they install your plugin viapip
(or via the builtin plugin installer, which currently usespip
), then there will be a binary incompatibility between their condapyqt
installation, and the new pip “PyQt5
” installation. This will very likely lead to a broken environment, forcing the user to re-create their entire environment and re-install napari. This is an unfortunate consequence of package naming decisions, and it’s not something napari can fix.Alternatively, they may end up with both PyQt and PySide in their environment, and while that’s not always guaranteed to break things, it can lead to unexpected and difficult to debug problems.
Don’t import from PyQt5 or PySide2 in your plugin: use
qtpy
.If you use
from PyQt5 import QtCore
(or similar) in your plugin, but the end-user has chosen to usePySide2
for their Qt backend — or vice versa — then your plugin will fail to import. Instead usefrom qtpy import QtCore
.qtpy
is a Qt compatibility layer that will import from whatever backend is installed in the environment.
Try not to depend on packages that require C compilation, but do not offer “wheels”¶
Tip
This requires some awareness of how your dependencies are built and distributed…
Some python packages write a portion of their code in lower level languages like
C or C++ and compile that code into “C Extensions” that can be called by python
at runtime. This can greatly improve performance, but it means that the
package must be compiled for each platform (i.e. Windows, Mac, Linux) that the
package wants to support. Some packages do this compilation step ahead of time,
by distributing “wheels” on
PyPI… or by providing pre-compiled packages via conda
.
Other packages simply distribute the source code (as an “sdist”) and expect the
end-user to compile it on their own computer. Compiling C code requires
software that is not always installed on every computer. (If you’ve ever tried
to pip install
a package and had it fail with a big wall of red text saying
something about gcc
, then you’ve run into a package that doesn’t distribute
wheels, and you didn’t have the software required to compile it).
As a plugin developer, if you depend on a package that uses C extensions but doesn’t distribute a pre-compiled wheel, then it’s very likely that your users will run into difficulties installing your plugin:
What is a “wheel”?
Briefly, a wheel is a built distribution, containing code that is pre-compiled for a specific operating system.
For more detail, see What Are Python Wheels and Why Should You Care?
How do I know if my dependency offers a wheel
There are many ways, but a sure-fire way to know is to go to the respective package on PyPI, and click on the “Download Files” link. If the package offers wheels, you’ll see one or more files ending in
.whl
. For example, napari offers a wheel. If a package doesn’t offer a wheel, it may still be ok if it’s just a pure python package that doesn’t have any C extensions…How do I know if one of my dependencies uses C Extensions?
There’s no one right way, but more often than not, if a package uses C extensions, the
setup()
function in theirsetup.py
file will use theext_modules
argument. (for example, see here in pytorch)
What about conda?
conda also distributes & installs pre-compiled packages, though they aren’t wheels. While this is definitely a fine way to install binary dependencies in a reliable way, the built-in napari plugin installer doesn’t currently work with conda. If your dependency is only available on conda, but does not offer wheels,you may guide your users in using conda to install your package or one of your dependencies. Just know that it may not work with the built-in plugin installer.
Don’t import heavy dependencies at the top of your module¶
Note
This point will be less relevant when we move to the second generation manifest-based plugin declaration, but it’s still a good idea to delay importing your plugin-specific dependencies and modules until after your hookspec has been called. This helps napari stay quick and responsive at startup.
Consider the following example plugin:
[options.entry_points]
napari.plugin =
plugin-name = mypackage.napari_plugin
In this example, my_heavy_dependency_like_tensorflow
will be imported
immediately when napari is launched, and we search the entry_point
mypackage.napari_plugin
for decorated hook specifications.
# mypackage/napari_plugin.py
from napari_plugin_engine import napari_hook_specification
from qtpy.QtWidgets import QWidget
from my_heavy_dependency_like_tensorflow import something_amazing
class MyWidget(QWidget):
def do_something_amazing(self):
return something_amazing()
@napari_hook_specification
def napari_experimental_provide_dock_widget():
return MyWidget
This can deterioate the end-user experience, and make napari feel slugish. Best practice is to delay heavy imports until right before they are used. The following slight modification will help napari load much faster:
# mypackage/napari_plugin.py
from napari_plugin_engine import napari_hook_specification
from qtpy.QtWidgets import QWidget
class MyWidget(QWidget):
def do_something_amazing(self):
# import has been moved here, will happen only after the user
# has opened and used this widget.
from my_heavy_dependency_like_tensorflow import something_amazing
return something_amazing()
(again, the second gen napari plugin engine will help improve this situation, but it’s still a good idea!)
Don’t leave resources open¶
It’s always good practice to clean up resources like open file handles and databases. As a napari plugin it’s particularly important to do this (and especially for Windows users). If someone tries to use the built-in plugin manager to uninstall your plugin, open file handles and resources may cause the process to fail or even leave your plugin in an “installed-but-unuseable” state.
Don’t do this:
# my_plugin/module.py
import json
data_file = open("some_data_in_my_plugin.json")
data = json.load(data_file)
Instead, make sure to close your resource after grabbing the data (ideally by using a context manager, but manually otherwise):
with open("some_data_in_my_plugin.json") as data_file:
data = json.load(data_file)
Write extensive tests for your plugin!¶
Programmer and author Bruce Eckel famously wrote:
“If it’s not tested, it’s broken”
It’s true. High test coverage is one way to show your users that you are dedicated to the stability of your plugin. Aim for 100%!
Of course, simply having 100% coverage doesn’t mean your code is bug-free, so make sure that you test all of the various ways that your code might be called.
See our Tips for testing napari plugins.
How to check test coverage?¶
The cookiecutter template is already set up to report test coverage, but you can test locally as well, using pytest-cov
pip install pytest-cov
Run your tests with
pytest --cov=<your_package> --cov-report=html
Open the resulting report in your browser:
open htmlcov/index.html
The report will show line-by-line what is being tested, and what is being missed. Continue writing tests until everything is covered! If you have lines that you know never need to be tested (like debugging code) you can exempt specific lines from coverage with the comment
# pragma: no cover
In the cookiecutter, coverage tests from github actions will be uploaded to codecov.io