In search of the most optimized image in Drupal 7

Jim Birch writes about image optimisation:

While Drupal Image styles allow us to create the exact size we want, I was looking for a way to better optimize the image size, make progressive jpegs, and keep the rendered images looking as close to the original as possible.

Some useful tips there.