Some images generated with imaginary are incorrect

[janusn]

Some square preview images generated with command
$ occ preview:generate-all -vvv
are a crop of the original images and the aspect ratio are not preserved.
On the other hand, the square preview images generated by web interface of Nextcloud are correctly. They respect the aspect ratios and letterboxed correctly.

Environment:

• Nextcloud docker: linuxserver/nextcloud:latest

• Nextcloud version 24.0.6
• previewgenerator version 5.1.0

• imaginary docker: h2non/imaginary:latest

• Imaginary version 1.2.4

• host OS: DSM 7.1.1-42962 Update 1
• hardware: Synology DS-918+

The content of the config.php:

<?php
$CONFIG = array (
  'memcache.local' => '\\OC\\Memcache\\APCu',
  'memcache.distributed' => '\\OC\\Memcache\\Redis',
  'memcache.locking' => '\\OC\\Memcache\\Redis',
  'redis' => 
  array (
    'host' => 'redis',
    'port' => 6379,
    'timeout' => 1.5,
  ),
  'filelocking.enabled' => true,
  'datadirectory' => '/data',
  'instanceid' => '<omitted for security>',
  'passwordsalt' => '<omitted for security>',
  'secret' => '<omitted for security>',
  'trusted_domains' => 
  array (
    0 => '<omitted> for security>',
  ),
  'dbtype' => 'mysql',
  'version' => '24.0.6.1',
  'trusted_proxies' => ['swag'],
  'overwrite.cli.url' => '<omitted for security>',
  'dbname' => 'nextcloud',
  'dbhost' => '10.27.0.40:3306',
  'dbport' => '',
  'dbtableprefix' => 'oc_',
  'mysql.utf8mb4' => true,
  'dbuser' => '<omitted for security>',
  'dbpassword' => '<omitted for security>',
  'installed' => true,
  'app_install_overwrite' => 
  array (
    0 => 'files_excludedirs',
  ),
  'default_phone_region' => 'GB',
  'maintenance' => false,
  'mail_smtpmode' => 'smtp',
  'mail_smtpsecure' => 'ssl',
  'mail_sendmailmode' => 'smtp',
  'mail_smtpauth' => 1,
  'mail_from_address' => 'No.Reply',
  'mail_domain' => '<omitted for security>',
  'mail_smtpauthtype' => 'LOGIN',
  'mail_smtphost' => '<omitted for security>',
  'mail_smtpport' => '465',
  'mail_smtpname' => '<omitted for security>',
  'mail_smtppassword' => '<omitted for security>',
  'preview_max_x' => null,
  'preview_max_y' => null,
  'jpeg_quality' => '60',
  'preview_max_scale_factor' => 1,
  'enabledPreviewProviders' => [
    'OC\Preview\MP3',
    'OC\Preview\TXT',
    'OC\Preview\MarkDown',
    'OC\Preview\OpenDocument',
    'OC\Preview\Krita',
    'OC\Preview\Imaginary',
  ],
  'preview_imaginary_url' => 'http://imaginary:9000',
);

The previewgenerator settings:

$ php /config/www/nextcloud/occ config:app:get previewgenerator squareSizes
64 256 1024
$ php /config/www/nextcloud/occ config:app:get previewgenerator widthSizes
64 256 1024
$ php /config/www/nextcloud/occ config:app:get previewgenerator heightSizes
64 256 1024

A sample of an original image:

The preview generated for both grid view and detailed view on the Files pane.

Another example of an original image:

The preview generated for both grid view and detailed view on the Files pane.

[st3iny]

I see, that you are persistent.

I'll try to reproduce it. However, I suspect this being either a bug in the server or the imaginary upstream.

[szaimen]

@janusn which Imaginary version are you running?

[szaimen]

Can you for a test check if it works with the nextcloud/aio-imaginary:latest image corrrectly?

[janusn]

@szaimen The version of imaginary is 1.2.4.

[szaimen]

Yeah, so to make it work correctly, it is required to build imaginary from master IIRC since no new release was pushed since two years. That is what we are doing with the nextcloud/aio-imaginary:latest image. Hence my question if you could test with that.

[janusn]

@szaimen Thanks for the pointer. I have replaced the container from the image h2non/imaginary:latest with the image nextcloud/aio-imaginary:latest. Unfortunately, it still produces strange distorted previews.

In fact, you can see the previews of the build-in stock photos generated from aio-imaginary are distorted, such as

• /[User]/files/Photos/Birdie.jpg
• /[User]/files/Photos/Frog.jpg
• /[User]/files/Photos/Gorilla.jpg
• /[User]/files/Photos/Toucan.jpg

but the previews of the following photos are correct:

• /[User]/files/Photos/Library.jpg
• /[User]/files/Photos/Nextcloud community.jpg
• /[User]/files/Photos/Vineyard.jpg

The version of the aio-imaginary:

$ imaginary --version
dev

[szaimen]

Right. Then maybe @CarlSchwan has an idea?

[st3iny]

On the other hand, the square preview images generated by web interface of Nextcloud are correctly. They respect the aspect ratios and letterboxed correctly.

I couldn't reproduce it. For me it's the exact other way around.

I only enabled the Imaginary provider to be able to isolate the issue. Both square previews generated by generate-all are fine. Square previews generated by the web interface are weird and look like your examples.

I'm currently investigating the server code to find a difference between both calls to the Preview API.

EDIT: I repeated the procedure multiple times and now all previews are broken. It seems that only the first previews ever generated are fine. After that, all previews are weird, even when I restart the Imaginary server.

[szaimen]

If I remember the discussion with Carl correctly, the maintainer of Imaginary submitted in the last moment a commit that broke something. Not sure if it is the same issue though. Probably it is then this: h2non/imaginary@234d1fe
https://github.com/nextcloud/server/search?q=X-Image-Width

[st3iny]

I tested some more and noticed that the previews are only broken if the source image is smaller than the actual preview.

E.g. Supplying an Image with 8000x6000 produces correct results. Supplying an image with 640x480 produces weird results because Nextcloud asks for a preview of 1024x1024.

[st3iny]

Bingo!

@szaimen This is correct. I added debugging code to Imaginary which dumps each generated image to a file and they are correct. It seems like our server does not parse the width and height values correctly and thus distorts the image.

This should be fixable by parsing both headers.