#+TITLE: Exiftool
#+SUBTITLE: Snippets for everyday photo/video metadata editing
#+DESCRIPTION:
#+KEYWORDS: exiftool
# Export underscore as underscore instead of highlight in HTML:
#+OPTIONS: ^:nil
# Include usable macros from https://github.com/fniessen/org-macros:
#+INCLUDE: ../org-mode/macros/org-macros.setup
#+INFOJS_OPT: view:showall ltoc:nil path:https://iki.fi/~pyyhttu/debian/org-mode/js/org-info.js
#+HTML_HEAD: <link rel="stylesheet" type="text/css" href="https://pyyhttu.kapsi.fi/debian/org-mode/css/org.css"/>
* Exiftool

** Installation on Kapsi shared hosting

As per [[https://exiftool.org/install.html#Unix][Exitool unix instructions]]:

~$ wget https://exiftool.org/Image-ExifTool-12.25.tar.gz~

~$ tar xvf Image-ExifTool-12.25.tar.gz~

~$ cd Image-ExifTool-12.21~

~$ perl Makefile.PL~

~$ make test~

~$ mv exiftool lib/ ~/bin/~

Note: If above is not done after version upgrade, a warning is displayed:

#+BEGIN_SRC bash
~$ exiftool -ver
12.25 [Warning: Library version is 12.21]
#+END_SRC

Finally, make sure that =~/.profile= has:

#+BEGIN_SRC bash
if [ -d "$HOME/bin" ] ; then
     PATH="$HOME/bin:$PATH"
fi
#+END_SRC

Then logout and ssh back in for =~/.profile= changes to take effect. Exiftool is installed:

#+BEGIN_SRC bash
$ type exiftool
exiftool is /home/users/pyyhttu/bin/exiftool
#+END_SRC

** NEXT Upgrading on Kapsi shared hosting

** Installation on debian instance with su access

~$ sudo aptitude install libimage-exiftool-perl~

** Overview of mass tagging and organizing photos

To achieve with minimal amount of work a tagged and organized file structure.

1. Move photos to one =Upload= directory. Doesn't matter if photos are scattered around in subdirectories in it.

2. Update with Exiftool =FileModifyDate= using =CreateDate= that has it:\\
 ~$ exiftool -m -r '-FileModifyDate<CreateDate' -overwrite_original Upload/~

 #+BEGIN_SRC bash
 $ exiftool -m -r '-FileModifyDate<CreateDate' -overwrite_original Upload/
   10 directories scanned
   19 image files updated
 #+END_SRC

Those that don't, are reported with =Warning: No writable tags set=, and can be left behind for the second run.

3. [@3] Rename with Exiftool every photo based on their =CreateDate= tag:\\
 ~$ exiftool -m -r -ext jpg -ext jpeg -ext png -ext bmp -ext eps -ext nef
 -ext heic '-filename<${createdate}_$filename' -d 'Photo_%Y-%m-%d' Upload/ &&
 exiftool -m -r -ext mov -ext mp4 -ext wmv -ext avi -ext wmv -ext m2ts '-filename<${createdate}_$filename' -d 'Video_%Y-%m-%d' Upload/~

#+BEGIN_SRC bash
$ exiftool -m -r -ext jpg -ext jpeg -ext png -ext bmp -ext eps
'-filename<${createdate}_$filename' -d 'Photo_%Y-%m-%d' Upload/ && exiftool -m -r -ext mov -ext mp4 -ext wmv -ext avi -ext wmv
'-filename<${createdate}_$filename' -d 'Video_%Y-%m-%d' Upload/
   10 directories scanned
   19 image files updated
   10 directories scanned
    0 image files read
#+END_SRC

4. [@4] Move with Exiftool every photo to their respective year and month directories:\\
 ~$ exiftool -m -r '-Directory<CreateDate' -d %Y/%m Upload/~

#+BEGIN_SRC bash
$ exiftool -m -r '-Directory<CreateDate' -d %Y/%m Upload/
Error: '2022/06/Photo_2022-06-05_DSC_0001.JPG' already exists - Upload/2021/02/Photo_2022-06-05_DSC_0001.JPG
   10 directories scanned
    2 directories created
   18 image files updated
    1 files weren't updated due to errors
#+END_SRC

*Note:* If the command does not move images, it is an indication there are
duplicates in the destination, and exiftool refuses to overwrite them.

5. [@5] For second pass, run update in =Upload= directory for those that weren't updated with =CreateDate= but use =DateTimeOriginal=:\\
 ~$ exiftool -m -r '-FileModifyDate<DateTimeOriginal' -overwrite_original Upload/~
6. [@6] Rename based on =DateTimeOriginal=:\\
 ~$ exiftool -m -r -ext jpg -ext jpeg -ext png -ext bmp -ext eps -ext nef
 -ext heic '-filename<${datetimeoriginal}_$filename' -d 'Photo_%Y-%m-%d'
 Upload/ && exiftool -m -r -ext mov -ext mp4 -ext wmv -ext avi -ext wmv -ext
 m2ts '-filename<${datetimeoriginal}_$filename' -d 'Video_%Y-%m-%d' Upload/~
7. [@7] Move based on =DateTimeOriginal=\\
 ~$ exiftool -m -r '-Directory<DateTimeOriginal' -d %Y/%m Upload/~

- If no hits (xxx image files unchanged), then run third run and create =CreateDate= from =FileModifyDate=:\\
 ~$ exiftool -m -r '-CreateDate<FileModifyDate' -overwrite_original Upload/ && exiftool -m -r '-FileModifyDate<CreateDate' -overwrite_original Upload/~

8. [@8] Rerun steps 3. (Rename) and 4 (Move).

9. [@9] Finally, while working in =__groupfolders/2/Photos/=, merge all year 2000 directories to their correct place:\\
~$ cp -r --interactive --preserve=all 20* ~/siilo/sites/pyyhttu-siilo.kapsi.fi/www/nextcloud/data/Heidi/files/Photos/~

** Single file usage
*** List all time metadata

~$ exiftool -time:all -a -G0:1 image.jpg~

*** Check tag names on a file

~$ exiftool -s FILE~

*** Change single tag's value

~$ exiftool -exif:dateTimeOriginal='2017:12:22 12:00:01' -overwrite_original IMG_6446.JPG~

Or, if a e.g. an mp4 file then:

~$ exiftool -all:CreateDate='2019:07:28 15:00:01' -overwrite_original Ropecon-2019.mp4~

*** Rename a file

~$ exiftool '-filename<${datetimeoriginal}_$filename' -d 'Video_%Y-%m-%d' FILE~

** Mass tagging in detail

*** NEXT Bring =FileModifyDate= in sync with =CreateDate=, inspect images have this

This is done, because Nextcloud photos sorts pictures per file's modification
time stamp --> I get pictures displayed in correct timeline.

*** NEXT =DateTimeOriginal= as master instead of =CreateDate=?
Instead of =DateTimeOriginal=, I consider =CreateDate= to be the
master, as it's more common among video files. Additional difference between
them two [[https://exiftool.org/forum/index.php?topic=2451.0][here]].

~$ exiftool -m -r '-FileModifyDate<CreateDate' -overwrite_original 2018/~

However, since =DateTimeOriginal= is considered as master by dupeGuru (see
[[https://dupeguru.voltaicideas.net/help/en/scan.html#exif-timestamp][this]]),
then make sure you also copy =CreateDate= to =DateTimeOriginal=.

*Note:* Not every file type is writable, e.g. =.wmv=. See
[[https://exiftool.org/#supported][supported files types]].

*** Verify tagging

Result per directory (=2018= in this case) is something along the lines =156 image files updated=.
Verify that number matches with output of ~ls 2018/ | wc -l~.

** Mass renaming in detail

*** Rename images from their original =DSC05240.jpg= to =Photo_2018-12-24_DSC05240.jpg=

~$ exiftool -r '-filename<${createdate}_$filename' -d 'Photo_%Y-%m-%d' Upload/~

*** Rename also .avi videos in addition to writable files to =Video_2018-12-24_DSC05240.AVI=

~$ exiftool -r -ext+ AVI '-filename<${datetimeoriginal}_$filename' -d 'Video_%Y-%m-%d' 2018/~

*** Rename only .avi videos to =Video_2018-12-24_DSC05240.AVI=

~$ exiftool -r -ext AVI '-filename<${datetimeoriginal}_$filename' -d 'Video_%Y-%m-%d' 2018/~

*** Rename with ~vimv~

Install with:

~$ curl https://raw.githubusercontent.com/thameera/vimv/master/vimv > ~/.local/bin/vimv && chmod +755 ~/.local/bin/vimv~

~$ vimv Photo_2014-03-04-*.mov~

Changing extension to =MOV= in vim:
1. Visual select =mov= {{{kbd(ctrl-v)}}}
2. Press on selection {{{kbd(shift-c)}}}
3. Type =MOV=, press {{{kbd(esc)}}}
4. Save and exit {{{kbd(:wq)}}}

** Moving

*** Move images and =.AVI= files from directory =2018/= into a directory structure of =2018/01/=, =2018/02/=, etc.

As per: https://exiftool.org/faq.html#Q16.

~$ exiftool -r -ext+ AVI '-Directory<CreateDate' -d %Y/%m Upload/~

*** Merge all directories from current directory to their place

~$ cp -r preserve=all * ../~

** Finding
*** Find from a directory Pictures all =Thumbs.db= and remove them
~$ find "Pictures/" -name Thumbs.db -exec rm -rf '{}' +~

*** Find directories that are empty

~$ find "/home/pyyhttu/temp/Pics/Yhtfilet/" -type d -exec bash -c 'shopt -s nullglob; shopt -s dotglob; files=("$1"/*); [[ ${files[@]} ]] || echo "$1"' -- {} \;~~

*** Find and remove directories that are empty

~$ find "/home/pyyhttu/temp/Pics/Yhtfilet/" -type d -exec bash -c 'shopt -s nullglob; shopt -s dotglob; files=("$1"/*); [[ ${files[@]} ]] || rmdir -v "$1"' -- {} \;~

For more information on finding and removing, see [[https://unix.stackexchange.com/questions/46322/how-can-i-recursively-delete-empty-directories-in-my-home-directory][stackexchange post]].

*** NEXT Find and delete duplicates
- Exiftool [[https://exiftool.org/forum/index.php?topic=11015.0][isn't really indented to find duplicates.]]
- Also, comparing duplicates from a cmd line output and to make an informed
  decision without *seeing* the deleted image, isn't effective.
- Much better way is to install dedicated tool for duplicates, e.g.
  [[https://blog.desdelinux.net/en/dupeguru-removes-duplicate-files/][dupeGuru]]
  on a user's laptop and operate it in tandem with [[https://nextcloud.com/install/#][Nextcloud Desktop sync client]].
- Then the user can point dupeGuru to scan one's Nextcloud photo directory
  residing on local filesystem, delete the duplicates, and synchronize
  changes (deletions) back to Nextcloud server side (master).

** Tips

*** Subtract one year in date from all images (with date/time otherwise preserved):
~$ exiftool -alldates-='1:0:0 0' *.jpg~

*** Add one year in date on all images (with date/time otherwise preserved):
~$ exiftool -alldates+='1:0:0 0'~

*** Convert all Sony raw image files to high quality jpegs in a directory:
~$ ufraw-batch *.ARW --out-type=jpeg --compression=99~

*** Erase duplicates from whatsapp messages inside family, use either fdupes or FSlint