my tildelog

a blog about tildes

Fixing ld-decode on Arch Linux (2023.04)

April 18, 2023 — ~rawktucc

Apparently, recent versions of python-numba do not support python-numpy 1.24 yet. This is specific for Arch and NixOS (and possibly other more up-to-date systems).

Since the ld-decode project only targets Ubuntu 22.04 (and obviously for stability/good reason), I’m on my own here.

I tried the PKGBUILD and patches in the Arch Linux bug for the numba package, but was not able to build them successfully.

Instead, I built python-numba-git and python-numpy-git from the AUR. At least this keeps things a bit more organized and easier for me to track.

python-numba-git, however, requires python-llvmlite >= 0.40.0. The AUR package commentary notes to build python-llvmlite-git, however despite this targeting the latest git for llvmlite, it still builds 0.39.1:

ImportError: Numba requires at least version 0.40.0 of llvmlite. Installed version is 0.39.1. Please update llvmlite.

So the solution here, per a comment found here, is to install a specific llvmlite target through pip;

pip install llvmlite==0.40.0rc1

This is… obviously messy, but it works.

TLDR

  1. sudo pacman -R python-numba python-numpy
  2. pip uninstall numba
  3. pip uninstall numpy
  4. pip uninstall llvmlite
  5. yay -S --aur python-numba-git python-numpy-git
  6. pip install llvmlite=0.40.0rc1

The pip uninstall commands may fail if you don’t have those packages installed, but we run them anyway to ensure we remove any possible conflicts.

The other solution to make it less messy, might be to install llvmlite to a virtualenv - you could also attempt this with numpy and numba as well; I need to test this.

tags: ld-decode, DomesdayDuplicator, git, linux

Using dvgrab to archive miniDV tapes and more, with Arch Linux

November 22, 2022 — ~rawktucc

This is a simple guide on how to setup dvgrab on Arch Linux, to allow capturing of MiniDV+ tapes (and others using the DV format) over Firewire. This is considered a “lossless” capture, as the DV stored on the tape is put to PC as-is, as it’s simply a digital format.

This means however, that if the DV tape is degraded, older, or noticeably damaged somehow, the output may be missing data, or have inconsistent playback. You’ll notice this with dvgrab throwing errors; with the video having visual bars on screen; the audio having glitches; and both having inconsistencies and discontinuities in playback (skipping/missing parts).

  1. Setup an Arch Linux bootable USB. Unfortunately I won’t cover this in the guide, it’s different for every system (Legacy vs UEFI boot for example).

    1. I recommend writing to a USB drive that uses USB 3.0. Your write speeds won’t be spectacular, but read speeds will be excellent for booting.
    2. Note this guide is only focused on Arch Linux, and not derivatives like Manjaro.
  2. Boot into the Arch installation live session.

    1. You may wish to choose “Copy to RAM”, as this will free up a USB port, as well as making operation much faster.
      1. It takes slightly longer to boot, depending on the read speed of your USB.
  3. Once booted full, you’ll be dropped to the root terminal prompt.

    1. You may wish to connect over SSH. The SSH daemon should be running by default, use your preferred application or ssh client to connect (putty, ssh, mosh, etc)
    1. OPTIONAL: At the terminal prompt, type “tmux” and hit enter.
    2. tmux is a “terminal multiplexer”, allowing multiple shell sessions in one contained window.
    3. It also allows recovery of “reconnecting” to a terminal window if somehow you lose connection (if you are connecting to the system over SSH for example)
    4. tmux uses a “control” shortcut scheme to activate tmux commands. The standard command is pressing the LEFT CTRL + B button, then pressing another key as a means of entering a command.
      1. The most used would be LEFT CTRL + b, then c (lowercase), to create a new terminal shell.
      2. Next most used would be LEFT CTRL + b, then “ (double quotes, shift+ ‘” button) to split the window into two. You then use the control command and the ARROW KEYS to switch between windows
  4. Ensure you are connected to the internet. If you are using a laptop, please use the following command to connect to a wireless network:

    1. iwctl
    2. Follow on-screen help to connect. Otherwise, please use a wired ethernet connection
  5. Once connected to the internet, run the following command:

    1. pacman -Syy dvgrab libforensic1394 libraw1394 libavc1394 libdc1394
    2. the above command does the following:
      1. pacman is the package manager
      2. -Syy means “Install + update local package repo information + forcefully update local repo information”
      3. The text following that are the packages to install, in this case: dvgrab, the main tool; and libraries for interfacing with Firewire tools/devices. Not all are truly necessary, but better safe than errored out ☺
  6. Once the install completes successfully, connect your device to a firewire connection on your system, if you haven’t already.
  7. Prepare your tape in your MiniDV/DV playback device. Ensure it’s rewound completely to the start, or to where your timecode starts.
  8. Before starting capture, determine where the captured files will be stored. If you have an external USB device you want to store them on, mount the device:

    1. Enter the command “lsblk” (no quotes), hit enter
    2. Before plugging in the USB device, confirm it’s formatted as NTFS or exFAT, and NOT FAT32. FAT32 does not support files larger than 4GB, and dvgrab is best run by capturing to a single file, versus splitting into 4GB chunks.
    3. Plug in the NTFS or exFAT formatted USB drive.
    4. Run “lsblk” again and look for a new device that should have appeared; it should be sdX where X is the letter assigned. Check the size of the drive matches your plugged in USB device
    5. Once properly identified, mount your USB device, replacing X with the appropriate letter:
      1. mount /dev/sdX /mnt
      2. If you get an error, your device is encrypted, or using some special format, you’re on your own here (or email me ☺ )
    1. Alternatively, follow the above steps in using lsblk, except simply look for the approprate internal HDD/SSD you want to mount and store the data on.
  9. Once your storage point is available and ready, your tape rewound to start/desired timecode, the DV playback device connected, and your computer available, RUN DVGRAB! :D
    1. dvgrab -csize 0 -size 0 -showstatus -timestamp -timesys -f raw Filename_.dv
    2. The above command broken down:
      1. -csize 0: Don’t split the file
      2. -size 0: Don’t set any sort of filesize limit
      3. -showstatus: show the current status of the dvgrab process, frame by frame. Good for seeing any errors pop up
      4. -timestamp: adds timestamp from tape timecode to the filename, and to the internal dv header
      5. -timesys: adds system time to the filename
      6. -f raw: grabs the raw stream from the tape, most important flag

Enjoy your digitized tapes!

tags: digitization, dvgrab, dvtapes, minidv, archive-stuff, arch

USB Review: Kingston DTX/64GB

November 13, 2022 — ~rawktucc

I recently purchased some new USB drives as my existing ones are USB 2.0 only.
Here’s some testing I did for the other one of them, the Kingston Exodia USB 3.2 (DTX), 64GB model.

Specifications

  • Part Number: DTX/64GB
  • Dimensions (L x W x H): 67.3mm x 21.04mm x 10.14mm
  • Weight: 11g
  • Interface: USB 3.2 Gen 1
  • Performance: Not listed on the product page
  • Warranty: 5-year limited
  • Local purchase price: $5.99 or $12.99 CDN (+13% HST tax)

read more...

USB Review: ADATA UV350/32GB

October 02, 2021 — ~rawktucc

I recently purchased some new USB drives as my existing ones are USB 2.0 only.
Here’s some testing I did for one of them, the ADATA UV350, 32GB model.

Specifications

  • Part Number: AUV350-32G-RBK
  • Dimensions (L x W x H): 42.4 x 14.95 x 5.35mm / 1.7 x 0.6 x 0.2"
  • Weight: 5.9g / 0.2oz
  • Interface: USB 3.2 Gen1 ( backward compatible with USB 2.0 )
  • Performance: Up to 90MB/s (Read); 40MB/s (Write)
  • Warranty: 5-year limited
  • Local purchase price: $9.99 CDN (+13% HST tax)

read more...

Don’t trust ExFAT with your data

August 11, 2021 — ~rawktucc

I have a couple personal anecdotes on why you shouldn’t trust ExFAT as the filesystem for your valuable files. Let’s say you have a drive to share some personal files with family and friends. The files are large, and the recipients all use different systems, so ExFAT is the best choice because:

read more...

First blog post

February 06, 2021 — ~rawktucc

Blag blag blagging, i’m glabbing on tilde.team!

tags: post-one