All content marked as "Failed" but is actually downloaded

[Sicofra]

Hi,

ive installed fresh scraper in VM, via UV with ffmpeg and using python 3.12.7
All content from model was actually downloaded on the drive, readable and playable in Video case, but its all marked as "Failed"
scrape.txt
About 21GB correctly present, but not sure what will happen on reapeated run.
Iam using manual CDM keys.

Here is a logfile from that session:

ofscraper_main_profile_2026-04-05_02.47.51.log

Is it only cosmetic or something is wrong?

[Puk0]

• In the scraper.txt file it says:
  FileNotFoundError: [WinError 2] The system cannot find the file specified:
  'Z:\ofscraper\nancycb08\Posts\Images\2208x2944_9020ffdeb4472d74d52436320420080b_3017194927_735353680.part'
  FAILED: 1419 overall

• In the log file it says:
  OSError: [WinError 1005] The volume does not contain a recognized file system.

• I imagine you're using Windows and saving the files on a "Z" drive that isn't formatted as NTFS/FAT32etc., or is damaged, or it disconnects

• When you rename it, since it doesn't save, it gives [WinError 2].

[Sicofra]

Thanks

For the windows VM, the Z: is attached as a drive and it is NTFS. To the Windows at least.

The VM itself runs in Unraid which does the frontend for QEMU virtialization and the actuall mounting in windows is done by virtiofs service that mounts the drive. The Real (Real) underlaying file sytem of this Z: is actually a BTRFS, but that should not be visible to the OS itself. That should see it as NTFS drive.

I was unsed on the windows installation so that what I tried.
But I guess I will give a whirl to the Docker one if there isnt something I could do to make it work.

I though of saving to C:, but the drives that it runs from are not that big enough to acomodate some of models libraries.

[datawhores]

You can use after_download script
I do this successfully on another machine

Since the other larger storage is a network drive

#!/usr/bin/env python3
import sys
import os
import shutil

def main():
    # Read the final_path from standard input
    final_path = sys.stdin.read().strip()

    # Define the old base path and the new base path
    old_base_path = "/home/user/Data/ofscraper/"
    new_base_path = "/mnt/new_storage/ofscraper/"

    print(f"Info: afterdownload script started for path: '{final_path}'", file=sys.stderr)

    # --- Step 1: Validate the input path ---
    if not final_path.startswith(old_base_path):
        print(f"Error: Path '{final_path}' does not start with expected base path '{old_base_path}'. No action taken.", file=sys.stderr)
        sys.exit(1) # Indicate an error to the calling process

    # --- Step 2: Check if the source file actually exists ---
    if not os.path.exists(final_path):
        print(f"Error: Source file '{final_path}' does not exist. Cannot move.", file=sys.stderr)
        sys.exit(1) # Indicate an error to the calling process
    
    if not os.path.isfile(final_path):
        print(f"Error: Source path '{final_path}' is not a regular file. Skipping move.", file=sys.stderr)
        sys.exit(1) # Indicate an error if it's not a file (e.g., a directory)


    # Calculate the sub_path and new final_path
    sub_path = final_path[len(old_base_path):]
    new_final_path = os.path.join(new_base_path, sub_path)
    new_directory = os.path.dirname(new_final_path)

    print(f"Info: Original path: '{final_path}'", file=sys.stderr)
    print(f"Info: Calculated new path: '{new_final_path}'", file=sys.stderr)
    print(f"Info: Target directory: '{new_directory}'", file=sys.stderr)

    # --- Step 3: Ensure parent directories exist ---
    try:
        if not os.path.exists(new_directory):
            print(f"Info: Creating target directory: '{new_directory}'...", file=sys.stderr)
        os.makedirs(new_directory, exist_ok=True)
        print(f"Info: Target directory '{new_directory}' is ready.", file=sys.stderr)
    except OSError as e:
        print(f"Error: Failed to create target directory '{new_directory}': {e}", file=sys.stderr)
        sys.exit(1) # Indicate an error

    # --- Step 4: Perform the move safely ---
    try:
        print(f"Info: Attempting to move '{final_path}' to '{new_final_path}'...", file=sys.stderr)
        shutil.move(final_path, new_final_path)
        print(f"Success: File moved successfully to '{new_final_path}'", file=sys.stderr)
        print(new_final_path) # Print the new path to stdout ONLY IF move is successful
    except shutil.Error as e:
        print(f"Error: Failed to move file from '{final_path}' to '{new_final_path}': {e}", file=sys.stderr)
        sys.exit(1)
    except Exception as e:
        print(f"Fatal Error: An unexpected error occurred during file move: {e}", file=sys.stderr)
        sys.exit(1)

if __name__ == "__main__":
    main()

[Bum211]

Hello, I'm having the same issue with scraping failing. I tried it on several models, and they are smaller creators, and I have plenty of storage. What should I do? I did save the downloads on an external hard drive. Will I need to format it in order for it to work? I'm not very familiar with code and would appreciate your help. Thank you!

[Puk0]

Hello

• What operating system do you have, Windows?

If you have Windows, and if the Control Panel > Devices. recognizes it, and it lets you save any file from the internet and then play/open them, you don't need to do anything.

• Otherwise, check that you entered the path correctly in config.json

[Bum211]

Hi, I have Windows, followed our steps, and it does recognize my external hard drive. I also checked Config.json, and the path is correct. I also checked the downloaded folder, and I saw that scraping was only the profile picture and banner; everything else had failed.

[Sicofra]

You can use after_download script I do this successfully on another machine

Since the other larger storage is a network drive

#!/usr/bin/env python3
import sys
import os
import shutil

def main():
    # Read the final_path from standard input
    final_path = sys.stdin.read().strip()

    # Define the old base path and the new base path
    old_base_path = "/home/user/Data/ofscraper/"
    new_base_path = "/mnt/new_storage/ofscraper/"

    print(f"Info: afterdownload script started for path: '{final_path}'", file=sys.stderr)

    # --- Step 1: Validate the input path ---
    if not final_path.startswith(old_base_path):
        print(f"Error: Path '{final_path}' does not start with expected base path '{old_base_path}'. No action taken.", file=sys.stderr)
        sys.exit(1) # Indicate an error to the calling process

    # --- Step 2: Check if the source file actually exists ---
    if not os.path.exists(final_path):
        print(f"Error: Source file '{final_path}' does not exist. Cannot move.", file=sys.stderr)
        sys.exit(1) # Indicate an error to the calling process
    
    if not os.path.isfile(final_path):
        print(f"Error: Source path '{final_path}' is not a regular file. Skipping move.", file=sys.stderr)
        sys.exit(1) # Indicate an error if it's not a file (e.g., a directory)


    # Calculate the sub_path and new final_path
    sub_path = final_path[len(old_base_path):]
    new_final_path = os.path.join(new_base_path, sub_path)
    new_directory = os.path.dirname(new_final_path)

    print(f"Info: Original path: '{final_path}'", file=sys.stderr)
    print(f"Info: Calculated new path: '{new_final_path}'", file=sys.stderr)
    print(f"Info: Target directory: '{new_directory}'", file=sys.stderr)

    # --- Step 3: Ensure parent directories exist ---
    try:
        if not os.path.exists(new_directory):
            print(f"Info: Creating target directory: '{new_directory}'...", file=sys.stderr)
        os.makedirs(new_directory, exist_ok=True)
        print(f"Info: Target directory '{new_directory}' is ready.", file=sys.stderr)
    except OSError as e:
        print(f"Error: Failed to create target directory '{new_directory}': {e}", file=sys.stderr)
        sys.exit(1) # Indicate an error

    # --- Step 4: Perform the move safely ---
    try:
        print(f"Info: Attempting to move '{final_path}' to '{new_final_path}'...", file=sys.stderr)
        shutil.move(final_path, new_final_path)
        print(f"Success: File moved successfully to '{new_final_path}'", file=sys.stderr)
        print(new_final_path) # Print the new path to stdout ONLY IF move is successful
    except shutil.Error as e:
        print(f"Error: Failed to move file from '{final_path}' to '{new_final_path}': {e}", file=sys.stderr)
        sys.exit(1)
    except Exception as e:
        print(f"Fatal Error: An unexpected error occurred during file move: {e}", file=sys.stderr)
        sys.exit(1)

if __name__ == "__main__":
    main()

Thanks
The larger storage is technically an internal drive for the VM. Virtiofs makes it so as the drives are in the same NAS, you dont have to go through a network interface but can utilize internal storage speeds.

Would the Afterdownload script run in the existing Win VM?
My scripting skills are... meh.. I understand it move the files, do I understand it that the Step 2 prevent repetive scraping on already downloaded?
Thanks

[datawhores]

Yeah I don't have much experience with low level system calls, I'm reading that resolve might breaking
Since the script doesn't use that call directly it might help in that way

[Bum211]

My File system said: exFAT. Is this right? I have not changed anything, and every scrape came back as failed just 2 days ago. I am on Windows, and I'm on the latest commit. Any help is appreciated.

[Bum211]

Hello, coming back to this issue. I haven't been able to download anything. The script works fine but as it is scrapping, it just marked "failed" for all models, new or old. Any kind soul knows a fix or can help please?