🖼️ Loading...
    Do you know of an open source implementation of an async inference DataLoader? The job is simple: given a huge dataset and time limited SLURM jobs and a varying over time number of nodes - run inference on that dataset. Of course, the puzzle is how to: - dole out chunks of data
    Prompt

    Do you know of an open source implementation of an async inference DataLoader? The job is simple: given a huge dataset and time limited SLURM jobs and a varying over time number of nodes - run inference on that dataset. Of course, the puzzle is how to: - dole out chunks of data

    Info
    Image
    Likes
    3,660
    Created
    7/19/2024
    Source
    CivitAI
    Actions