HowToSD-ComfyUI-Pt-Wrapper/docs/reference/ptv_hf_dataset_with_token_encode.md

Ptv Hf Dataset With Token Encode

A PyTorch Dataset class wrapper for a Hugging Face dataset that converts text to token IDs.

Args:  
    name (str): Name of the dataset class.  
    split (str): The name of the subset of dataset to retrieve or the split specifier.
    sample_field_name (str): Field name for text samples.
    label_field_name (str): Field name for labels.
    encode (PTCALLABLE): The reference to a token encoder function.

Input

Name	Data type
name	String
split	String
sample_field_name	String
label_field_name	String
encode	Ptcallable

Output

Data type
Ptvdataset

---

Category: PyTorch wrapper - Training

ComfyUI Pt Wrapper Node Reference. © 2025 Hide Inada (HowToSD.com). All rights reserved.