Skip to content

how to finetune #170

@xiangzhaoyu

Description

@xiangzhaoyu

hello, i read the colab and download the pretrain model from gs, i create my own data, and i add the code to datasets.py and tasks.py, but when i use the gin script to finetune the model, the error is that:
File "/root/miniconda3/envs/mt3/lib/python3.11/site-packages/t5x/checkpoints_utils.py", line 88, in get_step_from_checkpoint_dir
raise ValueError('Found improperly formatted checkpoint directory.')
ValueError: Found improperly formatted checkpoint directory.
In call to configurable 'train' (<function train at 0x7ff3449bc7c0>)

i guess because the gs pretrain model down flow the t5x train step, can you provide the suggest for me ? thank you !

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions