IDEA-Research_ChatRex-7B

Get this model

Seeders: — · Leechers: —

—

Model card

The complete upstream card, rendered from this payload's README.md — the same hash-verified bytes the torrent distributes. Images and off-site links are removed; the original card on Hugging Face carries them.

language:

en base_model:
lmsys/vicuna-7b-v1.5
openai/clip-vit-large-patch14
laion/CLIP-convnext_large_d.laion2B-s26B-b102K-augreg pipeline_tag: image-text-to-text tags:
chatrex
upn

arxiv.org/abs/2411.18363

1. Introduction 📚

TL;DR: ChatRex is an MLLM skilled in perception that can respond to questions while simultaneously grounding its answers to the referenced objects.

ChatRex is a Multimodal Large Language Model (MLLM) designed to seamlessly integrate fine-grained object perception and robust language understanding. By adopting a decoupled architecture with a retrieval-based approach for object detection and leveraging high-resolution visual inputs, ChatRex addresses key challenges in perception tasks. It is powered by the Rexverse-2M dataset with diverse image-region-text annotations. ChatRex can be applied to various scenarios requiring fine-grained perception, such as object detection, grounded conversation, grounded image captioning and region understanding.

2. Installation 🛠️

conda install -n chatrex python=3.9
pip install torch==2.1.2 torchvision==0.16.2 --index-url https://download.pytorch.org/whl/cu121
git clone https://github.com/IDEA-Research/ChatRex.git
cd ChatRex
pip install -v -e .
# install deformable attention for universal proposal network
cd chatrex/upn/ops
pip install -v -e .

2.1 Download Pre-trained UPN Models

We provide model checkpoints for both the Universal Proposal Network (UPN) and the ChatRex model. You can download the pre-trained models from the following links:

UPN Checkpoint
ChatRex-7B Checkpoint

Or you can also using the following command to download the pre-trained models:

mkdir checkpoints
mkdir checkpoints/upn
# download UPN checkpoint
wget -O checkpoints/upn/upn_large.pth https://github.com/IDEA-Research/ChatRex/releases/download/upn-large/upn_large.pth

2.2 Verify Installation

To verify the installation of the Universal Proposal Network (UPN), run the following command:

python tests/test_upn_install.py

If the installation is successful, you will get two visualization images of both fine-grained proposal and coarse-grained proposal in tests folder.

To verify the installation of the ChatRex model, run the following command:

python tests/test_chatrex_install.py

If the installation is successful, you will get an output like this:

prediction: <obj0> shows a brown dog lying on a bed. The dog is resting comfortably, possibly sleeping, and is positioned on the left side of the bed

3. Usage 🚀

3.1 Use UPN for Object Proposal Generation

Universal Proposal Network (UPN) is a robust object proposal model designed as part of ChatRex to enable comprehensive and accurate object detection across diverse granularities and domains. Built upon T-Rex2, UPN is a DETR-based model with a dual-granularity prompt tuning strategy, combining fine-grained (e.g., part-level) and coarse-grained (e.g., instance-level) detection.

Example Code for UPN

import torch
from PIL import Image
from tools.visualize import plot_boxes_to_image
from chatrex.upn import UPNWrapper

ckpt_path = "checkpoints/upn_checkpoints/upn_large.pth"
test_image_path = "tests/images/test_upn.jpeg"

model = UPNWrapper(ckpt_path)
# fine-grained prompt
fine_grained_proposals = model.inference(
    test_image_path, prompt_type="fine_grained_prompt"
)
# filter by score (default: 0.3) and nms (default: 0.8)
fine_grained_filtered_proposals = model.filter(
    fine_grained_proposals, min_score=0.3, nms_value=0.8
)
## output is a dict with keys: "original_xyxy_boxes", "scores"
## - "original_xyxy_boxes": list of boxes in xyxy format in shape (B, N, 4)
## - "scores": list of scores for each box in shape (B, N)

# coarse-grained prompt
coarse_grained_proposals = model.inference(
    test_image_path, prompt_type="coarse_grained_prompt"
)
coarse_grained_filtered_proposals = model.filter(
    coarse_grained_proposals, min_score=0.3, nms_value=0.8
)

## output is a dict with keys: "original_xyxy_boxes", "scores"
## - "original_xyxy_boxes": list of boxes in xyxy format in shape (B, N, 4)
## - "scores": list of scores for each box in shape (B, N)

We also provide a visualization tool to visualize the object proposals generated by UPN. You can use the following code to visualize the object proposals:

Example Code for UPN Visualization


from chatrex.tools.visualize import plot_boxes_to_image
image = Image.open(test_image_path)
fine_grained_vis_image, _ = plot_boxes_to_image(
    image.copy(),
    fine_grained_filtered_proposals["original_xyxy_boxes"][0],
    fine_grained_filtered_proposals["scores"][0],
)
fine_grained_vis_image.save("tests/test_image_fine_grained.jpeg")
print(f"fine-grained proposal is saved at tests/test_image_fine_grained.jpeg")

coarse_grained_vis_image, _ = plot_boxes_to_image(
    image.copy(),
    coarse_grained_filtered_proposals["original_xyxy_boxes"][0],
    coarse_grained_filtered_proposals["scores"][0],
)
coarse_grained_vis_image.save("tests/test_image_coarse_grained.jpeg")
print(f"coarse-grained proposal is saved at tests/test_image_coarse_grained.jpeg")

3.2 Usage of ChatRex

ChatRex takes three inputs: image, text prompt, and box input. For the box input, you can either use the object proposals generated by UPN or provide your own box input (user drawn boxes). We have wrapped the ChatRex model to huggingface transformers format for easy usage. ChatRex can be used for various tasks and we provide example code for each task below.

3.2.1 ChatRex for Object Detection & Grounding & Referring

Example Prompt for detection, grounding, referring tasks:

# Single Object Detection
Please detect dog in this image. Answer the question with object indexes.
Please detect the man in yellow shirt in this image. Answer the question with object indexes.

# multiple object detection, use ; to separate the objects
Please detect person; pigeon in this image. Answer the question with object indexes.
Please detect person in the car; cat below the table in this image. Answer the question with object indexes.

Example Code

import torch
from PIL import Image
from transformers import AutoModelForCausalLM, AutoProcessor, GenerationConfig

from chatrex.tools.visualize import visualize_chatrex_output
from chatrex.upn import UPNWrapper

if __name__ == "__main__":
    # load the processor
    processor = AutoProcessor.from_pretrained(
        "IDEA-Research/ChatRex-7B",
        trust_remote_code=True,
        device_map="cuda",
    )

    print(f"loading chatrex model...")
    # load chatrex model
    model = AutoModelForCausalLM.from_pretrained(
        "IDEA-Research/ChatRex-7B",
        trust_remote_code=True,
        use_safetensors=True,
    ).to("cuda")

    # load upn model
    print(f"loading upn model...")
    ckpt_path = "checkpoints/upn_checkpoints/upn_large.pth"
    model_upn = UPNWrapper(ckpt_path)
    test_image_path = "tests/images/test_chatrex_detection.jpg"

    # get upn predictions
    fine_grained_proposals = model_upn.inference(
        test_image_path, prompt_type="fine_grained_prompt"
    )
    fine_grained_filtered_proposals = model_upn.filter(
        fine_grained_proposals, min_score=0.3, nms_value=0.8
    )

    inputs = processor.process(
        image=Image.open(test_image_path),
        question="Please detect person; pigeon in this image. Answer the question with object indexes.",
        bbox=fine_grained_filtered_proposals["original_xyxy_boxes"][
            0
        ],  # box in xyxy format
    )

    inputs = {k: v.to("cuda") for k, v in inputs.items()}

    # perform inference
    gen_config = GenerationConfig(
        max_new_tokens=512,
        do_sample=False,
        eos_token_id=processor.tokenizer.eos_token_id,
        pad_token_id=(
            processor.tokenizer.pad_token_id
            if processor.tokenizer.pad_token_id is not None
            else processor.tokenizer.eos_token_id
        ),
    )
    with torch.autocast(device_type="cuda", enabled=True, dtype=torch.bfloat16):
        prediction = model.generate(
            inputs, gen_config=gen_config, tokenizer=processor.tokenizer
        )
    print(f"prediction:", prediction)

    # visualize the prediction
    vis_image = visualize_chatrex_output(
        Image.open(test_image_path),
        fine_grained_filtered_proposals["original_xyxy_boxes"][0],
        prediction,
        font_size=15,
        draw_width=5,
    )
    vis_image.save("tests/test_chatrex_detection.jpeg")
    print(f"prediction is saved at tests/test_chatrex_detection.jpeg")

The output from LLM is like:

<ground>person</ground><objects><obj10><obj14><obj15><obj27><obj28><obj32><obj33><obj35><obj38><obj47><obj50></objects>
<ground>pigeon</ground><objects><obj0><obj1><obj2><obj3><obj4><obj5><obj6><obj7><obj8><obj9><obj11><obj12><obj13><obj16><obj17><obj18><obj19><obj20><obj21><obj22><obj23><obj24><obj25><obj26><obj29><obj31><obj37><obj39><obj40><obj41><obj44><obj49></objects>

The visualization of the output is like:

3.2.2 ChatRex for Region Caption

Example Prompt for Region Caption tasks:

# Single Object Detection
## caption in category name
What is the category name of <obji>? Answer the question with its category name in free format.

## caption in short phrase
Can you provide me with a short phrase to describe <obji>? Answer the question with a short phrase.

## caption in referring style
Can you provide me with a brief description of <obji>? Answer the question with brief description.

## caption in one sentence
Can you provide me with a one sentence of <obji>? Answer the question with one sentence description.

# multiple object detection, use ; to separate the objects

Example Code

import torch
from PIL import Image
from transformers import AutoModelForCausalLM, AutoProcessor, GenerationConfig

from chatrex.tools.visualize import visualize_chatrex_output
from chatrex.upn import UPNWrapper

if __name__ == "__main__":
    # load the processor
    processor = AutoProcessor.from_pretrained(
        "IDEA-Research/ChatRex-7B",
        trust_remote_code=True,
        device_map="cuda",
    )

    print(f"loading chatrex model...")
    # load chatrex model
    model = AutoModelForCausalLM.from_pretrained(
        "IDEA-Research/ChatRex-7B",
        trust_remote_code=True,
        use_safetensors=True,
    ).to("cuda")

    test_image_path = "tests/images/test_chatrex_install.jpg"

    inputs = processor.process(
        image=Image.open(test_image_path),
        question="Can you provide a one sentence description of <obj0> in the image? Answer the question with a one sentence description.",
        bbox=[[73.88417, 56.62228, 227.69223, 216.34338]],
    )

    inputs = {k: v.to("cuda") for k, v in inputs.items()}

    # perform inference
    gen_config = GenerationConfig(
        max_new_tokens=512,
        do_sample=False,
        eos_token_id=processor.tokenizer.eos_token_id,
        pad_token_id=(
            processor.tokenizer.pad_token_id
            if processor.tokenizer.pad_token_id is not None
            else processor.tokenizer.eos_token_id
        ),
    )
    with torch.autocast(device_type="cuda", enabled=True, dtype=torch.bfloat16):
        prediction = model.generate(
            inputs, gen_config=gen_config, tokenizer=processor.tokenizer
        )
    print(f"prediction:", prediction)

    # visualize the prediction
    vis_image = visualize_chatrex_output(
        Image.open(test_image_path),
        [[73.88417, 56.62228, 227.69223, 216.34338]],
        prediction,
        font_size=15,
        draw_width=5,
    )
    vis_image.save("tests/test_chatrex_region_caption.jpeg")
    print(f"prediction is saved at tests/test_chatrex_region_caption.jpeg")

The output from LLM is like:

<ground>A brown dog is lying on a bed, appearing relaxed and comfortable</ground><objects><obj0></objects>

The visualization of the output is like:

3.2.3 ChatRex for Grounded Image Captioning

Example Prompt for Region Caption tasks:

# Brief Grounded Imager Caption
Please breifly describe this image in one sentence and detect all the mentioned objects. Answer the question with grounded answer.

# Detailed Grounded Image Caption
Please provide a detailed description of the image and detect all the mentioned objects. Answer the question with grounded object indexes.

Example Code

import torch
from PIL import Image
from transformers import AutoModelForCausalLM, AutoProcessor, GenerationConfig

from chatrex.tools.visualize import visualize_chatrex_output
from chatrex.upn import UPNWrapper

if __name__ == "__main__":
    # load the processor
    processor = AutoProcessor.from_pretrained(
        "IDEA-Research/ChatRex-7B",
        trust_remote_code=True,
        device_map="cuda",
    )

    print(f"loading chatrex model...")
    # load chatrex model
    model = AutoModelForCausalLM.from_pretrained(
        "IDEA-Research/ChatRex-7B",
        trust_remote_code=True,
        use_safetensors=True,
    ).to("cuda")

    # load upn model
    print(f"loading upn model...")
    ckpt_path = "checkpoints/upn_checkpoints/upn_large.pth"
    model_upn = UPNWrapper(ckpt_path)
    test_image_path = "tests/images/test_chatrex_grounded_caption.jpg"

    # get upn predictions
    fine_grained_proposals = model_upn.inference(
        test_image_path, prompt_type="fine_grained_prompt"
    )
    fine_grained_filtered_proposals = model_upn.filter(
        fine_grained_proposals, min_score=0.3, nms_value=0.8
    )

    inputs = processor.process(
        image=Image.open(test_image_path),
        question="Please breifly describe this image in one sentence and detect all the mentioned objects. Answer the question with grounded answer.",
        bbox=fine_grained_filtered_proposals["original_xyxy_boxes"][
            0
        ],  # box in xyxy format
    )

    inputs = {k: v.to("cuda") for k, v in inputs.items()}

    # perform inference
    gen_config = GenerationConfig(
        max_new_tokens=512,
        do_sample=False,
        eos_token_id=processor.tokenizer.eos_token_id,
        pad_token_id=(
            processor.tokenizer.pad_token_id
            if processor.tokenizer.pad_token_id is not None
            else processor.tokenizer.eos_token_id
        ),
    )
    with torch.autocast(device_type="cuda", enabled=True, dtype=torch.bfloat16):
        prediction = model.generate(
            inputs, gen_config=gen_config, tokenizer=processor.tokenizer
        )
    print(f"prediction:", prediction)

    # visualize the prediction
    vis_image = visualize_chatrex_output(
        Image.open(test_image_path),
        fine_grained_filtered_proposals["original_xyxy_boxes"][0],
        prediction,
        font_size=15,
        draw_width=5,
    )
    vis_image.save("tests/test_chatrex_grounded_image_caption.jpeg")
    print(f"prediction is saved at tests/test_chatrex_grounded_image_caption.jpeg")

The output from LLM is like:

The image depicts a cozy living room with a <ground>plaid couch,</ground><objects><obj2></objects> a <ground>wooden TV stand</ground><objects><obj3></objects>holding a <ground>black television,</ground><objects><obj1></objects> a <ground>red armchair,</ground><objects><obj4></objects> and a <ground>whiteboard</ground><objects><obj0></objects>with writing on the wall, accompanied by a <ground>framed poster</ground><objects><obj6></objects>of a <ground>couple.</ground><objects><obj9><obj11></objects>

The visualization of the output is like:

3.2.4 ChatRex for Grounded Conversation

Example Prompt for Region Caption tasks:

Answer the question in Grounded format. Question

Example Code

import torch
from PIL import Image
from transformers import AutoModelForCausalLM, AutoProcessor, GenerationConfig

from chatrex.tools.visualize import visualize_chatrex_output
from chatrex.upn import UPNWrapper

if __name__ == "__main__":
    # load the processor
    processor = AutoProcessor.from_pretrained(
        "IDEA-Research/ChatRex-7B",
        trust_remote_code=True,
        device_map="cuda",
    )

    print(f"loading chatrex model...")
    # load chatrex model
    model = AutoModelForCausalLM.from_pretrained(
        "IDEA-Research/ChatRex-7B",
        trust_remote_code=True,
        use_safetensors=True,
    ).to("cuda")

    # load upn model
    print(f"loading upn model...")
    ckpt_path = "checkpoints/upn_checkpoints/upn_large.pth"
    model_upn = UPNWrapper(ckpt_path)
    test_image_path = "tests/images/test_grounded_conversation.jpg"

    # get upn predictions
    fine_grained_proposals = model_upn.inference(
        test_image_path, prompt_type="coarse_grained_prompt"
    )
    fine_grained_filtered_proposals = model_upn.filter(
        fine_grained_proposals, min_score=0.3, nms_value=0.8
    )

    inputs = processor.process(
        image=Image.open(test_image_path),
        question="Answer the question in grounded format. This is a photo of my room, and can you tell me what kind of person I am?  ",
        bbox=fine_grained_filtered_proposals["original_xyxy_boxes"][
            0
        ],  # box in xyxy format
    )

    inputs = {k: v.to("cuda") for k, v in inputs.items()}

    # perform inference
    gen_config = GenerationConfig(
        max_new_tokens=512,
        do_sample=False,
        eos_token_id=processor.tokenizer.eos_token_id,
        pad_token_id=(
            processor.tokenizer.pad_token_id
            if processor.tokenizer.pad_token_id is not None
            else processor.tokenizer.eos_token_id
        ),
    )
    with torch.autocast(device_type="cuda", enabled=True, dtype=torch.bfloat16):
        prediction = model.generate(
            inputs, gen_config=gen_config, tokenizer=processor.tokenizer
        )
    print(f"prediction:", prediction)

    # visualize the prediction
    vis_image = visualize_chatrex_output(
        Image.open(test_image_path),
        fine_grained_filtered_proposals["original_xyxy_boxes"][0],
        prediction,
        font_size=30,
        draw_width=10,
    )
    vis_image.save("tests/test_chatrex_grounded_conversation.jpeg")
    print(f"prediction is saved at tests/test_chatrex_grounded_conversation.jpeg")

The output from LLM is like:

Based on the items in the image, it can be inferred that the <ground>person</ground><objects><obj1></objects> who owns this room has an interest in fitness and possibly enjoys reading. The presence of the <ground>dumbbell</ground><objects><obj2></objects> suggests a commitment to physical activity, while the <ground>book</ground><objects><obj3></objects> indicates a liking for literature or reading. The <ground>sneaker</ground><objects><obj0></objects>s and the <ground>plush toy</ground><objects><obj1></objects> add a personal touch, suggesting that the <ground>person</ground><objects><obj1></objects> might also value comfort and perhaps has a playful or nostalgic side. However, without more context, it is not possible to accurately determine the individual's specific traits or <ground>person</ground><objects><obj1></objects>ality.

The visualization of the output is like:

5. LICENSE

ChatRex is licensed under the IDEA License 1.0, Copyright (c) IDEA. All Rights Reserved. Note that this project utilizes certain datasets and checkpoints that are subject to their respective original licenses. Users must comply with all terms and conditions of these original licenses including but not limited to the:

OpenAI Terms of Use for the dataset.
For the LLM used in this project, the model is lmsys/vicuna-7b-v1.5, which is licensed under Llama 2 Community License Agreement.
For the high resolution vision encoder, we are using laion/CLIP-convnext_large_d.laion2B-s26B-b102K-augreg which is licensed under MIT LICENSE.
For the low resolution vision encoder, we are using openai/clip-vit-large-patch14 which is licensed under MIT LICENSE

BibTeX 📚

@misc{jiang2024chatrextamingmultimodalllm,
      title={ChatRex: Taming Multimodal LLM for Joint Perception and Understanding}, 
      author={Qing Jiang and Gen Luo and Yuqin Yang and Yuda Xiong and Yihao Chen and Zhaoyang Zeng and Tianhe Ren and Lei Zhang},
      year={2024},
      eprint={2411.18363},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2411.18363}, 
}

Magnet link

Opens the swarm directly in your torrent client — no file download needed. Copy-paste works too:

magnet:?xt=urn:btih:c23c1e3ead473c96e9372823d21a562bd7ec1058&dn=IDEA-Research_ChatRex-7B

Open magnet in torrent client · infohash c23c1e3ead473c96e9372823d21a562bd7ec1058

Files & hashes

Path	Size	sha1	sha256
README.md	21.6 KB (22,129 B)	38c476028794537e3f0c772c5a061fd1ee5f08af	7a21ea82a808c607b010864a5af54514d66ca0cf821443779e14804c8f5c3739
added_tokens.json	2.0 KB (2,081 B)	b23c16a2cad28a17427b0057540432fe35f58726	a68bc581eb3b0c9133676257558daa40403cf48fc03cb893b9bc64f837a23d33
assets/capability_overview.jpg	758.2 KB (776,362 B)	6cdae6511dc17996d25e76cee1d21dd36e86ed5f	f0d8b6699b4d6567d31172f7dbd589ec49085deb4fa3e47142ee6a6cc2117e41
assets/chatrex_gradio.jpg	489.6 KB (501,385 B)	2842ddd148830643c178abdaa48ccd70ca350e1b	6f7c6c2e702b5488c3feced8b7c166861348d66822f4e2e98d4e1cdadc2f4bac
assets/teaser.jpg	100.5 KB (102,917 B)	296b44a0afd67cb3d822e42707c5f3e16a0ae158	29238a2feeb3867fb8288e34df786c126dbf441985d0f404af13f6baa8500d89
assets/test_chatrex_grounded_conversation.jpeg	127.3 KB (130,401 B)	c92cabf014d99646b90582d70fb0a497efd76b2f	8ce36389eec10d5d0cb86848ef94fd3e02b42ff52d2eb2c69324e398a571cd1b
assets/upn_arch.jpg	249.7 KB (255,672 B)	f1890b35e512bcb2b2ef6882d47c4beb9bca212d	418dccbfdcfc04fc236948dd233c6c07e401fb7266f40657aeb9636b14ec49a1
assets/upn_gradio.jpg	523.9 KB (536,445 B)	d44260c1940982bc75264aafc4bfde0cfcbd4e01	8232f240d4a3a281ee7b6f3a0142182bb4a363b860869a8b3a618a676c3e5572
assets/upn_res.jpg	534.6 KB (547,415 B)	011ff5a479619f041292a1cd7a8ac69714486b85	f8e791a3f09bd2ae78994f2a34d4fe042c322f125605df044e08f8d9bb1e4d8b
assets/vis_output/test_chatrex_detection.jpeg	86.9 KB (88,969 B)	c2b132f70e2693efbc10f984c3323ee8615bcb90	799c2b5dbf9fc540e431cfd54e4f7815f4233847264c2d95c456e1ea0bd0dcaf
assets/vis_output/test_chatrex_grounded_image_caption.jpeg	30.9 KB (31,688 B)	1b9092dce87ecf708ab2267a5b06dfba38092dd6	9b504f0706b33e3d6810ca00a5e59b3858c32d54773c402d5066354bf0e2dba1
assets/vis_output/test_chatrex_region_caption.jpeg	59.7 KB (61,111 B)	6b1f95f7b3be12616b05109007149b4e545b12b5	00cd57524b4f2b0dae1a94b250a6826fd7dbd7f81ad880f8a78cd3916eda96ff
config.json	1.7 KB (1,738 B)	fa0c292541fd04448e88dd7471a7c7cb8cd2967b	ed481b88468d5d4057744149b3abd6aaa6c15e31ef7b0d9d67e3bd5aa5b841d8
convnext.py	23.1 KB (23,705 B)	1a4eef6f7ca803b012a496f44e7e95d382431e7a	b3da49cc270fc393b81130657e2de127fd5774f2dd6c83ea706f4b1ba102abd9
model-00001-of-00008.safetensors	1.86 GB (1,999,036,584 B)	26f755ce3c188869b5c3678a568984960a58a270	9346b639fad8375bb7593ff7c1fc1ca8c44af9cfef7f98fef5cca71e313ae3fd
model-00002-of-00008.safetensors	1.79 GB (1,924,284,084 B)	49470b8896566de9264d04491ec69a4be7ff3c17	93269f3f498e1c077a27737e986118c731e54563c940a278db55dff3242fb4ed
model-00003-of-00008.safetensors	1.80 GB (1,933,661,312 B)	a0000bdbf5905f5b4ba144c20476113240bc636f	74d3d5505d4a2969a6167b67ef211e38bd40a44876500e8c446c6cd9893259dc
model-00004-of-00008.safetensors	1.85 GB (1,990,284,448 B)	1e068cf4895bb3a375fe392f8909e1da5c5cf2e9	86dd31f20e7cb47e21ffd4d6671ad0ccdd45a2263ae9c598fd2104a673f8525c
model-00005-of-00008.safetensors	1.85 GB (1,990,284,464 B)	2e5f8e09da1e39d664a40213dade3efe2884d69b	6b2e5aed4e9e6d67ecc9ac6bdc64ae43acb1c5870ddcadd0e0aa8a98cfe9e379
model-00006-of-00008.safetensors	1.85 GB (1,990,284,464 B)	bb67a1d1f50831721c34f21bb3c7085e3cf09bb0	ba9e17499970f3e08d69035e659dbb631de32af034eddf4e6db64bc906fd7ab1
model-00007-of-00008.safetensors	1.85 GB (1,990,284,464 B)	efb3530d03dbe91b41c1bb3d8c93c6da62b725e6	8cd8c1582df12838e330fe243f13f962674de1262c83dca95d9ed4be81090b7c
model-00008-of-00008.safetensors	1.75 GB (1,882,075,584 B)	22c8edab6acb2131d8dcc916ba0c196d5e3520e1	c24cd66261ea897e5e5a04c45c1e687037b0a79a9ee87a36176af1ca984a3275
model.safetensors.index.json	100.2 KB (102,570 B)	250048fa14f3dd8fa6202187872b1eb012cdf16e	da8462591fa30d5621662fe14c3e4a4287e8fd82d3089ec948c22a442f96e6a7
modeling_chatrex.py	32.7 KB (33,463 B)	a380cffbf34b1cc0c184d9c3a4d25af2c138ec54	c0e99b7a2e6be735762e1e46adf30bd520ec75ef56289047854e6d653fa12dab
preprocessing_chatrex.py	8.4 KB (8,589 B)	94550d450937e52e2d2f9b7714b1f9738c60fec5	2e7f4441cb3216189e08d4bc56d6b8b0c343ff0d2336e90de3fe96aa47f24620
preprocessor_config.json	507 B (507 B)	1bc3cd106622d492adc4382bfbf0f4f1c0ea5b9c	3ca2738ddf0d135d5eef354d14b98dfde8e2eec85325983f015be5c0783cc31c
processor_config.json	127 B (127 B)	67942a705ac30475ca198452458677894aa22454	b39bdc501d931a500cff104eea6768a630d7076dd48037d16227088fead3a3d6
special_tokens_map.json	552 B (552 B)	8bedc05a6476080d7f473a9da72394f2cee48340	4859e5dbde90e059988a0a2136d8df3f2773d4d2fc4c4543690028f0b2166e7f
tokenizer.json	1.8 MB (1,861,682 B)	275e7728521df29a0173f915110d87628844583f	fffa377e1990721b4d585d650f4825b947718d2f0ffb26301352ec82aeac4da0
tokenizer.model	488.0 KB (499,723 B)	7a4e789beca293352e60b6fad5eef1908070cee0	9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347
tokenizer_config.json	18.5 KB (18,993 B)	efafc3fa88331fde8c05f26c511cd8eabf0103e0	b508fcda538d902cca68a810bf1fe82da47ece0af0e9e2e8a4b895d4a3b1cddd

Cite this release

Canonical URL: https://aiseedbank.org/models/IDEA-Research_ChatRex-7B/
Slug: IDEA-Research_ChatRex-7B
Infohash: c23c1e3ead473c96e9372823d21a562bd7ec1058
License: no license recorded
Signing key fingerprint: 85a3b32c3712427b

Every file carries a locally computed sha256 — verify a download against the signed sums: IDEA-Research_ChatRex-7B.SHA256SUMS (+ minisign signature).

Provenance

Upstream repository	IDEA-Research/ChatRex-7B
Revision (pinned)	55e8fe852bea416045aabecb35de24ab81cf6ffa
Fetched at	2026-09-03T17:43:47Z
License at fetch	no license recorded
Snapshot tool	huggingface · seedbank 0.1.0

Trackers

udp://announce.aitorrent.org:6969/announce
http://announce.aitorrent.org:7070/announce
udp://announce2.aitorrent.org:6970/announce
http://announce2.aitorrent.org:7071/announce
udp://tracker.opentrackr.org:1337/announce
udp://open.demonii.com:1337/announce
udp://open.stealth.si:80/announce
udp://exodus.desync.com:6969/announce
udp://tracker.torrent.eu.org:451/announce

✓ verified · rehash-vs-hf-metadata at 2026-09-03T17:46:35Z

no license recorded14.63 GB (15,705,803,628 bytes)safetensorschatrexupnimage-text-to-textcustom_code1 language (en)paper: 2411.18363