chivier/ryze-biovision-qwen3.8-27b-v6.2-fp32
specialized multimodal model for analyzing scientific figures
2 min readupdated
Ryze BioVision is built on Qwen/Qwen3.8-27B (27.78B parameters) and fine-tuned to answer four-option multiple-choice questions (A–D) based on images from biology papers. The adapter (LoRA — a lightweight add-on for a base model) is fully merged into the base weights in FP32 format, so it loads as a standalone checkpoint without extra modules. It targets tasks like color identification, comparing values along a shared axis, spatial relationships, and trend directions in plots, aiming to automate the verification of biological diagrams and charts from open-access PubMed Central sources.
Key features
- Multimodal analysis: processes charts and figures from biology research at resolutions up to 1,048,576 pixels.
- Four-option multiple choice: outputs strictly a single capital letter (A, B, C, or D) in response to a given question.
- Domain specialization: trained on a dataset of PubMed Central biology papers covering colors, axes, spatial relationships, and trends.
- FP32 format: weights are fully merged across all layers, bringing the total checkpoint size to roughly 102.7 GB.
What you can do
- Analyze charts: test the model on trend detection, value comparisons, and matching elements in diagrams from biology publications.
- Integrate into pipelines: run it in Python scripts via the
transformerslibrary to automate scientific figure parsing. - Benchmark accuracy: verify model predictions against ground-truth labels using the test splits referenced in the model card.
Example
import torch
from PIL import Image
from transformers import AutoModelForImageTextToText, AutoProcessor
model_id = "chivier/ryze-biovision-qwen3.8-27b-v6.2-fp32"
processor = AutoProcessor.from_pretrained(model_id)
model = AutoModelForImageTextToText.from_pretrained(
model_id,
dtype=torch.float32,
device_map="auto",
max_memory={0: "60GiB", "cpu": "45GiB"},
offload_folder="./offload",
)
model.eval()Read more
DetailsHeld-out test accuracy (383 questions): 98.17% (up from 94.26% for the base model).
Hardware requirements: the FP32 checkpoint does not fit entirely on a 96 GB GPU and requires CPU and disk offloading.
Limitations: outputs only letters A–D even when an image is unreadable; not intended for clinical or diagnostic use.
Training: 1 epoch of SFT on the Qwen3_5ForConditionalGeneration architecture with a frozen vision tower.










Comments