类型化答案Typed answers
支持选择、评分与真伪判断,结果天然符合结构,无需解析生成文本。Choice, score and boolean answers that fit your schema by construction.
OmniJev
OmniJev 是我们在自建数据集上端到端训练的 4B 决策模型。
它联合读取文本、图像与视频,在一次前向计算中为 choice、score、noul 问题输出校准概率。OmniJev is a 4B decision model trained end to end on our own dataset.
It reads text, images and video together, returning calibrated probabilities for choice, score and noul questions in one forward pass.
模型特性Model properties
输入由视觉状态、文本上下文和问题集合组成。模型直接输出固定结构的概率结果,不调用第三方模型,也不进行逐 token 文本生成。Each request contains visual state, text context and typed questions. The model itself returns fixed probability structures—without third-party model calls or token-by-token generation.
支持选择、评分与真伪判断,结果天然符合结构,无需解析生成文本。Choice, score and boolean answers that fit your schema by construction.
回答 0.9 时,大约十次对九次。阈值因此真正具备业务意义。When it says 0.9, it is right roughly nine times out of ten.
一次前向同时回答一组问题,图像单题服务端时延中位数仅 103 毫秒。One forward pass answers a full set of questions; median server latency for one image question is 103 ms.
统一处理照片、连续视频、应用界面、网页、棋盘与具身视角。Photos, videos, interfaces, web pages, games and embodied views.
每个选择都包含“以上都不是”,不确定的样本可安全交给其他流程。Every choice can return “none of the above” for safe routing.
约 27 万条决策记录、130 万个类型化问题,覆盖网页与手机、机器人、视频、游戏、手势、危险和声音。About 270k decision records and 1.3M typed questions spanning web and phone use, robots, video, games, gestures, hazards and sounds.
任务示例Task examples
以下视频展示机器人任务、四类实时游戏、网页与手机操作、目标定位、视频理解和安全监测。The examples cover robot tasks, four real-time games, web and phone operation, visual grounding, video understanding and safety monitoring.
每一帧同步判断子任务、运动方向、抓取状态与阶段完成度。Every frame resolves sub-task, motion, grasp state and completion.
以 LIBERO-10 为例,逐帧展示任务与子任务识别、运动控制,以及状态判断。A LIBERO-10 example showing task and sub-task recognition, seven-way action probabilities, grasp state, object holding and completion on every frame.
在 Atari、贪吃蛇、五子棋和国际象棋中判断下一步动作、得分机会与局势。Decide the next action, scoring opportunity and game state in Atari, Snake, Gomoku and Chess.
逐页选择操作元素、动作类型、风险与任务进度。Pick the element, operation, risk and progress on every page.
逐屏判断下一步动作、任务是否完成、操作风险与当前进度。Choose the next action, completion state, operation risk and progress on each screen.
用网格在截图或照片中定位任意自然语言所指的对象。Locate a natural-language target on screenshots or photos.
判断灯是否点亮、门是否开合,以及人物最后的状态。Understand lights, doors, people and temporal events.
识别火、烟、危险类型、紧急程度与所在区域。Fire, smoke, urgency and the affected region.
Held-out evaluation
展示五组模型结果均完整的 held-out 评测项:比较 Qwen3.5 zero-shot 骨干与三个规模的 OmniJev。准确率按百分比展示;ECE 为 OmniJev-4B 的校准误差,越低越好。Held-out benchmarks with results for all five models: Qwen3.5 zero-shot backbones and three OmniJev sizes. Accuracy is shown as a percentage; ECE is the calibration error of OmniJev-4B and lower is better.
注:此处仅展示当前所有对比列均完整的评测项,缺项 benchmark 暂不纳入。结果会随评测与复核持续更新,并沿用一致协议以确保可比;完整结果见 GitHub Results ↗。Note: Only benchmarks with complete comparison columns are shown; incomplete rows are omitted for now. Results will be updated under consistent protocols as evaluation and verification continue. See the full GitHub results ↗.
推理延迟Inference latency
测试模型:OmniJev-4BModel tested: OmniJev-4B时延均报告 12 次运行的中位数。Latency values are medians over 12 runs.
单图单题,服务端时延one image, one question
同图十二题,总时延twelve questions, total latency
整段视频,多帧采样a full sampled video
始终不生成文本generated, always
Online evaluation
在线页面支持 choice、score、noul 问题,并显示完整概率分布和服务端耗时。The online page supports choice, score and noul questions and reports full probabilities and server latency.