Skip to content

Publish an Aggregation Model ​

Applicable Roles ​

  • Model Provider

Before You Start ​

  • Prepare at least two healthy published member models with compatible protocols and modalities.
  • Decide whether the aggregation objective is cost, success rate, load distribution, or high availability.
  • Compare member billing, context, concurrency, and region differences.

Procedure ​

  1. From the platform home page, select My Models in the left navigation.
  2. Open the My Aggregations tab. Use Public Models / Private Models to switch between publication areas.
  3. Select Create Aggregation Model in the upper-right corner.
  4. Select a publication area:
    • Publish to Private Area makes the aggregation visible only within the team or tenant and does not list it in the public catalog.
    • Publish to Public Area lists the aggregation in the public catalog for all tenants and allows independent pricing and rate limits.
  5. Select Publish to Public Area to open Step 1.

Choose where to publish the aggregation model

Step 1: Basic Information ​

  • Select the Model Type, such as Multimodal, Chat, Image, Speech, Video, Embedding, or Rerank.
  • Select the Model Subtype, such as LLM.

Select the aggregation model type

  • Under Model Selection, select Add Model:
    • Filter the model-name and model-identifier list on the left.
    • Review provider instances on the right, including publication date, context, input and output price, throughput, success rate, weekly calls, weekly tokens, maximum output, region, and capabilities.
    • Select one or more compatible provider instances and select Confirm.

Choose the first member model

  • Configure each member model:
    • Enabled controls whether the member participates in routing.
    • Minimum Success Rate, such as 80%.
    • Maximum Concurrency, such as 1500.
    • Maximum Context Length, such as 128K.
    • Input-token and output-token Cost.
    • Delete removes the member.

Choose the second member model

  • Complete the aggregation's basic information:
    • Enter a Custom Identifier, such as Qwen3-235b-a22b-instruct-2507.
    • Select a Matching Policy: Cost First, Success Rate First, Balanced Cost and Experience, Random, or Round Robin.
    • Select tags, such as Text Generation.
    • Enter a description.

Complete aggregation model basic information

  • Select Publish Immediately or Scheduled Publication.

Choose the publication method

  • Select Next to open Step 2.

Step 2: Billing Configuration ​

  • Select Free or Paid billing.
  • For paid billing, select Uniform Billing, Input/Output Billing, or Tiered Billing.
  • Configure prices in Credits per 1M tokens:
    • Original Input Price is the input reference price shown for comparison.
    • Input Sale Price is the actual settlement price for model input.
    • Original Output Price is the output reference price shown for comparison.
    • Output Sale Price is the actual settlement price for model output.

Configure aggregation model billing

  • Select Save Only or Submit for Review.

Parameter Reference - Aggregation Model ​

FieldTypeExampleDescription
Model TypeSingle selectChat / ImageRequired; aggregation model function
Model SubtypeSelectLLMRequired; specific model subtype
Member ModelsList selectionMultiple provider instancesRequired; select at least two published models
EnabledSwitchOn / OffRequired; controls whether the member receives traffic
Minimum Success RatePercentage80%Required; members below the threshold are excluded
Maximum ConcurrencyNumber1500Required; maximum concurrent requests for the member
Maximum Context LengthNumber128KRequired; member context limit
Input Token CostNumber2000Required; cost per million input tokens
Output Token CostNumber8000Required; cost per million output tokens
Custom IdentifierTextQwen3-235b-a22b-instruct-2507Required; public aggregation identifier
Matching PolicySingle selectCost First / Success Rate First / Balanced / Random / Round RobinRequired; request-routing policy
TagsSelectText GenerationOptional; aggregation tags
DescriptionTextAggregation model...Optional; aggregation description
Publication MethodSingle selectImmediate / ScheduledRequired; publication time
Billing MethodSingle selectFree / PaidRequired; whether calls are billed
Billing ModeSingle selectUniform / Input-Output / TieredRequired for paid models
Original Input PriceNumber40.00 Credits/1M tokensOptional; input reference price
Input Sale PriceNumber20.00 Credits/1M tokensRequired; actual input settlement price
Original Output PriceNumber160.00 Credits/1M tokensOptional; output reference price
Output Sale PriceNumber80.00 Credits/1M tokensRequired; actual output settlement price

Completion Checklist ​

Purpose: These are the exit criteria for the current feature task. Use them to decide whether the result is observable and reviewable and whether you can continue to the next step in the scenario. They do not repeat the procedure; if any item fails, follow the troubleshooting section below.

CheckPass Criteria
1The aggregation contains at least two enabled member models.
2The matching policy fits the business objective and member thresholds and costs are complete.
3Publication or review status is correct.
4A controlled request succeeds through the aggregation endpoint.
5Remaining members accept traffic when one member is disabled.

Troubleshooting ​

SymptomCheck First
No member model can be selectedPublication state, modality, protocol, and visibility
Submission failsMember count, required fields, billing, and publication area
Requests always select one memberMatching policy, enabled state, success-rate threshold, and cost
Aggregation calls failMember health, protocol compatibility, rate limits, and timeout

User Manual ​