Overview
A job can process multiple input items containing data. Large input items may exceed the system’s inference capacity and fail. For large input items, we recommend to open a job and add the input data in chunks to run them successfully.
Chunks
Chunks are portions of large input data that can be sent separately to an open job.
Open jobs
These are jobs submitted without the input object. They are created with status open and they can receive input chunks until they get closed.
The job chunks object
{
"inputChunkMaximumSize": "...",
"maximumInputChunks": "...",
"maximumInputsPerJob": "..."
}
Parameter | Type | Description |
---|---|---|
inputChunkMaximumSize | string | The maximum size the system supports for each chunk. |
maximumInputChunks | string | The maximum amount of chunks the system/model supports. |
maximumInputsPerJob | string | The maximum amount of inputs a system/model supports. |