获取交互式 future

GET

https://api.fastino.ai

training

jobs

{job_id}

futures

{future_id}

curl "https://api.fastino.ai/v1/training/jobs/$TRAINING_JOB_ID/futures/$FUTURE_ID?wait=true" \
  -H "X-API-Key: $FASTINO_API_KEY"

{
  "future_id": "FUTURE_ID",
  "job_id": "SESSION_ID:train:0",
  "type": "forward_backward",
  "status": "pending",
  "queue_state": "paused_capacity",
  "queue_state_reason": null,
  "result": null,
  "error": null
}

{
  "future_id": "FUTURE_ID",
  "job_id": "SESSION_ID:train:0",
  "type": "sample",
  "status": "completed",
  "queue_state": null,
  "queue_state_reason": null,
  "result": {
    "sequences": [
      {"tokens": [59604, 13, 151645], "logprobs": [-0.21, -0.05, -0.01], "stop_reason": "stop", "topk_logprobs": null}
    ],
    "prompt_logprobs": null,
    "topk_prompt_logprobs": null,
    "prompt_cache_hit_tokens": 0
  },
  "error": null
}

GET /v1/training/jobs/{job_id}/futures/{future_id} Every interactive-job call that does work returns a future_id. Read the future until its status is completed, failed, or cancelled. Use wait=true to wait at most 25 seconds per request. Continue polling a nonterminal future. Use wait=true to wait at most 25 seconds per request. Continue polling a nonterminal future. Use wait=true to wait at most 25 seconds per request. Continue polling a nonterminal future. Use wait=true to wait at most 25 seconds per request. Continue polling a nonterminal future. Use wait=true to wait at most 25 seconds per request. Continue polling a nonterminal future. Results are kept for one hour.

Request

string

必填

Your Fastino API key.

string

必填

Interactive job ID.

string

必填

Future ID returned when the work was queued.

boolean

默认值:"false"

Wait up to 25 seconds for an unfinished future before answering. Repeat the request until it finishes.

curl "https://api.fastino.ai/v1/training/jobs/$TRAINING_JOB_ID/futures/$FUTURE_ID?wait=true" \
  -H "X-API-Key: $FASTINO_API_KEY"

Response

string

The future.

string

The job.

string

create, load, forward, forward_backward, optim_step, save, or sample.

string

pending, running, completed, failed, or cancelled.

string | null

While unfinished: active, or paused_capacity while GPU capacity warms up.

any

Once completed:

forward and forward_backward: loss_fn_outputs (one entry of tensors per datum, such as logprobs) and metrics.
sample: sequences, each with tokens, logprobs, and stop_reason, plus prompt_logprobs when requested.
save: the checkpoint path.
Other types: an acknowledgement.

object | null

When failed or cancelled: message, and category (user for a problem with the request, server for a Fastino problem).

{
  "future_id": "FUTURE_ID",
  "job_id": "SESSION_ID:train:0",
  "type": "forward_backward",
  "status": "pending",
  "queue_state": "paused_capacity",
  "queue_state_reason": null,
  "result": null,
  "error": null
}

{
  "future_id": "FUTURE_ID",
  "job_id": "SESSION_ID:train:0",
  "type": "sample",
  "status": "completed",
  "queue_state": null,
  "queue_state_reason": null,
  "result": {
    "sequences": [
      {"tokens": [59604, 13, 151645], "logprobs": [-0.21, -0.05, -0.01], "stop_reason": "stop", "topk_logprobs": null}
    ],
    "prompt_logprobs": null,
    "topk_prompt_logprobs": null,
    "prompt_cache_hit_tokens": 0
  },
  "error": null
}

Status	Meaning
`404`	The job or future doesn’t exist, or belongs to another team.

⌘I

curl "https://api.fastino.ai/v1/training/jobs/$TRAINING_JOB_ID/futures/$FUTURE_ID?wait=true" \
  -H "X-API-Key: $FASTINO_API_KEY"

{
  "future_id": "FUTURE_ID",
  "job_id": "SESSION_ID:train:0",
  "type": "forward_backward",
  "status": "pending",
  "queue_state": "paused_capacity",
  "queue_state_reason": null,
  "result": null,
  "error": null
}

{
  "future_id": "FUTURE_ID",
  "job_id": "SESSION_ID:train:0",
  "type": "sample",
  "status": "completed",
  "queue_state": null,
  "queue_state_reason": null,
  "result": {
    "sequences": [
      {"tokens": [59604, 13, 151645], "logprobs": [-0.21, -0.05, -0.01], "stop_reason": "stop", "topk_logprobs": null}
    ],
    "prompt_logprobs": null,
    "topk_prompt_logprobs": null,
    "prompt_cache_hit_tokens": 0
  },
  "error": null
}

推理

训练

Request

Response

​Request

​Response

Request

Response