Obtenir un future interactif

GET

https://api.fastino.ai

training

jobs

{job_id}

futures

{future_id}

curl "https://api.fastino.ai/v1/training/jobs/$TRAINING_JOB_ID/futures/$FUTURE_ID?wait=true" \
  -H "X-API-Key: $FASTINO_API_KEY"

{
  "future_id": "FUTURE_ID",
  "job_id": "SESSION_ID:train:0",
  "type": "forward_backward",
  "status": "pending",
  "queue_state": "paused_capacity",
  "queue_state_reason": null,
  "result": null,
  "error": null
}

{
  "future_id": "FUTURE_ID",
  "job_id": "SESSION_ID:train:0",
  "type": "sample",
  "status": "completed",
  "queue_state": null,
  "queue_state_reason": null,
  "result": {
    "sequences": [
      {"tokens": [59604, 13, 151645], "logprobs": [-0.21, -0.05, -0.01], "stop_reason": "stop", "topk_logprobs": null}
    ],
    "prompt_logprobs": null,
    "topk_prompt_logprobs": null,
    "prompt_cache_hit_tokens": 0
  },
  "error": null
}

GET /v1/training/jobs/{job_id}/futures/{future_id} Every interactive-job call that does work returns a future_id. Read the future until its status is completed, failed, or cancelled. Use wait=true to wait at most 25 seconds per request. Continue polling a nonterminal future. Use wait=true to wait at most 25 seconds per request. Continue polling a nonterminal future. Use wait=true to wait at most 25 seconds per request. Continue polling a nonterminal future. Use wait=true to wait at most 25 seconds per request. Continue polling a nonterminal future. Use wait=true to wait at most 25 seconds per request. Continue polling a nonterminal future. Results are kept for one hour.

Request

string

requis

Your Fastino API key.

string

requis

Interactive job ID.

string

requis

Future ID returned when the work was queued.

boolean

défaut:"false"

Wait up to 25 seconds for an unfinished future before answering. Repeat the request until it finishes.

curl "https://api.fastino.ai/v1/training/jobs/$TRAINING_JOB_ID/futures/$FUTURE_ID?wait=true" \
  -H "X-API-Key: $FASTINO_API_KEY"

Response

string

The future.

string

The job.

string

create, load, forward, forward_backward, optim_step, save, or sample.

string

pending, running, completed, failed, or cancelled.

string | null

While unfinished: active, or paused_capacity while GPU capacity warms up.

any

Once completed:

forward and forward_backward: loss_fn_outputs (one entry of tensors per datum, such as logprobs) and metrics.
sample: sequences, each with tokens, logprobs, and stop_reason, plus prompt_logprobs when requested.
save: the checkpoint path.
Other types: an acknowledgement.

object | null

When failed or cancelled: message, and category (user for a problem with the request, server for a Fastino problem).

{
  "future_id": "FUTURE_ID",
  "job_id": "SESSION_ID:train:0",
  "type": "forward_backward",
  "status": "pending",
  "queue_state": "paused_capacity",
  "queue_state_reason": null,
  "result": null,
  "error": null
}

{
  "future_id": "FUTURE_ID",
  "job_id": "SESSION_ID:train:0",
  "type": "sample",
  "status": "completed",
  "queue_state": null,
  "queue_state_reason": null,
  "result": {
    "sequences": [
      {"tokens": [59604, 13, 151645], "logprobs": [-0.21, -0.05, -0.01], "stop_reason": "stop", "topk_logprobs": null}
    ],
    "prompt_logprobs": null,
    "topk_prompt_logprobs": null,
    "prompt_cache_hit_tokens": 0
  },
  "error": null
}

Status	Meaning
`404`	The job or future doesn’t exist, or belongs to another team.

⌘I

curl "https://api.fastino.ai/v1/training/jobs/$TRAINING_JOB_ID/futures/$FUTURE_ID?wait=true" \
  -H "X-API-Key: $FASTINO_API_KEY"

{
  "future_id": "FUTURE_ID",
  "job_id": "SESSION_ID:train:0",
  "type": "forward_backward",
  "status": "pending",
  "queue_state": "paused_capacity",
  "queue_state_reason": null,
  "result": null,
  "error": null
}

{
  "future_id": "FUTURE_ID",
  "job_id": "SESSION_ID:train:0",
  "type": "sample",
  "status": "completed",
  "queue_state": null,
  "queue_state_reason": null,
  "result": {
    "sequences": [
      {"tokens": [59604, 13, 151645], "logprobs": [-0.21, -0.05, -0.01], "stop_reason": "stop", "topk_logprobs": null}
    ],
    "prompt_logprobs": null,
    "topk_prompt_logprobs": null,
    "prompt_cache_hit_tokens": 0
  },
  "error": null
}

Inférence

Entraînement

Request

Response

​Request

​Response

Request

Response