Skip to content

tinker.types.ModelInput

class tinker.types.ModelInput(StrictBase)

Fields:

  • chunks – Sequence of input chunks (formerly TokenSequence)

from_ints(tokens)

Create a ModelInput from a list of ints (tokens).

Returns: 'ModelInput'

to_ints()

Convert the ModelInput to a list of ints (tokens) Throws exception if there are any non-token chunks

Returns: List[int]

property length

Return the total context length used by this ModelInput.

Returns: int

empty()

Create an empty ModelInput.

Returns: 'ModelInput'

append(chunk)

Add a new chunk, return a new ModelInput.

Returns: 'ModelInput'

append_int(token)

Add a new token, return a new ModelInput.

Returns: 'ModelInput'