Trait hotg_rune_runtime::Model

source · [−]
pub trait Model: Send + Sync + 'static {
    fn infer(
        &mut self, 
        inputs: &[&[u8]], 
        outputs: &mut [&mut [u8]]
    ) -> Result<(), Error>;

    fn input_shapes(&self) -> &[Shape<'_>];

    fn output_shapes(&self) -> &[Shape<'_>];
}
Expand description

An object that can do inference.

Required methods

Run inference on the input tensors, writing the results to outputs.

Implementors