def clean_calibration_dataset()

in optimum/furiosa/quantization.py [0:0]

• 5 lines of code
• 2 McCabe index (conditional complexity)

    def clean_calibration_dataset(self, dataset: Dataset) -> Dataset:
        model = onnx.load(self.model_path)
        model_inputs = {input.name for input in model.graph.input}
        ignored_columns = list(set(dataset.column_names) - model_inputs)
        return dataset.remove_columns(ignored_columns)