def partitions()

in pyspark_huggingface/huggingface_source.py [0:0]

• 5 lines of code
• 3 McCabe index (conditional complexity)

    def partitions(self) -> Sequence[Shard]:
        if self.streaming_dataset:
            return [Shard(index=i) for i in range(self.streaming_dataset.num_shards)]
        else:
            return [Shard(index=0)]