Skip to contents

Function creates an arrow data set that contains only unique cases. That is, duplicates are removed.

Usage

reduce_to_unique(dataset_to_reduce, column_name)

Arguments

dataset_to_reduce

Object of class datasets.arrow_dataset.Dataset.

column_name

string Name of the column whose values should be unique.

Value

Returns a data set of class datasets.arrow_dataset.Dataset where the duplicates are removed according to the given column.