Skip to content

Speed up sparse tensor export/import functionality using numpy.savetxt and numpy.loadtxt #460

@gqcollins

Description

@gqcollins

The current implementation of file export/import for sparse tensors has some inefficiencies, as it writes/reads one line at a time. To address this, I propose using numpy.savetxt and numpy.loadtxt to provide considerable speedup.

sparse_export.py: Compares the current export functionality to a new option using numpy.savetxt.
sparse_import.py: Compares the current import functionality to a new option using numpy.loadtxt.
I will create a merge request with the proposed changes once this issue is acknowledged.

Metadata

Metadata

Assignees

No one assigned

    Labels

    performanceThings can always be faster

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions