Skip to content

Commit ae61d10

Browse files
committed
transform data.pkl to data.pt instead of combining .pt split files
1 parent d8e68cc commit ae61d10

File tree

1 file changed

+6
-1
lines changed

1 file changed

+6
-1
lines changed

chebai/preprocessing/migration/chebi_data_migration.py

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -35,7 +35,12 @@ def migrate(self):
3535
os.makedirs(self._chebi_cls.base_dir, exist_ok=True)
3636
print("Migration started..................")
3737
self._migrate_old_raw_data()
38-
self._migrate_old_processed_data()
38+
39+
# Either we can combine `.pt` split files to form `data.pt` file
40+
# self._migrate_old_processed_data()
41+
# OR
42+
# we can transform `data.pkl` to `data.pt` file (this seems efficient along with less code)
43+
self._chebi_cls.setup_processed()
3944
print("Migration completed..................")
4045

4146
def _migrate_old_raw_data(self):

0 commit comments

Comments
 (0)