Skip to content

Commit b3e431c

Browse files
lhoestqwengh
andauthored
Update pyspark_huggingface/compat/datasource.py
Co-authored-by: Haoyu Weng <wenghy02@gmail.com>
1 parent 38429e7 commit b3e431c

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

pyspark_huggingface/compat/datasource.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,7 +3,7 @@
33
import pyspark
44

55

6-
if int(pyspark.__version__.split(".")[0]) >= 4 and ("dev0" not in pyspark.__version__ and "dev1" not in pyspark.__version__):
6+
if int(pyspark.__version__.split(".")[0]) >= 4 and pyspark.__version__ not in ("4.0.0.dev0", "4.0.0.dev1"):
77
from pyspark.sql.datasource import DataSource, DataSourceArrowWriter, DataSourceReader, DataSourceWriter, InputPartition, WriterCommitMessage
88
else:
99
class DataSource:

0 commit comments

Comments
 (0)