Tried to create a dask dataframe with read_parquet() and raised "TypeError: ‘<’ not supported between instances of ‘NoneType’ and ‘str’ ". The same line used to work couple days ago, but is not work now. What is causing the problem? Below is the error message. File ~/parts_consumption_sk/lib/pytho…

Read_parquet caused "TypeError: '<' not supported between instances of 'NoneType' and 'str'"

farmd February 17, 2023, 9:10pm 5

@guillaumeeb
Thanks for the advice! We figured there are null values in the partition column in the HIVE_DEFAULT_PARTITION, and it had been taken care of. Everything works now.

1 Like

Topic		Replies	Views
Still cannot get rid of string conversion for blob Dask DataFrame	3	56	August 30, 2024
Dask .to_parquet() errors when saving lists of integers (object types) with convert-string: False	1	1967	January 25, 2024
Error when calling to_parquet() "TypeError: argument of type 'int' is not iterable" Dask DataFrame parquet , partitioning	2	133	March 29, 2024
KeyError while using the read_parquet method Dask DataFrame	10	1014	August 21, 2023
How to upload dataframe with numpy array column using to_parquet in dask.dataframe? Dask DataFrame	2	738	August 29, 2023

Read_parquet caused "TypeError: '<' not supported between instances of 'NoneType' and 'str'"

Related topics