Hello
I am receiving error AttributeError: aenter from this snippet which is reading a csv file from S3 and trying to get a count.
file="s3://xxxxr/80Gplus/xxxxx80G.csv"
now = datetime.datetime.now()
print('Status: reading {0} at {1} '.format(btcfile,now.strftime("%Y-%m-%d %H:%M:%S")))
gdf_data_tmp = dd.read_csv(btcfile)
symbol='XXX'
train_columns = [column_headers for column_headers in gdf_data_tmp.columns if 'double_line' in column_headers or 'XXXX' in column_headers ]
train_columns2= [column_headers for column_headers in gdf_data_tmp.columns if 'XXX' in column_headers ]
now = datetime.datetime.now()
print('Status: reading {0} completed at {1} '.format(file,now.strftime("%Y-%m-%d %H:%M:%S")))
print('Status: len reading {0} '.format(now.strftime("%Y-%m-%d %H:%M:%S")))
data_tmp_len=gdf_data_tmp.index.size.compute()
print('Status: fillna reading {0} '.format(now.strftime("%Y-%m-%d %H:%M:%S")))
---------------------------------------------------------------------------
AttributeError Traceback (most recent call last)
Cell In[12], line 15
12 print('Status: reading {0} completed at {1} '.format(file,now.strftime("%Y-%m-%d %H:%M:%S")))
14 print('Status: len reading {0} '.format(now.strftime("%Y-%m-%d %H:%M:%S")))
---> 15 data_tmp_len=gdf_data_tmp.index.size.compute()
18 print('Status: fillna reading {0} '.format(now.strftime("%Y-%m-%d %H:%M:%S")))
File /opt/conda/lib/python3.10/site-packages/dask/bytes/core.py:191, in read_block_from_file()
File /opt/conda/lib/python3.10/site-packages/fsspec/core.py:102, in __enter__()
File /opt/conda/lib/python3.10/site-packages/fsspec/spec.py:1241, in open()
File /opt/conda/lib/python3.10/site-packages/s3fs/core.py:659, in _open()
File /opt/conda/lib/python3.10/site-packages/s3fs/core.py:2066, in __init__()
File /opt/conda/lib/python3.10/site-packages/fsspec/spec.py:1597, in __init__()
File /opt/conda/lib/python3.10/site-packages/fsspec/spec.py:1610, in details()
File /opt/conda/lib/python3.10/site-packages/fsspec/asyn.py:121, in wrapper()
File /opt/conda/lib/python3.10/site-packages/fsspec/asyn.py:106, in sync()
File /opt/conda/lib/python3.10/site-packages/fsspec/asyn.py:61, in _runner()
File /opt/conda/lib/python3.10/site-packages/s3fs/core.py:1271, in _info()
File /opt/conda/lib/python3.10/site-packages/s3fs/core.py:348, in _call_s3()
File /opt/conda/lib/python3.10/site-packages/s3fs/core.py:140, in _error_wrapper()
File /opt/conda/lib/python3.10/site-packages/s3fs/core.py:113, in _error_wrapper()
File /opt/conda/lib/python3.10/site-packages/aiobotocore/client.py:366, in _make_api_call()
File /opt/conda/lib/python3.10/site-packages/aiobotocore/client.py:391, in _make_request()
File /opt/conda/lib/python3.10/site-packages/aiobotocore/endpoint.py:100, in _send_request()
File /opt/conda/lib/python3.10/site-packages/aiobotocore/endpoint.py:262, in _needs_retry()
File /opt/conda/lib/python3.10/site-packages/aiobotocore/hooks.py:66, in _emit()
File /opt/conda/lib/python3.10/site-packages/aiobotocore/_helpers.py:15, in resolve_awaitable()
File /opt/conda/lib/python3.10/site-packages/aiobotocore/utils.py:414, in redirect_from_error()
File /opt/conda/lib/python3.10/site-packages/aiobotocore/utils.py:483, in get_bucket_region()
AttributeError: __aenter__
These python packages [lightgbm panda scikit-learn seaborn scipy scikit-learn-intelex matplotlib graphviz joblib nbconvert dpcpp-cpp-rt aiobotocore s3fs boto3 botocore asyncio] ar e being added to the base image Package dask · GitHub
I am not sure where the root of the problem lies …
Thanks