Skip to content

500 returned by DeX in some cases when called from ezEML #87

@rogerdahl

Description

@rogerdahl

Likely cause:

OSError: [Errno 36] File name too long: '/home/pasta/dex-cache/https-ezeml.edirepository.org-user-data-Joanna_Alexandra_Guldin_Guldin-52ed8878f551e1a9cbe623a7f489cada-uploads-Groundwater-derived-20nutrient-20fluxes-20and-20offshore-20mixing-20rates-20along-20the-20New-20Jersey-20coast-Repository-20Data-20-20surface-20water.csv/eml.etree'

Stack:

2024-12-19 17:33:47 23186    ERROR Exception
Traceback (most recent call last):
  File "/home/pasta/miniconda3/envs/dex/lib/python3.11/site-packages/flask/app.py", line 917, in full_dispatch_request
    rv = self.dispatch_request()
         ^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pasta/miniconda3/envs/dex/lib/python3.11/site-packages/flask/app.py", line 902, in dispatch_request
    return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args)  # type: ignore[no-any-return]
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pasta/dex/dex/views/profile.py", line 25, in profile
    csv_df, raw_df, eml_ctx = dex.csv_parser.get_parsed_csv_with_context(rid)
                              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pasta/dex/dex/csv_parser.py", line 28, in get_parsed_csv_with_context
    eml_ctx = get_eml_ctx(rid)
              ^^^^^^^^^^^^^^^^
  File "/home/pasta/dex/dex/csv_parser.py", line 37, in get_eml_ctx
    dt_el = dex.eml_cache.get_data_table_el(rid)
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pasta/dex/dex/eml_cache.py", line 160, in get_data_table_el
    eml_el = get_eml_etree(rid)
             ^^^^^^^^^^^^^^^^^^
  File "/home/pasta/dex/dex/cache.py", line 110, in wrapper
    if flask.current_app.config["DISK_CACHE_ENABLED"] and is_cached(rid, key, obj_type):
                                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pasta/dex/dex/cache.py", line 145, in is_cached
    if cache_path.exists():
       ^^^^^^^^^^^^^^^^^^^
  File "/home/pasta/miniconda3/envs/dex/lib/python3.11/pathlib.py", line 1235, in exists
    self.stat()
  File "/home/pasta/miniconda3/envs/dex/lib/python3.11/pathlib.py", line 1013, in stat
    return os.stat(self, follow_symlinks=follow_symlinks)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
OSError: [Errno 36] File name too long: '/home/pasta/dex-cache/https-ezeml.edirepository.org-user-data-Joanna_Alexandra_Guldin_Guldin-52ed8878f551e1a9cbe623a7f489cada-uploads-Groundwater-derived-20nutrient-20fluxes-20and-20offshore-20mixing-20rates-20along-20the-20New-20Jersey-20coast-Repository-20Data-20-20surface-20water.csv/eml.etree'
2024-12-19 17:33:47 23186    ERROR Exception on /dex/profile/84906 [GET]
Traceback (most recent call last):
  File "/home/pasta/miniconda3/envs/dex/lib/python3.11/site-packages/flask/app.py", line 1511, in wsgi_app
    response = self.full_dispatch_request()
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pasta/miniconda3/envs/dex/lib/python3.11/site-packages/flask/app.py", line 920, in full_dispatch_request
    return self.finalize_request(rv)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pasta/miniconda3/envs/dex/lib/python3.11/site-packages/flask/app.py", line 939, in finalize_request
    response = self.make_response(rv)
               ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pasta/miniconda3/envs/dex/lib/python3.11/site-packages/flask/app.py", line 1212, in make_response
    raise TypeError(
TypeError: The view function for 'profile.profile' did not return a valid response. The function either returned None or ended without a return statement.
2024-12-19 17:33:47 23186    ERROR Exception
Traceback (most recent call last):
  File "/home/pasta/miniconda3/envs/dex/lib/python3.11/site-packages/flask/app.py", line 1511, in wsgi_app
    response = self.full_dispatch_request()
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pasta/miniconda3/envs/dex/lib/python3.11/site-packages/flask/app.py", line 920, in full_dispatch_request
    return self.finalize_request(rv)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pasta/miniconda3/envs/dex/lib/python3.11/site-packages/flask/app.py", line 939, in finalize_request
    response = self.make_response(rv)
               ^^^^^^^^^^^^^^^^^^^^^^
  File "/home/pasta/miniconda3/envs/dex/lib/python3.11/site-packages/flask/app.py", line 1212, in make_response
    raise TypeError(
TypeError: The view function for 'profile.profile' did not return a valid response. The function either returned None or ended without a return statement.

Metadata

Metadata

Assignees

Labels

Type

Projects

Status

No status

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions