Unicode issues

[techdragon]

  File "build/bdist.macosx-10.9-intel/egg/pytrace/reader/trace_walker.py", line 70, in __getitem__
  File "/Users/techdragon/.virtualenvs/salt-dev/lib/python2.7/site-packages/sqlalchemy/orm/loading.py", line 65, in instances
    fetch = cursor.fetchall()
  File "/Users/techdragon/.virtualenvs/salt-dev/lib/python2.7/site-packages/sqlalchemy/engine/result.py", line 788, in fetchall
    self.cursor, self.context)
  File "/Users/techdragon/.virtualenvs/salt-dev/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1076, in _handle_dbapi_exception
    exc_info
  File "/Users/techdragon/.virtualenvs/salt-dev/lib/python2.7/site-packages/sqlalchemy/util/compat.py", line 185, in raise_from_cause
    reraise(type(exception), exception, tb=exc_tb)
  File "/Users/techdragon/.virtualenvs/salt-dev/lib/python2.7/site-packages/sqlalchemy/engine/result.py", line 782, in fetchall
    l = self.process_rows(self._fetchall_impl())
  File "/Users/techdragon/.virtualenvs/salt-dev/lib/python2.7/site-packages/sqlalchemy/engine/result.py", line 749, in _fetchall_impl
    return self.cursor.fetchall()
sqlalchemy.exc.OperationalError: (OperationalError) Could not decode to UTF-8 column 'arg_values_1_value' with text ''%(asctime)s,%(msecs)03.0f [%(name)-17s][%(levelname)-8s] %(message)s'' None None

Looks like non unicode data is creeping into the trace database from the C side of things. Not sure how to troubleshoot this. Anyone more familiar with C able to look at this?

[alonho]

Thanks for the patience and opening these issues. I'm currently on vacation
in Argentina in a city with really crappy WiFi so it will take a couple of
weeks until I'll be able to address this issue.

I couldn't reproduce it on my machine but I believe you're correct and it's
a bug in the string serialization happening in the C extension.

What python version are you using?

You might be able to use the 'filter modules' option to trace selected
modules or packages and avoid this bug.
On Feb 24, 2014 10:16 PM, "Samuel Bishop" notifications@github.com wrote:

File "build/bdist.macosx-10.9-intel/egg/pytrace/reader/trace_walker.py", line 70, in getitem
File "/Users/techdragon/.virtualenvs/salt-dev/lib/python2.7/site-packages/sqlalchemy/orm/loading.py", line 65, in instances
fetch = cursor.fetchall()
File "/Users/techdragon/.virtualenvs/salt-dev/lib/python2.7/site-packages/sqlalchemy/engine/result.py", line 788, in fetchall
self.cursor, self.context)
File "/Users/techdragon/.virtualenvs/salt-dev/lib/python2.7/site-packages/sqlalchemy/engine/base.py", line 1076, in _handle_dbapi_exception
exc_info
File "/Users/techdragon/.virtualenvs/salt-dev/lib/python2.7/site-packages/sqlalchemy/util/compat.py", line 185, in raise_from_cause
reraise(type(exception), exception, tb=exc_tb)
File "/Users/techdragon/.virtualenvs/salt-dev/lib/python2.7/site-packages/sqlalchemy/engine/result.py", line 782, in fetchall
l = self.process_rows(self._fetchall_impl())
File "/Users/techdragon/.virtualenvs/salt-dev/lib/python2.7/site-packages/sqlalchemy/engine/result.py", line 749, in _fetchall_impl
return self.cursor.fetchall()
sqlalchemy.exc.OperationalError: (OperationalError) Could not decode to UTF-8 column 'arg_values_1_value' with text ''%(asctime)s,%(msecs)03.0f [%(name)-17s][%(levelname)-8s] %(message)s'' None None

Looks like non unicode data is creeping into the trace database from the C
side of things. Not sure how to troubleshoot this. Anyone more familiar
with C able to look at this?

Reply to this email directly or view it on GitHubhttps://github.com//issues/15
.

[techdragon]

Ive got a traces.sqlite that contains the 'bad' chars. I can upload it if that will help.