Port to Python3, use up to date SQLAlchemy, plus some extensions #8
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…etween locale and datetime.strptime Passes all tests with Python3 Python 3.8.6 (in locale FR_fr)
…igurable, added documentation
Note that doing so uncovers some porting issues in code sections not covered by other tests.
…5424 to work in this environment This checkpoint prepares move of class RSyParsing to parsers2.py
- adds ''traditional templates'' via class RSysTradiVariant, - defined formats FileFormat, TraditionalFileFormat, ForwardFormat, TraditionalForwardFormat. - adds SyslogRFC5424 for parsing this format requires package syslog_rfc5424_parser
Inspired by Github Actions Quickstart: https://docs.github.com/en/actions/quickstart See what happens!
Create linterExercise.yml
…g, import ordering
Try correction to yaml (next step will be RTFM)
Correcting YAML syntax
Removed automated workflow submission on push; manual dispatch for lint and python/logtools
…toolsrc on test server Added test data
Corrected typo
…ing on Github Actions platform; may need further investigation in os.system launched scripts
…ysql 8.0, SQLsoup, SQLAlchemy
…LAlchemy, connected to Mysql8.0
…o improve SQL parametrization, json log input. Later may also want to put log extract in DB
Logdb added with ability to load a database table from JSON data using a tree like schema
Utility to walk JSON facilitating interface to class implementing insertion in database
Checkpoint first (partly) successful execution against the DB ('tree')
Fiils tree table from inspect data
Logdb able to load a database (with a tree like schema) from an extracted JSON.
Multiple JSONs loads are managed by timestamp.
…lication dependent code in logtools/ext_db.py
This version checks whether we have a full featured dpath (from AlainLich/dpath-python; PR pending) or the default (from Pypi), to set flags and warn the user.
…s): still requiring corrections
the tests are dependent on this interface, the logtools library should not require this since a different DB or interface might be used
…tools.d/tradi....txt
…ect to obtain JSON
…table to github.Actions
…n non DB Yaml script, definition of SQlite file in Yaml script.
…gtoolsrc.sh Improved formatting in SQLite output
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Hi,
This PR:
geoIP, ̀logfilter`).SQLAlchemy, getting rid ofsqlsoupGithub)
Full functionality depends on using a non standard version of
dpath_pythonhttps://github.com/AlainLich/dpath-python,for which a PR is pending. May make distribution more complicated.
I will take remarks into account if this facilitates integration, response could depend on amount of work involved.
This is not modular (sorry), things got interesting enough to warrant a PR quite late in the development, when I found out that I had to move to up to date
SQLAlchemy, not compatible withsqlsoup.